0 views
Read
#0
Learn Apache Kafka - Pre-Requisites Skills & Environment Setup
Before touching Apache Kafka, you need to master the concepts of distributed systems, pub/sub messaging, and data serialization. In this episode you will also set up the JDK, Kafka binary, and Docker, then verify that your entire environment is ready to use.
August 10, 2026
00
Read
#1
Learn Apache Kafka - History, Background & Why You Need Event Streaming
This episode covers the journey of event streaming from traditional messaging to the birth of Apache Kafka at LinkedIn in 2011. You will also learn about the problems Kafka solves, its comparison with RabbitMQ, Kinesis, and Pulsar, and the main use cases of event streaming.
August 10, 2026
00
Read
#2
Learn Apache Kafka - Core Concepts & Architecture of Apache Kafka
This episode dissects Kafka's core concepts: events, topics, partitions, brokers, clusters, offsets, and consumer groups. You will also understand the distributed commit log architecture, the role of the controller broker, replication mechanisms, and log segment-based storage.
August 10, 2026
00
Read
#3
Learn Apache Kafka - Installation & Cluster Setup
This episode walks you through installing Kafka using the binary, Docker, and cloud managed services. You will understand the difference between ZooKeeper and KRaft mode, build single-node and multi-broker clusters, and master the CLI tools for managing clusters.
August 10, 2026
00
Read
#4
Learn Apache Kafka - Topics & Partitions Deep Dive
This episode dissects topics and partitions in depth: creating topics, naming rules, configuration parameters, key-based partitioning strategies, round-robin, custom partitioners, and retention, segment, and cleanup policies such as delete and compact.
August 10, 2026
00
Read
#5
Learn Apache Kafka - Producers: Writing Data to Kafka
This episode covers Kafka producers: the structure of a ProducerRecord, basic configuration, the fire-and-forget, synchronous, and asynchronous delivery patterns with callbacks, batching, tuning acks, retries, compression, and idempotent producers to prevent duplicates.
August 10, 2026
00
Read
#6
Learn Apache Kafka - Consumers: Reading Data from Kafka
This episode covers Kafka consumers: subscription, polling, lifecycle, consumer groups and rebalancing, partition assignment strategies, offset management with auto-commit and manual commit, and tuning consumer parameters for the right latency and throughput.
August 10, 2026
00
Read
#7
Learn Apache Kafka - Message Serialization & Schema Management
This episode covers Kafka data serialization: String, JSON, Avro, and Protobuf, plus the differences in performance and ease of use. You will also learn about the Confluent Schema Registry, schema evolution, compatibility types, and schema design best practices.
August 10, 2026
00
Read
#8
Learn Apache Kafka - Message Ordering & Delivery Semantics
This episode covers Kafka's ordering guarantees: ordering per partition and per key, global ordering limits, and the at-most-once, at-least-once, and exactly-once delivery semantics. You will also understand the role of idempotent producers and transactional messaging as the foundation of EOS.
August 10, 2026
00
Read
#9
Learn Apache Kafka - Kafka Transactions
This episode covers Kafka transactions: the initTransactions, beginTransaction, send, commitTransaction, and abortTransaction lifecycle. You will also learn the read-process-write pattern, configuring transactional.id, transaction.timeout.ms, isolation.level, and the performance trade-offs.
August 10, 2026
00