From the course: Complete Guide to Apache Kafka for Beginners
Unlock the full course today
Join today to access over 23,200 courses taught by industry experts.
Brokers and topics - Kafka Tutorial
From the course: Complete Guide to Apache Kafka for Beginners
Brokers and topics
Hi, this is Stephane from Conduktor. And in this lecture, we're finally going to learn about the Kafka brokers. So a Kafka cluster is an ensemble of multiple Kafka brokers, and a broker is just a server. Okay. But in Kafka, they're called brokers because they receive and send data. So a Kafka broker is going to be identified with an ID, which is an integer. And so, for example, we're going to have broker 101, broker 102 and broker 103 in our cluster. Now each broker is going to contain only certain topic partitions. That means that your data is going to be distributed across all brokers, and we will see how in the next slide. And then there is a very specific aspect in Kafka that I will describe as well in the next slides, which is called that after you connect to any Kafka broker, also called a bootstrap broker, then the clients or the producers or the consumers will be connected and know how to connect to the entire Kafka cluster because the Kafka clients have a smart mechanics for…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Contents
-
-
-
Topics, partitions, and offsets6m 10s
-
(Locked)
Producers and message keys7m 24s
-
(Locked)
Consumers and deserialization4m 1s
-
(Locked)
Consumer groups and consumer offsets7m 4s
-
(Locked)
Brokers and topics4m 28s
-
(Locked)
Topic replication5m 30s
-
(Locked)
Producer acknowledgments and topic durability2m 9s
-
(Locked)
ZooKeeper5m 14s
-
Kafka KRaft: Removing ZooKeeper1m 58s
-
(Locked)
Theory roundup1m 33s
-
-
-
-
-
-
-
-
-
-
-
-
-
-