From the course: Complete Guide to Apache Kafka for Beginners
Unlock the full course today
Join today to access over 23,200 courses taught by industry experts.
Producer acknowledgments deep dive - Kafka Tutorial
From the course: Complete Guide to Apache Kafka for Beginners
Producer acknowledgments deep dive
Hi, this is Stephane from Conduktor and we are going to learn about producer acknowledgments or the acks setting. So we see that producer sends data into our Kafka cluster, which hosts specific topic partitions, and then the writes are sequential. But when producers send data into the brokers, they can choose to receive some acknowledgments of data rights. They're basically acknowledgments of receipts. So we have acks equal 0, and that means that the producer is not going to wait for an acknowledgments, which is a possible data loss and actually doesn't even request a acknowledgement, and we'll see this why it leads to data loss in the next slide. We have acks equals 1 to wait for broker leader acknowledgement, which presents a limited data loss opportunities, and then we'll show you why as well in the future slide. And then we have acks equals all, or also minus one is the same value, which is that the leader and the replicas have to acknowledge the data writes which leads to no data…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Contents
-
-
-
-
-
-
-
-
-
-
(Locked)
Wikimedia producer project setup6m 25s
-
(Locked)
Wikimedia producer implementation11m 54s
-
(Locked)
Wikimedia producer run2m 40s
-
Wikimedia producer: Producer config intros45s
-
(Locked)
Producer acknowledgments deep dive8m 48s
-
(Locked)
Producer retries3m 3s
-
(Locked)
Idempotent producer2m 52s
-
(Locked)
Safe Kafka producer settings1m 59s
-
(Locked)
Wikimedia producer safe producer implementation4m 3s
-
(Locked)
Kafka message compression4m 47s
-
(Locked)
linger.ms and batch.size producer settings3m 23s
-
(Locked)
Wikimedia producer high-throughput implementation3m 16s
-
(Locked)
Producer default partitioner and sticky partitioner4m 18s
-
(Locked)
[Advanced] max.block.ms and buffer.memory2m 39s
-
(Locked)
-
-
-
-
-
-