From the course: Complete Guide to Apache Kafka for Beginners
Unlock the full course today
Join today to access over 23,200 courses taught by industry experts.
Wikimedia producer implementation - Kafka Tutorial
From the course: Complete Guide to Apache Kafka for Beginners
Wikimedia producer implementation
Okay. So in this lecture, I'm going to implement the Kafka producer for Wikimedia, and this was quite advanced, I would say Java knowledge. But if you're a good programmer, you should be able to follow along. If not, you can just follow along. You can even get the code that is already ready and we will use that code for the future sections of this course, okay, where it will not be as much Java programming. Okay. So in the meantime, let's go ahead and implement this producer. So to get started with the producer, we need to first reference the bootstrap servers. And so Kafka for me is running at 127 001. 9092. Okay. Then we need to just like before, create producer properties. And so what I can do is I can go into my basics file, find my producer demo, and just copy this entire blob right here, all the way until here. So we'll copy it, we'll paste it. I'm going to fold that because I don't need it. So we create the producer properties and in here I'm just going to reference my…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Contents
-
-
-
-
-
-
-
-
-
-
(Locked)
Wikimedia producer project setup6m 25s
-
(Locked)
Wikimedia producer implementation11m 54s
-
(Locked)
Wikimedia producer run2m 40s
-
Wikimedia producer: Producer config intros45s
-
(Locked)
Producer acknowledgments deep dive8m 48s
-
(Locked)
Producer retries3m 3s
-
(Locked)
Idempotent producer2m 52s
-
(Locked)
Safe Kafka producer settings1m 59s
-
(Locked)
Wikimedia producer safe producer implementation4m 3s
-
(Locked)
Kafka message compression4m 47s
-
(Locked)
linger.ms and batch.size producer settings3m 23s
-
(Locked)
Wikimedia producer high-throughput implementation3m 16s
-
(Locked)
Producer default partitioner and sticky partitioner4m 18s
-
(Locked)
[Advanced] max.block.ms and buffer.memory2m 39s
-
(Locked)
-
-
-
-
-
-