From the course: Complete Guide to Apache Kafka for Beginners
Unlock the full course today
Join today to access over 23,200 courses taught by industry experts.
Wikimedia producer project setup - Kafka Tutorial
From the course: Complete Guide to Apache Kafka for Beginners
Wikimedia producer project setup
Hi, this is Stephane from Conduktor and welcome to this section on the Wikimedia producer and producer configurations. So we're going to first set up the project to be able to take data from Wikimedia in a Kafka producer into Kafka. And we'll have a look at the recent change stream. We'll have a look at a few demos as well available to us to see the kind of transformations we're going to do. We will set up Java libraries for our project in this lecture just to get started. So we'll set up Okhttp3 as well as Okhttp-eventsource and all these things should be enough for us to start writing our code. Okay. So the first thing we're going to do is go to this URL to see the recent changes of Wikimedia. And actually, you see this page keeps on being updated and it goes really, really fast. And this is a stream, a real time stream accessible from your web browser of all the changes happening in Wikimedia in real time. So as you can see, it's quite a fairly high throughput type of data stream…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Contents
-
-
-
-
-
-
-
-
-
-
(Locked)
Wikimedia producer project setup6m 25s
-
(Locked)
Wikimedia producer implementation11m 54s
-
(Locked)
Wikimedia producer run2m 40s
-
Wikimedia producer: Producer config intros45s
-
(Locked)
Producer acknowledgments deep dive8m 48s
-
(Locked)
Producer retries3m 3s
-
(Locked)
Idempotent producer2m 52s
-
(Locked)
Safe Kafka producer settings1m 59s
-
(Locked)
Wikimedia producer safe producer implementation4m 3s
-
(Locked)
Kafka message compression4m 47s
-
(Locked)
linger.ms and batch.size producer settings3m 23s
-
(Locked)
Wikimedia producer high-throughput implementation3m 16s
-
(Locked)
Producer default partitioner and sticky partitioner4m 18s
-
(Locked)
[Advanced] max.block.ms and buffer.memory2m 39s
-
(Locked)
-
-
-
-
-
-