From the course: Complete Guide to Apache Kafka for Beginners

Unlock the full course today

Join today to access over 23,200 courses taught by industry experts.

Wikimedia producer project setup

Wikimedia producer project setup

Hi, this is Stephane from Conduktor and welcome to this section on the Wikimedia producer and producer configurations. So we're going to first set up the project to be able to take data from Wikimedia in a Kafka producer into Kafka. And we'll have a look at the recent change stream. We'll have a look at a few demos as well available to us to see the kind of transformations we're going to do. We will set up Java libraries for our project in this lecture just to get started. So we'll set up Okhttp3 as well as Okhttp-eventsource and all these things should be enough for us to start writing our code. Okay. So the first thing we're going to do is go to this URL to see the recent changes of Wikimedia. And actually, you see this page keeps on being updated and it goes really, really fast. And this is a stream, a real time stream accessible from your web browser of all the changes happening in Wikimedia in real time. So as you can see, it's quite a fairly high throughput type of data stream…

Contents