From the course: Complete Guide to Apache Kafka for Beginners

Important: Starting Kafka and lectures order - Kafka Tutorial

From the course: Complete Guide to Apache Kafka for Beginners

Start my 1-month free trial Buy for my team

Important: Starting Kafka and lectures order

“

Hi, this is Stephane from conduktor and in this section, we're going to see how we can be starting Kafka. And this is one of the most complicated things you'll have to do with Apache Kafka. The instructions depend if you're using Mac, Linux, and Windows. And then for Windows, specific versions of Windows work and don't work. So it's quite a challenge. And we'll have a look at how we can solve this challenge in this section. I have many, many, many videos for you. But the one thing I will be using in this course, that's a no brainer solution and that's why we created Conduktor is to create a Cloud Kafka cluster using conduktor. It will come with a UI. There is no setup to do on your machine and right away you will be able to access a Kafka cluster for free. So we'll be doing this and you will have a UI, which is great for learning Apache Kafka. Nonetheless, I will also show you how to start Kafka on macOS, so you will see how to start Kafka with Zookeeper locally or starting Kafka without Zookeeper. We'll also see how to install Kafka using Brew. We'll look at Linux. So again, start Kafka with Zookeeper or without Zookeeper in KRaft mode. And for Windows, we'll have a look at two different modes. So the WSL2 mode with Kafka and Zookeeper, the WSL2 mode with Kafka without Zookeeper, and finally Kafka on plain Windows, which is not recommended because you have lots of limitations. You cannot delete topics. It only works in Zookeeper mode, and overall I would say don't use it. Try if you have the chance to either use WSL2 or to start Kafka using conduktor on the Cloud. That's really important for you to not go crazy with your homework. So when you are starting, Kafka will use Conduktor with a secure connection. But nonetheless, I will provide you all the commands to do the exact same thing on localhost. So we'll have it on 127.0.0.1 on localhost if we do that and we'll use the native Kafka binaries to run commands either against the Cloud or on localhost. We'll have one broker on localhost and optionally one Zookeeper, which is perfect for development. But on conduktor you'll have a full Kafka cluster with about 39 Kafka brokers. So you'll see what it looks like to have a real production Kafka. And to set up Kafka in production, it's a big headache. It's very complicated. It takes over four hours, and there's a dedicated course in the Apache Kafka series. So right now we're just looking at starting Kafka for development purposes. So here are the steps you need to do to start on Mac, on Linux and on Windows, and I will walk you through it so you know which videos to watch in this section. By the way, all the steps of installation are available on our conduktor kafkademy so you can see how to start Kafka with Conduktor Mac, Linux, Windows and even Docker. Okay. So back here. So if you are on Mac, I would recommend for you to start Kafka on Conduktor on the Cloud. That's very easy. And if you do so, you still need to install the Kafka CLI tools using either the binaries or using brew because we'll be using the CLI to run commands against our Cloud Kafka on Conduktor. If you prefer to go the local route, then you install the Kafka CLI tool using the binary or brew, and then we'll start Kafka using the binaries and then you're ready to go. On Linux, again, very simple. Either you start Kafka on conduktor and then we still need to install the binaries and you're ready to go or I will show you how to start Kafka locally and then we'll issue CLI commands again using the binaries. For Windows, this is where it gets extremely complicated. So if you have a Windows version that's actually recent, using this version 2004, build 19 zero 41 or Windows 11, then all you have to do is to install Windows WSL2 Then two options. Either you start Kafka with conduktor and then use the CLI on WSL2 to issue commands or you go and install everything on WSL2. So you need to install the Kafka CLI using the binaries and then start Kafka on WSL2. If you have a lower version of Windows, I would want 100% recommend that you use Kafka on conduktor because the setup is very difficult on Windows, and then you install Kafka binary tools still on Windows and you're ready to go. But if you want to run Kafka on your lower Windows, plain Windows, you can do it. But this will lead to lots of potential issues, and especially when you delete topics or when you leave it running for too long or whatever. So I do not recommend it, but I will still show you how to do it and then you'll be ready to go. So that's it. Hopefully that gives you some pointers into how to see the next lectures. Just follow this diagram and you'll know where you're going and I will see you in the next lecture.

Contents