From the course: Complete Guide to Apache Kafka for Beginners

Unlock the full course today

Join today to access over 23,200 courses taught by industry experts.

Kafka Schema Registry introduction

Kafka Schema Registry introduction - Kafka Tutorial

From the course: Complete Guide to Apache Kafka for Beginners

Kafka Schema Registry introduction

Hi, this is Stephane from Conduktor and in this lecture, I'm going to show you what is the schema registry and why we need it. So Kafka is very efficient because it takes bytes as an input and then publishes them to consumers. Okay. So there is no data verification done. Your producer is just produces a series of zeros and ones and then your consumers read these zeros and ones. And then the producer to produce the zeros and ones, they will use a serializer and the consumer to consume them, they will use a deserializer. But what if the producer starts sending bad data, for example, a different format? Or what if it feels get renamed? What if the data format changes from one date to another? Then all consumers will break because they are not aware of this. They expect a specific deserializer and then they will crash at runtime because while the deserializer is failing. That means you need a schema registry. We need data to be self describable. We want to be able to evolve data over time…

Contents