From the course: Complete Guide to Apache Kafka for Beginners
Unlock the full course today
Join today to access over 23,200 courses taught by industry experts.
Consumer offsets commit strategies - Kafka Tutorial
From the course: Complete Guide to Apache Kafka for Beginners
Consumer offsets commit strategies
Hi, this is Stephane from Conduktor and we're going to have a look at the consumer offset commit strategies available to you. So there are two common patterns for committing offsets in your application. The first one is the easy one that we've been using so far, which is that enable auto commit is true, and then we get a synchronous processing of batches. And this is what we've been doing in our code. And the second one is to disable, enable auto commit and to manually commit offsets. There may be some advantages there, but you need to be aware of the trade offs you're making. So let's dive in. So first, let's do a deep dive into the auto offset commit behavior. So when you use the Java Consumer API behind the scenes, the offsets are going to be regularly committed as you've seen before. And this enables at least once reading scenarios by default under certain conditions. So these offsets are going to be committed whenever the poll function is going to be called in your code. And then…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Contents
-
-
-
-
-
-
-
-
-
-
-
(Locked)
OpenSearch consumer: Project overview52s
-
(Locked)
OpenSearch consumer: Project setup3m 32s
-
(Locked)
Setting up OpenSearch on Docker2m 38s
-
(Locked)
Setting up OpenSearch on the Cloud1m 57s
-
OpenSearch 1014m 26s
-
(Locked)
OpenSearch consumer implementation: Part 17m 26s
-
(Locked)
OpenSearch consumer implementation: Part 29m 34s
-
(Locked)
Consumer delivery semantics3m 16s
-
(Locked)
OpenSearch consumer implementation: Part 3 idempotence5m 29s
-
(Locked)
Consumer offsets commit strategies4m 38s
-
(Locked)
OpenSearch consumer implementation: Part 4 delivery semantics4m 52s
-
(Locked)
OpenSearch consumer implementation: Part 5 batching data4m 20s
-
(Locked)
Consumer offset reset behavior2m 6s
-
(Locked)
OpenSearch consumer implementation: Part 6 replaying data2m 57s
-
(Locked)
Consumer internal threads5m
-
(Locked)
Consumer replica fetching: Rack awareness2m 50s
-
(Locked)
-
-
-
-
-