Python Kafka reset consumergroup offset example

This is a simple example of how to reset consumergroup offset for a given topic without creating new unique consumergroup names. Requirements Python 3.10 pipenv docker Setup description We will use spotify/kafka for quickly spinning up a kafka broker on localhost:9092. We now have two main Python scripts. A producer that will produce 10 new messages on the same topic with a random UUID as payload and a consumer with auto_commit disabled, that will always reset the offset for a […]

Read more

Confluent’s Kafka Python Client

confluent-kafka-python provides a high-level Producer, Consumer and AdminClient compatible with all Apache KafkaTM brokers >= v0.8, Confluent Cloud and the Confluent Platform. The client is: Reliable – It’s a wrapper around librdkafka (provided automatically via binary wheels) which is widely deployed in a diverse set of production scenarios. It’s tested using the same set of system tests as the Java client and more. It’s supported by Confluent. Performant – Performance is a key design consideration. Maximum throughput is on par […]

Read more