Open Source Hong Kong Meetup #90 Queues for Kafka 4.1

Introduction & Refreshment

Vibe Coding for Open Source - Nick Hao

Vibe Coding enables anyone to realize their ideas without worrying too much about technical implementation. In this speech, Nick will demonstrate how Vibe Coding allows both IT and non-IT people to contribute to open source projects. He will also share how he created a Python-based open-source project driven by personal interest and implemented through Vibe Coding.

Queues for Kafka - Leo Yuen, partner solution architect Confluent

Event streaming excels, but sometimes a message queue is easier, especially when parallel consumption outweighs strict ordering. Wouldn't it be ideal to consume Apache Kafka data like a queue? For independent work items, you may prefer to run multiple consumers cooperating and acknowledging messages one at a time upon completion, perhaps even retrying specific messages. This is simpler with a queue than a standard topic/consumer group. KIP-932 introduces queuing semantics to Kafka via share groups. These allow applications to consume from regular Kafka topics with per-message acknowledgement without worrying about balancing the number of partitions and consumers. This brings queuing workloads to Kafka. Let's learn about this innovative Preview feature in Apache Kafka 4.1.