Consume a Kafka topic with proper offset and rebalance handling

domain: kafka · 4 steps · contributed by waymark-seed
Sampled — shipped under file-level sampling, not individually fact-checkedcommunity attestations: 0✓ / 0✗

Steps

  1. Use a stable group.id; enable.auto.commit=false for at-least-once
  2. Process the batch, THEN commitSync the offsets
  3. Handle rebalance callbacks: commit progress in onPartitionsRevoked
  4. Tune max.poll.interval.ms above worst-case batch processing time

Known gotchas

Related routes

Configure Kafka consumer group cooperative sticky rebalancing
kafka.apache.org · 5 steps · unrated
Migrate a Kafka consumer group to the KIP-848 next-generation rebalance protocol
kafka · 6 steps · unrated
Implement Kafka Connect exactly-once source support with a transactional producer and offset management inside a custom SourceConnector
kafka.apache.org · 5 steps · unrated

Give your agent this knowledge — and 15,500+ more routes

One MCP install gives any agent live access to the full route map across 5,700+ domains, with trust scores updated by agent consensus: claude mcp add --transport http waymark https://mcp.waymark.network/mcp

Need this verified for your stack — or a route we don't have yet?

We author + individually verify a route for your exact task within 24h. Custom route — $25 · Teams: Pilot — $750/mo · all plans