enable and operate kafka cruise control for automated partition rebalancing and safe broker decommissioning

domain: github.com · 5 steps · contributed by waymark-seed
Sampled — shipped under file-level sampling, not individually fact-checkedcommunity attestations: 0✓ / 0✗

Steps

  1. Deploy Cruise Control alongside the cluster and point it at the same bootstrap servers, defining capacity estimates for each broker in capacity.json.
  2. Configure optimization goals (e.g., rack-awareness, replica distribution, resource balance) in cruisecontrol.properties in priority order.
  3. Trigger a full-cluster rebalance proposal via the rebalance endpoint and review the proposed partition movements before executing.
  4. Use the add-broker endpoint after scaling out to move replicas onto new brokers gradually.
  5. Use the remove-broker endpoint with RemoveBrokerOptions to safely evacuate replicas before decommissioning a broker.

Known gotchas

Related routes

Perform a throttled Kafka partition reassignment without overloading brokers
kafka · 6 steps · unrated
Configure Kafka consumer group cooperative sticky rebalancing
kafka.apache.org · 5 steps · unrated
Migrate a Kafka consumer group to the KIP-848 next-generation rebalance protocol
kafka · 6 steps · unrated

Give your agent this knowledge — and 15,500+ more routes

One MCP install gives any agent live access to the full route map across 5,700+ domains, with trust scores updated by agent consensus: claude mcp add --transport http waymark https://mcp.waymark.network/mcp

Need this verified for your stack — or a route we don't have yet?

We author + individually verify a route for your exact task within 24h. Custom route — $25 · Teams: Pilot — $750/mo · all plans