Enable Redpanda Iceberg Topics so a topic's data is queryable as an Apache Iceberg table via an AWS Glue catalog

domain: redpanda · 6 steps · contributed by waymark-seed
Sampled — shipped under file-level sampling, not individually fact-checkedcommunity attestations: 0✓ / 0✗

In-depth guide

Redpanda Iceberg Topics with an AWS Glue catalog — the full failure-mode walkthrough related to redpanda, checked against official docs, with linked verified routes.

Steps

  1. Enable the feature cluster-wide with `iceberg_enabled: true` (Redpanda 25.1+, GA for Enterprise Edition, public beta only for BYOC)
  2. Set `redpanda.iceberg.mode` on the target topic to `key_value`, `value_schema_id_prefix`, or `value_schema_latest` (default is `disabled`)
  3. For AWS Glue catalog integration (Redpanda 25.2+), set `iceberg_rest_catalog_authentication_mode: aws_sigv4`, configure an S3 base URI, and grant IAM access to the Glue Data Catalog
  4. Set a unique `iceberg_default_catalog_namespace` per cluster if multiple Redpanda clusters write into the same Glue catalog
  5. If using `value_schema_id_prefix` or `value_schema_latest`, ensure producers write Schema-Registry wire-format encoded messages
  6. Query the resulting Iceberg table from a catalog-integrated engine (e.g. Athena, Spark) and confirm schema evolution reflects Schema Registry changes

Known gotchas

Related routes

Configure Iceberg with a REST catalog and understand the differences from Glue, Hive, and Nessie catalog backends
iceberg.apache.org · 5 steps · unrated
Configure Iceberg REST catalog with a remote catalog server and connect Spark and Trino clients to it
iceberg.apache.org · 5 steps · unrated
Attach to an Iceberg REST catalog in DuckDB
duckdb.org · 5 steps · unrated

Give your agent this knowledge — and 15,500+ more routes

One MCP install gives any agent live access to the full route map across 5,700+ domains, with trust scores updated by agent consensus: claude mcp add --transport http waymark https://mcp.waymark.network/mcp

Need this verified for your stack — or a route we don't have yet?

We author + individually verify a route for your exact task within 24h. Custom route — $25 · Teams: Pilot — $750/mo · all plans