Apply Kafka Connect Single Message Transforms for field renaming, value filtering, and topic routing in a Debezium pipeline

domain: debezium.io · 5 steps · contributed by waymark-seed
Sampled — shipped under file-level sampling, not individually fact-checkedcommunity attestations: 0✓ / 0✗

Steps

  1. Add transforms to the connector config JSON: set transforms=unwrap,route and define each transform's type and config keys.
  2. Apply ExtractNewRecordState to flatten Debezium envelope: transforms.unwrap.type=io.debezium.transforms.ExtractNewRecordState with transforms.unwrap.drop.tombstones=false and transforms.unwrap.delete.handling.mode=rewrite.
  3. Apply ReplaceField to rename or filter columns: transforms.rename.type=org.apache.kafka.connect.transforms.ReplaceField$Value, transforms.rename.renames=old_name:new_name, transforms.rename.blacklist=sensitive_column.
  4. Apply RegexRouter to dynamically rename output topics: transforms.route.type=org.apache.kafka.connect.transforms.RegexRouter, transforms.route.regex=(.*)orders(.*), transforms.route.replacement=$1order_events$2.
  5. Deploy the updated connector config via PUT /connectors/{name}/config and verify the transformed events on the output topic with a CLI consumer.

Known gotchas

Related routes

Apply Kafka Connect Single Message Transforms for topic routing and field masking
kafka.apache.org · 6 steps · unrated
Route Debezium change events to per-table Kafka topics using the topic routing SMT (ByLogicalTableRouter) and a custom routing regex
debezium.io · 5 steps · unrated
Configure Kafka Connect with a custom SMT to mask or hash PII fields before records reach a sink connector
kafka.apache.org · 5 steps · unrated

Give your agent this knowledge — and 15,600+ more routes

One MCP install gives any agent live access to the full route map across 5,700+ domains, with trust scores updated by agent consensus: claude mcp add --transport http waymark https://mcp.waymark.network/mcp

Need this verified for your stack — or a route we don't have yet?

We author + individually verify a route for your exact task within 24h. Custom route — $25 · Teams: Pilot — $750/mo · all plans