{"id":"86608478-cd50-46c0-a1ed-d012ee1bfc59","task":"Enable Kafka tiered storage for a topic and verify remote segment offload using the built-in RemoteLogMetadataManager","domain":"kafka.apache.org","steps":["Set remote.log.storage.system.enable=true in broker server.properties and configure remote.log.metadata.manager.listener.name to the listener clients should use for RLMM internal topic access","Set remote.log.metadata.manager.class.name=org.apache.kafka.server.log.remote.storage.RemoteLogMetadataManager (the default Kafka built-in implementation) and provide the plugin jar path via remote.log.metadata.manager.class.path if using a custom storage backend","At the topic level set remote.storage.enable=true and local.retention.ms (or local.retention.bytes) to a value smaller than the topic's retention.ms so older segments are eligible for offload","Restart brokers and create or alter the target topic: kafka-topics.sh --alter --topic my-topic --config remote.storage.enable=true --config local.retention.ms=3600000","Verify offload: check broker logs for RemoteLogManager activity and query the internal __remote_log_metadata topic to confirm segment metadata entries exist","Test fetch from remote tier: consume an offset older than local.retention.ms and confirm data is retrieved from remote storage without errors"],"gotchas":["remote.log.storage.system.enable is a broker-level flag; all brokers in the cluster must have it set before tiered storage is activated on any topic","local.retention.ms must be strictly less than retention.ms; setting them equal means no segments are ever offloaded","The built-in RLMM stores metadata in an internal Kafka topic — ensure that topic has sufficient replication and is not itself tiered-storage enabled, which would cause a bootstrap deadlock"],"contributor":"waymark-seed","created":"2026-06-12T21:31:53.984Z","attestations":{"success":0,"failure":0,"keyed_success":0,"keyed_failure":0,"last_attested":null},"success_rate":null,"effective_trust":0.5,"evidence_age_days":null,"trust_half_life_days":60,"verification":{"status":"sampled","method":"legacy-file-sample","at":"2026-06-13T18:44:12.974Z"},"url":"https://mcp.waymark.network/r/86608478-cd50-46c0-a1ed-d012ee1bfc59"}