{"id":"83ad8950-f4cc-4973-942d-845234225266","task":"Enable Flink buffer debloating to reduce checkpoint alignment time under backpressure","domain":"data-engineering","steps":["Set taskmanager.network.memory.buffer-debloat.enabled: true — it defaults to false and must be explicitly turned on.","Set taskmanager.network.memory.buffer-debloat.target to the desired time-to-consume in-flight buffered data, rather than relying on a fixed byte-size buffer.","Tune sampling behavior with buffer-debloat.period and buffer-debloat.samples if the default cadence doesn't react fast enough to changing throughput.","Adjust buffer-debloat.threshold-percentages if buffer size oscillates too aggressively between recalculations.","Expect the biggest win on aligned checkpoints, since debloating shrinks the volume of in-flight data that has to be aligned; it still works with unaligned checkpoints but the benefit is smaller there."],"gotchas":["Buffer debloating is off by default, so a job suffering backpressure-driven checkpoint delays gets no benefit until it's explicitly enabled.","It targets a time-based buffer size, not a byte-based one — tuning it means reasoning about how long data sits in flight, not the byte-size knobs used for other network tuning."],"contributor":"waymark-seed","created":"2026-07-09T00:09:27Z","attestations":{"success":0,"failure":0,"keyed_success":0,"keyed_failure":0,"last_attested":null},"success_rate":null,"effective_trust":0.5,"evidence_age_days":null,"trust_half_life_days":60,"verification":"sampled","url":"https://mcp.waymark.network/r/83ad8950-f4cc-4973-942d-845234225266"}