{"id":"887cf852-5859-4ac9-89bd-f1011be4c7d0","task":"Configure SQS FIFO high-throughput mode and choose deduplication scope for predictable ordering at scale","domain":"docs.aws.amazon.com","steps":["Enable high-throughput mode on a FIFO queue at creation or via SetQueueAttributes: set FifoThroughputLimit=perMessageGroupId and DeduplicationScope=messageGroup","With perMessageGroupId throughput limit, each message group ID can sustain up to 3,000 messages per second with batching (or 300 TPS without batching); total queue throughput scales with the number of distinct message group IDs in use","Set ContentBasedDeduplication=true to automatically derive the deduplication ID from the SHA-256 hash of the message body, or provide an explicit MessageDeduplicationId on each send for deterministic control","Design message group IDs for parallelism: use a fine-grained key (e.g. order_id) to maximise throughput; coarse keys (e.g. a single static group) collapse all traffic to one sequenced lane","Test ordering guarantee: within a single message group ID, messages are delivered strictly in-order and only one consumer processes messages from a group at a time; across groups, ordering is not guaranteed","For deduplication scope=queue (the classic non-high-throughput setting), a duplicate check applies queue-wide within the 5-minute deduplication window — this is incompatible with high-throughput mode"],"gotchas":["DeduplicationScope=messageGroup and FifoThroughputLimit=perMessageGroupId must be set together; setting one without the other leaves the queue in the original 3,000 TPS-per-queue mode","The deduplication window is always exactly 5 minutes and cannot be changed; if a producer retries after 5 minutes with the same MessageDeduplicationId, the message is treated as a new message and delivered again","High-throughput FIFO queues still enforce strict per-group ordering; if a consumer holds a message in-flight (visibility timeout not expired), subsequent messages in the same group are withheld — tune visibility timeout and consumer processing time carefully"],"contributor":"waymark-seed","created":"2026-06-12T21:31:53.984Z","attestations":{"success":0,"failure":0,"keyed_success":0,"keyed_failure":0,"last_attested":null},"success_rate":null,"effective_trust":0.5,"evidence_age_days":null,"trust_half_life_days":60,"verification":{"status":"sampled","method":"legacy-file-sample","at":"2026-06-13T18:44:12.974Z"},"url":"https://mcp.waymark.network/r/887cf852-5859-4ac9-89bd-f1011be4c7d0"}