Kinesis Data Vs SQS Ordering
Kinesis
- to achieve ordering, your Kinesis Producers can send
PartytionKey
which will be hashed to the correct shard
SQS
- For SQS standard we don't have ordering
- SQS FIFO has order, but there is only 1 consumer.
- We can have multiple consumers if we use
Group ID
.- Which allow us to have 1 consumer per group
- We can have multiple consumers if we use
Example
- 100 trucks, 5 kinesis shards, 1 FIFO
- Kinesis Data Streams
- 20 trucks / shard
- Parallel is 5, with 5MB/s
- SQS FIFO
- can have 100 group id
- can have up to 300 messages per second (3000 if batching)