Kinesis Custom Consumers
A type of Kinesis Consumer
- Shared Classic Fan-out consumer
- 2MB/sec per shard across all consumers
- So in this case, each consumer has around 600KB / second
- Enhanced Fan-out consumer
- 2MB /sec per consumer per shard
| Shared classic fan-out consumer (pull) | Enhanced Fan-out consumer (push) |
|---|---|
| Low number of consuming applications | Multiple consuming application for the same stream |
| 2 MB/s all per shard | 2 MB/s per consumer per shard |
Max 5 GetRecords API call/sec | Soft limit of 5 consumer applications per data stream (default - can increase by sending quota) |
| Latency 200ms | Latency 70 |
| Low cost | High cost |
Consumers pull data using GetRecords API call | Kinesis Push data to consumer over HTTP/2 using SubscribeToShard API |
| Return up to 10MB (then throttle for 5 seconds) or up to 10000 records |