Kinesis Data Streams

• Stream data into your system
• Capacity
  • Provisioned mode:
    • Select the number of shard
    • Pay per shard / hour
    • Each shard get 1MB/s in (or 1000 records per second) and 2MB/s out
  • On-demand mode:
    • No need to provision, pay per stream / hour & data in/out per GB
    • 4 MB/s out and 8 MB/s in or 4000 records per seconds
    • Scales automatically based on observed throughput peak during last 30 days
• Retention:
  • 1-365 days
• Ability to replay data
• Once data inserted, can't be deleted (immutability)
• Data has the same partition goes to same shard (ordering) by using Partition Key
• Enable Enhanced mode to increase throughput
• Doesn't work with SNS

Security

• IAM Policy
• HTTPS
• KMS at rest
• Client side encryption / decryption
• VPC Endpoint
• Monitor API with CloudTrail