Kinesis Client Library

• Java library that act as a Kinesis Consumer
• Each shard is read by one KCL instance
  • 4 shards = max 4 KCL instances
  • 6 shards = max 6 KCL instances
• Use dynamodb to
  • progress checkpointed
  • track other worker and share work amongst shard
• Can run on EC2, Elastic Beanstalk and on-premises
• Records are read in order at shard level
• Version
  • v1: Supports shared consumer
  • v2: Supports shared & enhanced fanout consumer
    Example