Kinesis
💡 Definition
Amazon Kinesis makes it easy to collect, process, and analyze real-time, streaming data so you can get timely insights and react quickly to new information.
🔑 Key Concepts
- Real-time Streaming: Handling data as it arrives, rather than in batches.
- Four Capabilities:
- Kinesis Video Streams: Streaming video capture for analytics.
- Kinesis Data Streams: Custom applications processing data streams (low latency).
- Kinesis Data Firehose: Simplest way to load streaming data into data stores (e.g., S3, Redshift, OpenSearch).
- Kinesis Data Analytics: Analyze streams using SQL or Apache Flink.
⚙️ How it Works
Producers (IoT devices, logs, clickstreams) push data to Kinesis. Kinesis buffers/processes it. Consumers (apps, Lambda, Firehose) read and act on the data.
🎯 Use Cases
- Log and Event Data Collection: Application logs, clickstream data.
- Real-time Analytics: Leaderboards, stock ticker analysis.
- Video Analytics: Security feed analysis.
💰 Pricing Model
- Data Streams: Shard hours and PUT payload units.
- Firehose: Data volume ingested.
📝 Exam Tips (CLF-C02)
- Keyword: "Real-time streaming data".
- Kinesis Data Firehose: Easiest way to load data into S3 or Redshift.
- Kinesis Data Streams: For custom processing applications.