Amazon Kinesis for Near Realtime Streaming
Asanka Boteju

Asanka Boteju @asankab

About: Passionate software, cloud, & data architect who strives to innovate and build intelligence into every solution crafted! Former Lead Architect Council, R&D, BI, Sec, Dev, DevOps & Project Manager

Location:
Colombo, Sri Lanka
Joined:
Mar 6, 2023

Amazon Kinesis for Near Realtime Streaming

Publish Date: Jan 12
0 0

Amazon Kinesis Data Streams

Collect and store streaming data such as clickstream data, IoT, metrics, and logs in real time with Amazon Kinesis Data Streams.

AWS fully manages the infrastructure required to run Kinesis
Pay-as-you-go pricing model where you are billed based on your usage.
Write your own producer and consumer codes using KPL and KCL libraries.
✅Shards to improve throughput.
✅Optionally, enable output data format conversions to Parquet or ORC with the support of Glue Catalogs.
✅Support for dynamic partitions.
✅Supports custom transformations with the use of lambda functions


Streaming
Image description

Destination
Image description

Output
Image description

Comments 0 total

    Add comment