In this task, you create an Amazon Kinesis Data Stream which will be used to ingest data from IoT Device (simulated). Further Amazon Glue ETL job will read data from the Kinesis Data Stream and persist to the Amazon S3 bucket after transformation.
-
Login to the AWS Console and choose an AWS region. Please make sure you are creating all AWS resources in the selected region only. The workshop uses Paris as the region.
-
Goto Kinesis Streams Management Console. Select Kinesis Data Streams as the option and click on the Create data stream button.
-
On the next screen, type in dojostream as the stream name. Select 1 for the number of open shards field. Click on the Create data stream button.
-
It will take couple of minutes to complete the creation of the stream. Wait till the status changes to Active.
-
Kinesis data stream is ready. The next task is to create S3 bucket where the ETL data finally rests.