Use AWS Glue Network Connection to call APIs in Glue Jobs

   Go back to the Task List
  [« 3. Create IAM Role ]    [5. Create Glue Connection »]

4. Create S3 Bucket

You will create an Amazon S3 bucket which serves many purposes. It will be used to store Python script for the AWS Glue job. It will also be used by AWS Glue job to copy data returned by the REST API call.

  1. Go to the S3 Management Console and create a S3 bucket with name dojo-glue-bucket. Please make sure you select the region of the bucket the same as the VPC created in the previous steps. If this bucket name is not available, kindly use another bucket name and make note of the name as you will need it for the configuration and scripting purposes.

    S3 Bucket

  2. The next task is to create a Glue connection which is used by the Glue Job to make internet based API call.