Creating AWS Glue Connection is a very important step in completing this exercise. The connection is used to create an ENI in the private subnet of the VPC. AWS Glue job uses ENI to make call to the internet based REST API. The connection type used is Network.
-
Go to the AWS Glue Console, select Connections in left menu and click on the Add connection button.
-
Enter Connection name as dojoconnection. Select Network as the Connection type and click on the Next button.
-
On the next screen, you select GlueVPC as the VPC. Select Private Subnet for the Subnet. Select the default Security Group. Finally click on the Next button.
-
On the next screen, click on the Finish button. It will create the network type connection. Select the connection and click on the Test connection button to test the connection.
-
On the popup screen, select dojo-glue-job-role as the role and select s3://dojo-glue-bucket as the bucket. If you created bucket with a different name, then use that one. Click on the Test connection button.
-
The connection test will take some time. Wait till the test status is shown as successful.
-
The next task is to create a Glue job which uses connection to make API call in the internet.