Using AWS Lake Formation Blueprint
AWS Glue Workflow is used to create complex ETL pipeline. The workflow uses crawlers, jobs and triggers to orchestrate the activities of the pipeline. The workflow can handle both snapshot and incremental data ETL and it can run on schedule or on demand. One can use Lake Formation Blueprint to simplify the workflow creation. Blueprint uses templates to enable ETL workflow configuration from the sources such as database and log files.
The following diagram shows the scenario you are going to build. Start the workshop