Structural process overview for Amazon EMR

The following high-level diagram describes how Tonic Structural data generation is processed for Amazon EMR.

Overview diagram of the Tonic Structural process for Amazon EMR

For an Amazon EMR workspace, the source data comes from a database in a Glue catalog. The source data is fed to the Structural web server and Structural worker through Amazon Athena.

The Structural worker calls the EMR Steps API to coordinate the data generation job on the Spark cluster.

The destination data is written to an S3 bucket.