Structural process overview for the Spark SDK

The following high-level diagram describes the Tonic Structural data generation process for the Spark SDK.

Overview diagram of the Tonic Structural process for the Spark SDK

The source data for a Spark SDK workspace comes from either a Hive or Dremio catalog.

The Structural SDK on the Spark cluster calls the Structural web server to apply the configured generators and produce the output data.

A Spark SDK workspace is not configured with an output location for the transformed data. You identify the output location in your Spark program.