Structural process overview for the Spark SDK

The following high-level diagram describes how Tonic Structural data generation is processed for the Spark SDK.

Overview diagram of the Tonic Structural process for the Spark SDK

The source data for a Spark SDK workspace comes from either a Hive or Dremio catalog.

The Structural SDK on the Spark cluster calls the Structural web server to apply the configured generators and produce the output data.

A Spark SDK workspace is not configured with an output location for the transformed data. You identify the output location in your Spark program.