Structural process overview for the Spark SDK
The following high-level diagram describes how Tonic Structural data generation is processed for the Spark SDK.
The source data for a Spark SDK workspace comes from either a Hive or Dremio catalog.
The Structural SDK on the Spark cluster calls the Structural web server to apply the configured generators and produce the output data.
A Spark SDK workspace is not configured with an output location for the transformed data. You identify the output location in your Spark program.
Last updated
