Structural process overview for the Spark SDK
Last updated
Was this helpful?
Last updated
Was this helpful?
The following high-level diagram describes the Tonic Structural data generation process for the Spark SDK.
The source data for a Spark SDK workspace comes from either a Hive or Dremio catalog.
The Structural SDK on the Spark cluster calls the Structural web server to apply the configured generators and produce the output data.
A Spark SDK workspace is not configured with an output location for the transformed data. You identify the output location in your Spark program.
