Structural process overview for Databricks

The following high-level diagram describes how Tonic Structural data generation is processed for Databricks.

Overview diagram of the Tonic process for Databricks

For a Databricks workspace, the source data comes from a Databricks database.

The Databricks API coordinates the running of the data generation job on the Databricks cluster.

The destination data is written to either an S3 bucket or to a location in Azure Data Lake Storage Gen2.