Configuring the destination database schema creation

By default, during data generation to Databricks Delta tables, Structural creates the database schema for the destination database tables, then populates the database tables based on the workspace configuration.

You can also choose to manage the database schema yourself. You can:

• Configure Structural to always skip the schema creation

• Enable a workspace configuration option to skip the schema creation

You can add these settings to the Environment Settings list on Structural Settings.

Configuring whether to always skip the schema creation

To manage the database schema yourself, set the environment setting TONIC_DATABRICKS_SKIP_CREATE_DB to true.

When the environment setting TONIC_DATABRICKS_ENABLE_WORKSPACE_SKIP_CREATE_DB is true, then TONIC_DATABRICKS_SKIP_CREATE_DB determines the default value in the workspace configuration.

When TONIC_DATABRICKS_ENABLE_WORKSPACE_SKIP_CREATE_DB is false, then TONIC_DATABRICKS_SKIP_CREATE_DB determines for the entire instance whether Structural skips the schema creation.

Configuring whether to provide a workspace configuration option

By default, the workspace configuration includes the Skip Destination Database Schema Creation option, which allows you to determine for the specific workspace whether to skip the database schema creation.

The default configuration is based on the value of TONIC_DATABRICKS_SKIP_CREATE_DB.

To not include the option in the workspace configuration, set TONIC_DATABRICKS_ENABLE_WORKSPACE_SKIP_CREATE_DB to false.