By default, during data generation to Databricks Delta tables, Structural creates the database schema for the destination database tables, then populates the database tables based on the workspace configuration.
You can also choose to manage the database schema yourself. You can:
Configure Structural to always skip the schema creation
Enable a workspace configuration option to skip the schema creation
You can add these settings to the Environment Settings list on Structural Settings.
To manage the database schema yourself, set the environment setting TONIC_DATABRICKS_SKIP_CREATE_DB
to true
.
When the environment setting TONIC_DATABRICKS_ENABLE_WORKSPACE_SKIP_CREATE_DB
is true, then TONIC_DATABRICKS_SKIP_CREATE_DB
determines the default value in the workspace configuration.
When TONIC_DATABRICKS_ENABLE_WORKSPACE_SKIP_CREATE_DB
is false
, then TONIC_DATABRICKS_SKIP_CREATE_DB
determines for the entire instance whether Structural skips the schema creation.
By default, the workspace configuration includes the Skip Destination Database Schema Creation option, which allows you to determine for the specific workspace whether to skip the database schema creation.
The default configuration is based on the value of TONIC_DATABRICKS_SKIP_CREATE_DB
.
To not include the option in the workspace configuration, set TONIC_DATABRICKS_ENABLE_WORKSPACE_SKIP_CREATE_DB
to false
.