Configuring Snowflake on Azure workspace data connections
In the workspace configuration, under Connection Type, select Snowflake.
In the Source Settings section, under Snowflake Type, click Azure.
Connecting to the source database
In the Source Settings section, provide the details about connecting to the source database.
Providing the connection details
To connect to the source database, you can either populate the connection fields or use a connection string.
You can also opt to use key pair authentication to connect to the database.
Populating the connection fields
By default, Use connection string is off, and you provide the connection values in the individual fields:
In the Server field, provide the server where the database is located. You must provide the full path to the server.
https://is optional. So the format of the server value can be either:<account>.<region>.snowflakecomputing.com https://<account>.<region>.snowflakecomputing.comFor example:abc123456.us-east-1.snowflakecomputing.comorhttps://abc123456.us-east-1.snowflakecomputing.comIn the Database field, provide the name of the database.
In the Username field, provide the username for the account to use to connect to the database.
In the Password field, provide the password for the specified username.
Using a connection string
To use a connection string to connect to the source database:
Toggle Use connection string to the on position.
In the Connection String field, provide the connection string.
In the Password field, provide the password for the user.
To test the connection to the source database, click Test Source Connection.
The connection string uses the following format:
Using key pair authentication to connect to the database
Instead of providing a password, you can instead use key pair authentication.
To do this:
Toggle Use Key Pair Authentication to the on position.
Expand the Key Pair Authentication Settings.
For RSA Private Key, click Browse, then select the key file.
If the key is encrypted, then in the Encrypted Key Passphrase field, provide the passphrase to use to decrypt the key.
Indicating whether to trust the server certificate
To trust the server certificate, and ignore the certificate authority's revocation list, toggle Trust Server Certificate to the on position.
This option can be useful when your Tonic Structural instance cannot connect to the certificate authority.
Enabling a proxy connection
You can use a proxy server to connect to the source database.
When you use a connection string to connect to the source database, Structural automatically adds the configured proxy connection parameters to the connection string.
If you manually include proxy connection parameters in the connection string, and also configure the proxy connection settings, the connection string will have duplicate proxy connection parameters.
We recommend that you use the configuration fields to enable the proxy connection, and do not include proxy connection parameters in the connection string.
To use a proxy server to connect to the source database:
Toggle Enable proxy connection to the on position.
In the Proxy Host field, provide the host name for the proxy connection.
In the Proxy Port field, provide the port for the proxy connection.
Optionally, in the Proxy User field, provide the name of the user for the proxy connection.
If you provide a proxy user, then in the Proxy Password field, provide the password for the specified user.
Optionally, in the Non-Proxy Hosts field, provide the list of hosts for which to bypass the proxy server and connect to directly.
Use a pipe symbol (|) to separate the host names. For example, host1|host2|host3.
You can also use an asterisk (*) as a wildcard. For example, to connect directly to all hosts whose host names start with myhost, use myhost*.
Limiting the included schemas
By default, the source database includes all of the schemas. To specify a list of specific schemas to either include or exclude:
Toggle Limit Schemas to the on position.
From the filter option dropdown list, select whether to include or exclude the listed schemas.
In the field, provide the list of schemas to either include or exclude. Use commas or semicolons to separate the schemas.
Do not exclude schemas that are referred to by included schemas, unless you create those schemas manually outside of Structural.
Testing the source connection
To test the connection to the source database, click Test Source Connection.
Blocking data generation on all schema changes
By default, data generation is not blocked as long as schema changes do not conflict with your workspace configuration.
To block data generation when there are any schema changes, regardless of whether they conflict with your workspace configuration, toggle Block data generation on schema changes to the on position.
Connecting to the destination database
In the Destination Settings section, you specify the connection information for the destination database.
If the destination database is in the same location as the source database, then you can copy the connection and authentication details from the source database. The copied details include the proxy connection configuration.
If the destination database is in a different location, then you can either populate the connection fields or use a connection string.
You can also opt to use key pair authentication to connect to the database.
Copying the source database connection details
To copy the connection details from the source database:
Click Copy Settings from Source.
In the Password field, provide the password.
To test the connection to the destination database, click Test Destination Connection.
Providing destination database connection details
If you don't copy the details from the source database, then you can either populate the connection fields or use a connection string.
Populating the connection fields
By default, Use connection string is off, and you provide the connection values in the individual fields:
In the Server field, provide the server where the database is located. You must provide the full path to the server.
https://is optional. So the format of the server value can be either:<account>.<region>.snowflakecomputing.com https://<account>.<region>.snowflakecomputing.comFor example:abc123456.us-east-1.snowflakecomputing.comorhttps://abc123456.us-east-1.snowflakecomputing.comIn the Database field, provide the name of the database.
In the Username field, provide the username for the account to use to connect to the database.
In the Password field, provide the password for the specified username.
Using a connection string
To use a connection string to connect to the destination database:
Toggle Use connection string to the on position.
In the Connection String field, provide the connection string.
In the Password field, provide the password for the user.
The connection string uses the following format:
Indicating whether to trust the server certificate
To trust the server certificate, and ignore the certificate authority's revocation list, toggle Trust Server Certificate to the on position.
This option can be useful when your Structural instance cannot connect to the certificate authority.
Enabling a proxy connection
You can use a proxy server to connect to the destination database.
When you use a connection string to connect to the destination database, Structural adds the proxy connection parameters to the connection string.
If you manually include proxy connection parameters in the connection string, and also configure the proxy connection settings, the connection string will have duplicate proxy connection parameters.
We recommend that you use the configuration fields to enable the proxy connection, and do not include proxy connection parameters in the connection string.
To enable and configure the proxy connection:
Toggle Enable proxy connection to the on position.
In the Proxy Host field, provide the host name for the proxy connection.
In the Proxy Port field, provide the port for the proxy connection.
Optionally, in the Proxy User field, provide the name of the user for the proxy connection.
If you provide a proxy user, then in the Proxy Password field, provide the password for the specified user.
Optionally, in the Non-Proxy Hosts field, provide the list of hosts for which to bypass the proxy server and connect to directly.
Use a pipe symbol (|) to separate the host names. For example, host1|host2|host3.
You can also use an asterisk (*) as a wildcard. For example, to connect directly to all hosts whose host names start with myhost, use myhost*.
Using key pair authentication to connect to the database
Instead of providing a password, you can instead use key pair authentication.
To do this:
Toggle Use Key Pair Authentication to the on position.
Expand the Key Pair Authentication Settings.
For RSA Private Key, click Browse, then select the key file.
If the key is encrypted, then in the Encrypted Key Passphrase field, provide the passphrase to use to decrypt the key.
Testing the destination database connection
To test the connection to the destination database, click Test Destination Connection.
Setting the storage location for temporary files
During data generation, Structural uses temporary CSV files to load and unload Snowflake tables.
To store these temporary files, you can use either:
Azure Blob Storage
External stages
During data generation, Structural copies CSV files containing the source data to an input folder in the storage location. After the generators are applied, Structural copies CSV files containing the destination data to an output folder.
Selecting the type of storage
Under File Storage Options, by default, the Use External Stage toggle is off, which indicates to use Azure Blob Storage for the temporary files.
To instead use external stages, toggle Use External Stage to the on position.
Setting the Azure Blob Storage location for temporary files
When Use External Stage is off, in the Source Azure Storage Account Name field, provide the name of the account that Structural uses to load and unload Snowflake data in Azure Blob Storage. Do not provide the URI. You only need the account name.
In the Source Azure Blob Storage Path field, provide the container path to the Azure Blob Storage location where Structural places temporary CSV files that it uses to load and unload Snowflake tables.
Setting the external stage location for temporary files
When Use External Stage is on, in the Source Snowflake External Stage Name field, provide the path to the external stage to use for temporary files.
The format is:
<database>.<schema>.<stage>
Where:
<database>is the name of the database where the stage is located.<schema>is the name of the schema that contains the stage.<stage>is the name of the stage.
Last updated