V1202 - V1250
A new entry is added each week, and contains the release notes for all of the Tonic Structural versions that were released during that week.
V1244 - V1250
August 23, 2024
Updated the application to reflect the rename to Tonic Structural. Includes renaming the Tonic Settings view to Structural Settings.
From the Access Management tab of Structural Settings, users with permission to manage Structural access can now restore deleted users.
For a column that is part of a unique compound index, Structural now only suggests generators that can be used for unique columns.
Structural now detects SWIFT codes based on the format of the data in addition to the column name.
Fixed an issue where all subsetting WHERE
clauses failed internally.
Databricks
On self-hosted instances, you can now configure whether Structural creates the destination database schema for Databricks tables. The environment setting
TONIC_DATABRICKS_SKIP_CREATE_DB
indicates whether to skip the schema creation. The default is false. The environment settingTONIC_DATABRICKS_ENABLE_WORKSPACE_SKIP_CREATE_DB
indicates whether to include the option in the workspace configuration, and useTONIC_DATABRICKS_SKIP_CREATE_DB
to determine the default. The default is true. You can add these settings to the Environment Settings list on Structural Settings.When a cluster is resizing, and the workspace is configured with Use Databricks Job Cluster turned off, Structural data generation now waits for the resizing to complete.
File connector
Fixed an issue where a copied local files workspace that contained Avro or Parquet files could not be loaded.
Structural now supports authentication to Amazon S3 buckets using assumed roles for cross-account access.
Fixed an issue where file connector workspaces did not load when they used an Amazon S3 source with environment-based authentication.
Snowflake
Fixed a rare subsetting issue where processing a large table could cause the job to hang.
Fixed an issue where Structural did not retry transient failures when it read unloaded files from a cloud storage provider.
V1239 - V1243
August 16, 2024
The scheduled sensitivity scans are now daily instead of weekly. By default, the scans run every day at midnight. Structural scans the 10 workspaces that have the most recent activity. Activity is defined as either a user-initiated workspace event that is added to the Protection Audit Trail, or a data generation job.
On the details view for custom sensitivity rules, fixed an issue where the Edit Current Preset button was always disabled.
When a generation to Ephemeral fails, Structural job logs now include the Ephemeral logs and destination database pod logs.
For users who do not have permission to manage sensitivity rules, the Sensitivity Rules option now displays in a disabled state.
When you configure a workspace to write to a self-hosted Ephemeral instance, or to write to Ephemeral Cloud from a self-hosted Structural instance, the workspace configuration now includes an option to test the Ephemeral connection.
V1234 - V1238
August 9, 2024
Yugabyte data connector - Structural now allows you to connect to databases on Yugabyte version 2024.1 and above. The Yugabyte data connector is available with a Professional or Enterprise license. It only supports Yugabyte SQL (YSQL).
When you configure a custom security rule, you can now create or edit the assigned generator preset. You can also use a workspace to preview the security rule results. The preview displays the matching columns for the selected workspace.
Structural can now detect the following additional sensitivity types:
US driver’s license number
Passport number
Marital status
GPS coordinates
Non-birthday dates: admission date, discharge date, date of death
US license plate
MySQL
When the SQL mode
ALLOW_INVALID_DATES
is set, Structural now allows Passthrough for columns that contain invalid dates.
Snowflake
For the Data Pipeline V2 process, reduced the frequency of polling cloud platforms for new unloaded files.
V1228 - V1233
August 2, 2024
Fixed an issue on the webhook configuration panel where users could not click Save when the Message Body tab contained large property values.
Fixed an issue that caused the Notifications service to stop processing webhooks.
Improved the detection of name values to identify more specific types of names.
Amazon EMR
Fixed an issue with previewing data after applying the Timestamp Shift Generator or Date Truncation Generator to timestamp columns with timezones.
V1223 - V1227
July 26, 2024
Self-hosted instances can now schedule sensitivity scans to run automatically on a weekly basis. By default, the weekly scans are enabled and run each Sunday at midnight.
Structural can now detect the following additional sensitivity types:
Money Amount
Usernames
File connector
Fixed a regression that made Table View unusable.
Oracle
Fixed an issue that caused data generation to fail when subsetting with a date-based upstream table filter.
Salesforce
Resolved issues where Salesforce workspaces became unrecoverable.
Fixed issues with the use of session refresh tokens.
PostgreSQL
Preserve Destination and Incremental tables no longer drop columns that reference user-defined types (UDTs) or extensions.
Added support for the pgvector vector data type as a non-replaceable type that is always passed through to the destination database.
Snowflake on AWS
Improved performance when copying passthrough tables when a workspace uses separate source and destination S3 buckets.
V1218 - V1222
July 19, 2024
Structural can now detect the following additional sensitivity types that are defined by the HIPAA Safe Harbor method:
Medical record numbers
Health plan beneficiary numbers
Account numbers
Certificate and license numbers
Web URLs
Full face photographic images and similar images
Biometric identifiers, including finger and voice prints
Removed the environment setting TONIC_SUBSETTING_CYCLE_BREAK_GREEDY_ALGORITHM
. The greedy algorithm to compute the required cycle breaks for subsetting is no longer available.
Snowflake
A new environment setting allows you to control whether Structural creates the destination database schema before it populates the destination data. By default,
TONIC_SNOWFLAKE_SKIP_CREATE_DB
is false, meaning that Structural creates the destination database and schema. If you set this to true, then Structural does not create the schema. You must create the destination database with the full schema. You can addTONIC_SNOWFLAKE_SKIP_CREATE_DB
to the Environment Settings list on Tonic Settings.Improved performance when writing to Snowflake for de-identified tables and some Passthrough tables.
V1211 - V1217
July 12, 2024
For post-job webhook URLs, you cannot use URLs that resolve to a private IPv4 range.
To provide the column name matching criteria for custom sensitivity rules, you can now use a regular expression.
The Structural sensitivity scan can now detect UK and Canada postal codes.
You can now use the Structural API to manage custom sensitivity rules.
When you configure a PostgreSQL or MySQL workspace to write the destination data to a container repository, you can now specify the name of the database.
Fixed an issue where the column sensitivity type was not updated when a later sensitivity scan detected a different type. Columns that are manually marked as sensitive are not affected.
Increased the number of column names that Structural uses to detect sensitivity types.
Amazon EMR
Iceberg now correctly handles schemas that contain capitalized column names.
Salesforce
The Continuous generator is now available.
The Algebraic generator is now available.
You can now use
WHERE
clauses in subsetting target table configuration.
V1208 - V1210
July 5, 2024
When Structural detects a state abbreviation, it no longer identifies it as a full state name.
During a sensitivity scan, the value finders now look more holistically at both the data and the column name instead of assessing them individually.
V1204 - V1207
June 28, 2024
Custom sensitivity rules - On self-hosted Enterprise instances, you can now configure custom sensitivity rules, which allow you to create your own sensitivity types. For each rule, you configure the general data type, text matching rules for the column name, and the recommended generator. Structural uses these rules during the sensitivity scan. Matching columns are included on the Recommended Generators by Sensitivity Type panel.
Toleration configuration for output to container repositories - Self-hosted customers who write output to a container repository can now set pod tolerations to enable pods to be scheduled on nodes that have taints. The tolerations are configured in environment settings. You can add these settings to the Environment Settings list on Tonic Settings.
MySQL
Fixed an issue with subsetting for instances of MySQL that were deployed using Amazon Aurora where downstream tables were not populated properly.
V1202 - V1203
June 21, 2024
When configuring a workspace to write output to an Ephemeral snapshot, you can now optionally configure the compute resources. By default, the resources are based on the size of the source database.
Last updated