V401 - V450


April 27, 2022


  • Improve usability of processing with Java SDK


  • Close connection to application database when not being used

  • Removed excess querying of database version


April 26, 2022


  • Improves performance of Name Generator on Spark / Databricks

  • Change Dremio schema input to Tag Input and add an informational popover


  • Do not null FKs between reference tables

  • Allow foreign keys to be added by editors


April 26, 2022


  • Improves performance of the SSN Generator on EMR Spark / Databricks


  • Keep the password field empty when copying from source database settings to destination database

  • Improved exception handling when masking and preserving destination tables

  • More quickly alert user when a cycle has been found in their relationships

  • Handle Postgres interval data types with a null boundary

  • Disable Add Foreign Keys tab for non-workspace owner users


April 25, 2022


  • The Workspaces view now supports bulk actions. Share, transfer, delete, and leave multiple workspaces by checking the boxes at the right end of each row, and choosing the desired action from the Actions menu.


  • Fixed an issue where Safari would fail to load the application

  • Fixes to constraint application parallelism

Breaking Changes

  • The response for the Workspace deletion endpoint (/api/workspace/{workspaceId}) has been modified slightly


April 22, 2022


  • Enable Timestamp Generator To Work Without Statistics For Spark Object Masks

  • When a mongo foreign key field has a primary key with a generator applied, replace the example data with a link to the collection with the primary key


  • Fix for MySql generation hanging with empty password


April 21, 2022


  • Improves performance of Name Generator on EMR and Databricks


  • Fix Display Bug in AI Synthesizer Configuration Panel

  • Fix application of constraints in Redshift


April 20, 2022


  • Add the version of the worker that ran a job to the job details

  • On the Mongo Collection View for foreign/primary keys: Added a hover tooltip for key icons, replaced the generator with a label

  • Refresh the last collection visited when a new foreign key file is uploaded and optimize single_doc foreign key


  • Disable date truncation generator as a subgenerator for Spark

  • Fixes Notification service consuming all disk space when crashing

  • Show the appropriate Conditional sub-generator label instead of passthrough

  • Fixed in memory table query for SQL Server


April 19, 2022


  • Teardown and database creation performance improved for SQL Server

  • Skip preserve destination tables (just like truncated) for privacy scan


  • Fix not allowing generators allowed on arrays that were scanned prior to v439


April 18, 2022


  • Adds support for events (dependent rows) to AI Synthesizer (formerly known as Smart Linking)

  • Allow wildcard (%) in schema name for Dremio


  • Support Date Truncation and Timestamp Shift on Snowflake TIMESTAMP_TZ and Redshift TIMESTAMPTZ columns

  • Disable the generator dropdown in the UI for columns with both primary and foreign keys

  • MongoDB - Fix errors when linking Categorical Generators

  • Bug fixes for synthesis report

  • Fix data type mappings for Dremio Integer and Varchar


April 14, 2022


  • Display whether webhooks were used in job details

  • Terminology changes

    • Masked is changing to De-identify

    • Synthesized is changing to Scale

    • Truncated is changing to Truncate

    • Generator name change: Smart Linking is changing to AI Synthesizer


  • Fixes to SQL script beautifier


April 14, 2022


  • Move single connections on connection pools behind a feature flag

  • Do not drop indexes on auto increment columns in MySQL to improve performance

  • Add type filter to JSON Mask generator

  • Remove unique constraint on workspace names and change default workspace name to "Untitled Workspace"

  • Display key icons for user uploaded foreign/primary key fields in Mongo Single document view


  • Fix issue where 0 results in Workspaces table sometimes let you navigate to a negative page number

  • Fix issue where workspace permissions didn't update in the UI until a refresh

  • Fixes authentication error on Postgres when username has special characters

  • Fixed reopening open connections when TONIC_ENABLE_SINGLE_CONNECTION is false

  • Remove owner section from exported workspace body

  • Improve readability of workspace tags in small-width window sizes


April 13, 2022


  • Apply foreign key constraints serially on a different thread to avoid deadlocks & improve performance


  • Clear bulk column search query on filters reset

  • Memory improvements to Mongo schema serialization

  • Better handling of schema name in Java SDK


April 12, 2022


  • Allow changes to order of JSON Mask sub-generators

  • Running a job is now disabled when the license expiration date has passed

  • Separate Workspace Sharing and Workspace Role-based Workspace access into different license features

  • Improve SQL Server performance by prefetching all tables & views


  • When using Java SDK only show Java supported generators


April 11, 2022


  • Improves performance of Email Generator on EMR and Databricks

  • Add support from Dremio with Spark


  • Allowing Kubernetes ImagePullBackOff for up to 5 minutes before throwing error when updating through UI

  • Fixes inability to run a data generator on Spark with default database as the source


April 8, 2022


  • Display estimated time remaining on row-based tasks in job details page

  • Display key icons for user uploaded foreign/primary key fields in Mongo hybrid documents


  • Copy Generator in Mongo: Fix bug where if generator was copying a field that wasn't in the document it would throw exception

  • Add exception handling for SQL Server datetime columns to drop invalid records, better SQL Server XML type exception handling

  • Create source pool just before processing tables to avoid any timeouts in SQL Server


April 8, 2022


  • Display row based progress on jobs whenever possible

  • Statistics Jobs for the Java Spark SDK now appear in Jobs Table/Jobs Detail Page

  • Skip pre-job health check for PyML service when not needed


April 7, 2022


  • Added database metric sharing for AWS users

  • Don't null self-referential foreign keys on reference tables when subsetting


April 7, 2022


  • Improves performance of Email Generator on EMR and Databricks


  • Better small-width responsiveness of tables in UI


April 6, 2022


  • Add synthesis report

  • Support for update via UI with Docker


  • Prevent unexpected behavior of progress tracker when the system clock shifts

  • Fixes error when creating partition function with null range on SQL Server

  • Fix issues with loading screen showing when not needed


April 5, 2022


  • Add Remove Whitespace Transformer to Copy generator

  • Add ability to generate JSONPath expression for JSON Mask generator by clicking on preview JSON


  • Improved support for large decimal numeric types in Postgres


April 4, 2022


  • Add exception handling for invalid SSH Tunnel private key format and list valid formats in tooltip


April 4, 2022


  • Apply constraints in parallel to data generation in Postgres


  • Ensure workspace tag input closes when focus is lost from outside click

  • Remove foreign key checks when applying constraints in MySQL


April 1, 2022


  • Invalidate refresh tokens on logout, log in or out all open sessions (tabs) on login or logout, cross-tab inactivity timeout support

  • Improve load times on workspace pages


  • Fix linking of non-consistent generators in Spark

API update

  • Deprecated the GET /api/workspace endpoint in favor of GET /api/workspace/search


March 31, 2022


  • Include workspace ID in URLs

  • Parallelize writes on MySQL passthrough tables

  • Allow decimals in subsetting percentages


  • Don't allow duplicate entries of tables in table mode settings for workspace

  • Handle null values with Copy generator on MongoDB

  • Database query performance improvements


March 30, 2022


  • Improve MySQL generation performance by applying constraints in parallel


  • Fix issue where indexes fail to be applied to converted columns on SQL Server

  • Fix issue with SSO account creation failing


March 29, 2022


  • Support Copy generator on MongoDB

  • Support parallelism of MongoDB schema scan

  • Support truncation mode on MongoDB


  • Set Command Timeout in Postgres to prevent timeouts


March 25, 2022


  • Change password requirements

    • Length >= 12 characters

    • Must include number

    • Must include lowercase letter

    • Must include uppercase letter

    • Must include non-alphanumeric character


  • Fixes to transfer workspace text

  • Allow opening Admin Panel when user has no workspaces


March 25, 2022


  • Improve constraint restoration performance on MySQL

  • Allow incremental tables in MySQL where all columns are keys


  • Prevent app from crashing when admin status of user is unknown


March 24, 2022


  • Add login rate limitin3


  • Fix issue with functions and procedures not being created in the destination on Oracle databases


March 23, 2022


  • On EMR and Databricks, write JSON files to JSON instead of Parquet

  • Improved handling of Latitude/Longitude with Smart Linking Generator

  • Add support for enum arrays columns in Postgres


  • Fix issue with EMR cross account data generation failing to resolve the Glue database


March 17, 2022


  • Admin users can now view all workspaces in Tonic. They can copy, share, and transfer any workspace, regardless of whether they have a role in the workspace.

  • Multiple enhancements for workspaces. Users can now leave a workspace. Improved the workspace share and transfer functions. Added the ability to filter workspaces by owner.

  • Parse as bigint if decimal fails

  • Oracle Whitelist support in BuildDb

  • Initialize after log sink reset

  • Replace slashes with underscores in build versioning

  • Add 'No generators' filter for bulk table view

  • Add progress tracker for SQL server post-data script generation

  • Allow support for views without fully qualified tables in Redshift

  • Improve performance of listing workspaces

  • Improve performance of the Constant Generator on EMR and Databricks

  • Sensitive columns now appear in the privacy hub for Mongo workspaces

  • Allow processing of decimals with a scale of 1 up to 9223372036854775807 in Postgres

  • Check for cloudsqlsuperuser permission on GCP Cloud SQL destination postgres databases


  • Address Lambda Function Setup bug

  • Improve Regex Mask Display of Empty Matches and values with new lines

  • Do not fail completely when SSO groups do not resolve

  • Misc Redshift View fixes

  • Fix issue where column can't be in schema changes and show as sensitive

  • Fix issue where some downstream tables are missing their foreign keys in the destination database when using subsetting

  • Fix issue with shifting table size on data preview in database view

  • Prevent error from occurring when MongoDB collection size is too large


March 10, 2022


  • Added support for user defined enum types as keys in subsetting

  • Simplify schema diff changes error toast on generation

  • Show more unprotected columns button mongo privacy hub

  • Added filtering on custom value generator dropdown

  • Add ConsistentOn to AdditiveNoiseGenerator

  • Enabling Timeshift Generator on Compound Primary Keys

  • Regex Mask Generator supports matching empty capture groups

  • Accommodate OFFSET in where clauses in SQL Server subsetting

  • Miscellaneous workspace config improvements

  • Add support Azure Sql with SqlServerDatabaseCreator

  • Add progress tracking for mongo schema scans

  • Add syntax highlighting for where clauses in subsetting

  • Add support for integer primary keys on smallint

Bug fixes

  • Fixed error message for MySQL data type not found

  • Fix Postgres Test Connection bug

  • Fix Workspace patches after rename or modify tags

  • Fix Unix Timestamp empty column bug

  • Throw OperationCanceledException instead of CancelTonicJobException on cancellation request

  • Fix Redshift view replication missing schema


February 24, 2022


  • Added the ability to configure Tonic administrators. Admin users have access to the new Admin Panel. The Admin Panel contains Tonic usage metrics, a table of all Tonic users, and the ability to manage other admin users.

  • For Kubernetes, admin users can now use the Admin Panel to update Tonic

  • Oracle perf improvements

  • Add new range options for integer pk generator

  • CNPJ and CPF generator performance improvements

  • Updates Regex Mask Generator to support replacing all matches

  • Start the progress token for passthrough tables when there are no passthrough tables with references

  • Add support for Timestampshift for spark

  • Add warning system to Privacy Scan

  • Regex mask generator with Custom Value Processor

  • Check for cancellation and report progress on text copy in Postgresql

  • Miscellaneous perf improvements

Bug fixes

  • Start the progress token for passthrough tables when there are no passthrough tables with references

  • Treat non-standard oracle error code 5 not as an error

  • Fix grabbing workspace users for comments

  • Dispose the source connection instead of just closing in Postgres

  • Fix for test discovery exception

  • Fix postgres sequences behavior

  • Object mask bulk view fix

  • Miscellaneous typos fixed

  • Fixed database type for BigQuery test connection

Last updated