V401 - V450
April 27, 2022
Features
- Improve usability of processing with Java SDK
Bugs:
- Close connection to application database when not being used
- Removed excess querying of database version
April 26, 2022
Features
- Improves performance of Name Generator on Spark / Databricks
- Change Dremio schema input to Tag Input and add an informational popover
Bugs:
- Do not null FKs between reference tables
- Allow foreign keys to be added by editors
April 26, 2022
Features
- Improves performance of the SSN Generator on EMR Spark / Databricks
Bugs:
- Keep the password field empty when copying from source database settings to destination database
- Improved exception handling when masking and preserving destination tables
- More quickly alert user when a cycle has been found in their relationships
- Handle Postgres interval data types with a null boundary
- Disable Add Foreign Keys tab for non-workspace owner users
April 25, 2022
Features
- The Workspaces view now supports bulk actions. Share, transfer, delete, and leave multiple workspaces by checking the boxes at the right end of each row, and choosing the desired action from the Actions menu.
Bugs:
- Fixed an issue where Safari would fail to load the application
- Fixes to constraint application parallelism
Breaking Changes
- The response for the Workspace deletion endpoint (
/api/workspace/{workspaceId}
) has been modified slightly
April 22, 2022
Features
- Enable Timestamp Generator To Work Without Statistics For Spark Object Masks
- When a mongo foreign key field has a primary key with a generator applied, replace the example data with a link to the collection with the primary key
Bugs
- Fix for MySql generation hanging with empty password
April 21, 2022
Features
- Improves performance of Name Generator on EMR and Databricks
Bugs
- Fix Display Bug in AI Synthesizer Configuration Panel
- Fix application of constraints in Redshift
April 20, 2022
Features
- Add the version of the worker that ran a job to the job details
- On the Mongo Collection View for foreign/primary keys: Added a hover tooltip for key icons, replaced the generator with a label
- Refresh the last collection visited when a new foreign key file is uploaded and optimize single_doc foreign key
Bugs
- Disable date truncation generator as a subgenerator for Spark
- Fixes Notification service consuming all disk space when crashing
- Show the appropriate Conditional sub-generator label instead of passthrough
- Fixed in memory table query for SQL Server
April 19, 2022
Features
- Teardown and database creation performance improved for SQL Server
- Skip preserve destination tables (just like truncated) for privacy scan
Bugs
- Fix not allowing generators allowed on arrays that were scanned prior to v439
April 18, 2022
Features
- Adds support for events (dependent rows) to AI Synthesizer (formerly known as Smart Linking)
- Allow wildcard (%) in schema name for Dremio
Bugs
- Support Date Truncation and Timestamp Shift on Snowflake TIMESTAMP_TZ and Redshift TIMESTAMPTZ columns
- Disable the generator dropdown in the UI for columns with both primary and foreign keys
- MongoDB - Fix errors when linking Categorical Generators
- Bug fixes for synthesis report
- Fix data type mappings for Dremio Integer and Varchar
April 14, 2022
Features
- Display whether webhooks were used in job details
- Terminology changes
- Masked is changing to De-identify
- Synthesized is changing to Scale
- Truncated is changing to Truncate
- Generator name change: Smart Linking is changing to AI Synthesizer
Bugs
- Fixes to SQL script beautifier
April 14, 2022
Features
- Move single connections on connection pools behind a feature flag
- Do not drop indexes on auto increment columns in MySQL to improve performance
- Add type filter to JSON Mask generator
- Remove unique constraint on workspace names and change default workspace name to "Untitled Workspace"
- Display key icons for user uploaded foreign/primary key fields in Mongo Single document view
Bugs
- Fix issue where 0 results in Workspaces table sometimes let you navigate to a negative page number
- Fix issue where workspace permissions didn't update in the UI until a refresh
- Fixes authentication error on Postgres when username has special characters
- Fixed reopening open connections when TONIC_ENABLE_SINGLE_CONNECTION is false
- Remove owner section from exported workspace body
- Improve readability of workspace tags in small-width window sizes
April 13, 2022
Features
- Apply foreign key constraints serially on a different thread to avoid deadlocks & improve performance
Bugs
- Clear bulk column search query on filters reset
- Memory improvements to Mongo schema serialization
- Better handling of schema name in Java SDK
April 12, 2022
Features
- Allow changes to order of JSON Mask sub-generators
- Running a job is now disabled when the license expiration date has passed
- Separate Workspace Sharing and Workspace Role-based Workspace access into different license features
- Improve SQL Server performance by prefetching all tables & views
Bugs
- When using Java SDK only show Java supported generators
April 11, 2022
Features
- Improves performance of Email Generator on EMR and Databricks
- Add support from Dremio with Spark
Bugs
- Allowing Kubernetes ImagePullBackOff for up to 5 minutes before throwing error when updating through UI
- Fixes inability to run a data generator on Spark with default database as the source
April 8, 2022
Features
- Display estimated time remaining on row-based tasks in job details page
- Display key icons for user uploaded foreign/primary key fields in Mongo hybrid documents
Bugs
- Copy Generator in Mongo: Fix bug where if generator was copying a field that wasn't in the document it would throw exception
- Add exception handling for SQL Server datetime columns to drop invalid records, better SQL Server XML type exception handling
- Create source pool just before processing tables to avoid any timeouts in SQL Server
April 8, 2022
Features
- Display row based progress on jobs whenever possible
- Statistics Jobs for the Java Spark SDK now appear in Jobs Table/Jobs Detail Page
- Skip pre-job health check for PyML service when not needed
April 7, 2022
Features
- Added database metric sharing for AWS users
- Don't null self-referential foreign keys on reference tables when subsetting
April 7, 2022
Features
- Improves performance of Email Generator on EMR and Databricks
Bugs
- Better small-width responsiveness of tables in UI
April 6, 2022
Features
- Add synthesis report
- Support for update via UI with Docker
Bugs
- Prevent unexpected behavior of progress tracker when the system clock shifts
- Fixes error when creating partition function with null range on SQL Server
- Fix issues with loading screen showing when not needed
April 5, 2022
Features
- Add Remove Whitespace Transformer to Copy generator
- Add ability to generate JSONPath expression for JSON Mask generator by clicking on preview JSON
Bugs
- Improved support for large decimal numeric types in Postgres
April 4, 2022
Features
- Add exception handling for invalid SSH Tunnel private key format and list valid formats in tooltip
April 4, 2022
Features
- Apply constraints in parallel to data generation in Postgres
Bugs
- Ensure workspace tag input closes when focus is lost from outside click
- Remove foreign key checks when applying constraints in MySQL
April 1, 2022
Features
- Invalidate refresh tokens on logout, log in or out all open sessions (tabs) on login or logout, cross-tab inactivity timeout support
- Improve load times on workspace pages
Bugs
- Fix linking of non-consistent generators in Spark
API update
- Deprecated the
GET /api/workspace
endpoint in favor ofGET /api/workspace/search
March 31, 2022
Features
- Include workspace ID in URLs
- Parallelize writes on MySQL passthrough tables
- Allow decimals in subsetting percentages
Bugs
- Don't allow duplicate entries of tables in table mode settings for workspace
- Handle null values with Copy generator on MongoDB
- Database query performance improvements
March 30, 2022
Features
- Improve MySQL generation performance by applying constraints in parallel
Bugs
- Fix issue where indexes fail to be applied to converted columns on SQL Server
- Fix issue with SSO account creation failing
March 29, 2022
Features
- Support Copy generator on MongoDB
- Support parallelism of MongoDB schema scan
- Support truncation mode on MongoDB
Bugs
- Set Command Timeout in Postgres to prevent timeouts
March 25, 2022
Features
- Change password requirements
- Length >= 12 characters
- Must include number
- Must include lowercase letter
- Must include uppercase letter
- Must include non-alphanumeric character
Bugs
- Fixes to transfer workspace text
- Allow opening Admin Panel when user has no workspaces
March 25, 2022
Features
- Improve constraint restoration performance on MySQL
- Allow incremental tables in MySQL where all columns are keys
-
Bugs
- Prevent app from crashing when admin status of user is unknown
March 24, 2022
Features
- Add login rate limitin3
Bugs
- Fix issue with functions and procedures not being created in the destination on Oracle databases
March 23, 2022
Features
- On EMR and Databricks, write JSON files to JSON instead of Parquet
- Improved handling of Latitude/Longitude with Smart Linking Generator
- Add support for enum arrays columns in Postgres
Bugs
- Fix issue with EMR cross account data generation failing to resolve the Glue database
March 17, 2022
Features
- Admin users can now view all workspaces in Tonic. They can copy, share, and transfer any workspace, regardless of whether they have a role in the workspace.
- Multiple enhancements for workspaces. Users can now leave a workspace. Improved the workspace share and transfer functions. Added the ability to filter workspaces by owner.
- Parse as bigint if decimal fails
- Oracle Whitelist support in BuildDb
- Initialize after log sink reset
- Replace slashes with underscores in build versioning
- Add 'No generators' filter for bulk table view
- Add progress tracker for SQL server post-data script generation
- Allow support for views without fully qualified tables in Redshift
- Improve performance of listing workspaces
- Improve performance of the Constant Generator on EMR and Databricks
- Sensitive columns now appear in the privacy hub for Mongo workspaces
- Allow processing of decimals with a scale of 1 up to 9223372036854775807 in Postgres
- Check for cloudsqlsuperuser permission on GCP Cloud SQL destination postgres databases
Bugs
- Address Lambda Function Setup bug
- Improve Regex Mask Display of Empty Matches and values with new lines
- Do not fail completely when SSO groups do not resolve
- Misc Redshift View fixes
- Fix issue where column can't be in schema changes and show as sensitive
- Fix issue where some downstream tables are missing their foreign keys in the destination database when using subsetting
- Fix issue with shifting table size on data preview in database view
- Prevent error from occurring when MongoDB collection size is too large
March 10, 2022
Features
- Added support for user defined enum types as keys in subsetting
- Simplify schema diff changes error toast on generation
- Show more unprotected columns button mongo privacy hub
- Added filtering on custom value generator dropdown
- Add ConsistentOn to AdditiveNoiseGenerator
- Enabling Timeshift Generator on Compound Primary Keys
- Regex Mask Generator supports matching empty capture groups
- Accommodate OFFSET in where clauses in SQL Server subsetting
- Miscellaneous workspace config improvements
- Add support Azure Sql with SqlServerDatabaseCreator
- Add progress tracking for mongo schema scans
- Add syntax highlighting for where clauses in subsetting
- Add support for integer primary keys on smallint
Bug fixes
- Fixed error message for MySQL data type not found
- Fix Postgres Test Connection bug
- Fix Workspace patches after rename or modify tags
- Fix Unix Timestamp empty column bug
- Throw OperationCanceledException instead of CancelTonicJobException on cancellation request
- Fix Redshift view replication missing schema
February 24, 2022
Features
- Added the ability to configure Tonic administrators. Admin users have access to the new Admin Panel. The Admin Panel contains Tonic usage metrics, a table of all Tonic users, and the ability to manage other admin users.
- For Kubernetes, admin users can now use the Admin Panel to update Tonic
- Oracle perf improvements
- Add new range options for integer pk generator
- CNPJ and CPF generator performance improvements
- Updates Regex Mask Generator to support replacing all matches
- Start the progress token for passthrough tables when there are no passthrough tables with references
- Add support for Timestampshift for spark
- Add warning system to Privacy Scan
- Regex mask generator with Custom Value Processor
- Check for cancellation and report progress on text copy in Postgresql
- Miscellaneous perf improvements
Bug fixes
- Start the progress token for passthrough tables when there are no passthrough tables with references
- Treat non-standard oracle error code 5 not as an error
- Fix grabbing workspace users for comments
- Dispose the source connection instead of just closing in Postgres
- Fix for test discovery exception
- Fix postgres sequences behavior
- Object mask bulk view fix
- Miscellaneous typos fixed
- Fixed database type for BigQuery test connection
Last modified 5mo ago