Running a data generation job
The data generation job uses the configured tables modes and generators to transform the data in the source database. The transformed data is used to create the destination database.
You use the Generate Data button at the top right of the application to start the data generation.
If you configured subsetting, then you can choose whether to generate only the subset.
As you configure the data generation options, Tonic runs checks to verify that you can use the current configuration to generate data.
If any of these checks do not pass, then you cannot run the data generation job. The Generate Data button is not green. When you click Generate Data, Tonic displays information about why you cannot run the data generation job.
If all of those checks pass, then the Generate Data button is green, and you can run the data generation job. If there are no warnings, then the Confirm Generation panel displays.
Data generation is always blocked by conflicting schema changes.
The workspace configuration includes whether to block data generation for all schema changes, including non-conflicting changes.
If this setting is turned off, then if there are non-conflicting schema changes, when you click Generate Data, a warning displays. Non-conflicting schema changes include new tables and columns. If the new columns contain sensitive data, then if you do not assign generators before you generate data, that sensitive data will be in the destination database.
If you are sure that the data in the new tables and columns is not sensitive, then to continue to the Confirm Generation panel, click Continue to Data Generation.
The Confirm Generation panel allows you to confirm the details for the data generation.If subsetting is configured you can also determine whether to generate the subset. Tonic can also provide tips on improving the data generation performance.
Confirm Generation panel
If you configured subsetting, then you can indicate whether to only generate the subset.
To create a subset based on the current subsetting configuration, toggle Use Subsetting to the on position.
The initial setting matches the current setting in the subsetting configuration. If Use subsetting is turned on on the Subsetting view, then it is on by default on the Generation Confirmation panel.
When you change the setting on the generation confirmation panel, it also updates the setting on the Subsetting view.
The Confirm Generation panel displays the connection information for the destination database.
If the destination database information is incorrect, to navigate to the workspace configuration view to make updates, click Edit Destination DB.
For data generation, assigning Truncate table mode to tables that you don't need data for can improve generation performance.
For subsetting, if an upstream table is very large, and the foreign key columns are not indexed, then it can make the subsetting process run more slowly.
The Want Faster Generations? message displays at the bottom of the Confirm Generation panel. It displays for all non-subsetting jobs. For subsetting jobs, the panel only displays if Tonic identified columns that you should consider indexing.
To display information about tips for faster generation, click Generation Tips.
On the Generation Tips panel for subsetting jobs, the Add Indexes panel displays the first few columns that you might consider indexing.
Generation Tips panel with indexing suggestions
To display a panel with a suggested SQL command to add the index, click the information icon next to the column.
Example SQL command for indexing
On the panel, to copy the command to the clipboard, click Copy SQL to Clipboard.
If there are additional columns that are not listed, then to display the full list of columns to index, click Show all columns.
Full list of indexing suggestions
On the full list, to download the list to a CSV file, click Download list of columns (.csv).
On the Generation Tips panel for non-subsetting jobs, the Truncate Tables panel displays the hint to truncate tables that contain data that you do not need in the destination database.
To navigate to Database View to change the current configuration, click Go to Database View.
On the Confirm Generation panel, after you confirm the generation details, to start the data generation, click Run Generation.
Tonic displays a notification that the job has started. To track the progress of the data generation job and view the results, click the View Job button on the notification, or go to the Job History view.
The following issues prevent a data generation or subsetting job.
The following errors occur when you attempt to generate a subset. They do not apply if Use subsetting is turned off.