Structural differences and limitations with the Spark SDK
Required license: Professional or Enterprise license.
Not available on Tonic Structural Cloud.
No data science mode
Spark SDK is only available for data generation workspaces. You cannot use Spark SDK in data science mode workspaces.
No workspace inheritance
Spark SDK workspaces do not support workspace inheritance.
Table mode limitations
You can only assign the De-Identify or Truncate table modes.
For Truncate mode, the table is ignored completely. The table does not exist in the destination database.
Generator limitations
Spark SDK workspaces only support the following generators:
Address
Categorical
Character Scramble
Company Name
Constant
Continuous
Custom Categorical
Date Truncation
Email
HIPAA Address
Integer Key
JSON Mask
MAC Address
Name
Noise Generator
Null
Random Hash
Random Integer
Random UUID
Regex Mask
SSN
Struct Mask
Timestamp Shift Generator
UUID Key
No subsetting
Spark SDK workspaces do not support subsetting.
No upsert
Spark SDK workspaces do not support upsert.
No output to container artifacts
For Spark SDK workspaces, you cannot write the destination data to container artifacts.
No output to an Ephemeral snapshot
For Spark SDK workspaces, you cannot write the destination data to an Ephemeral snapshot
Last updated