Structural differences and limitations with Databricks
Required license: Professional or Enterprise
No workspace inheritance
Databricks workspaces do not support workspace inheritance.
Table mode limitations
You can only assign the De-Identify or Truncate table modes.
For Truncate mode, the table is ignored completely. The table does not exist in the destination database.
Generator limitations
Based on the version of Databricks, a Databricks workspace can only use the following generators:
Address Alphanumeric String Key ASCII Key Business Name Categorical Character Scramble Character Substitution Company Name Conditional Constant Continuous Custom Categorical Date Truncation Email File Name Find and Replace FNR Geo HIPAA Address Hostname Integer Key IP Address MAC Address Name Noise Generator Null Numeric String Key Phone Random Boolean Random Double Random Hash Random Integer Random Timestamp Random UUID Regex Mask Sequential Integer Shipping Container SSN Struct Mask Timestamp Shift Unique Email URL UUID Key XML Mask
Address Business Name
Categorical
Character Scramble
Company Name
Conditional
Constant
Continuous
Custom Categorical
Date Truncation
FNR
HIPAA Address
Integer Key
IP Address
JSON Mask
MAC Address
Name
Noise Generator
Null
Random Double
Random Hash
Random Integer
Random UUID Regex Mask
SSN
Struct Mask
Timestamp Shift Generator
UUID Key
No subsetting, but support for table filtering
Databricks workspaces do not support subsetting.
However, for tables that use the De-Identify table mode, you can provide a WHERE clause to filter the table. For details, go to Using table filtering for data warehouses and Spark-based data connectors.
No upsert
Databricks workspaces do not support upsert.
No output to container artifacts
For Databricks workspaces, you cannot write the destination data to container artifacts.
No output to an Ephemeral snapshot
For Databricks workspaces, you cannot write the destination data to an Ephemeral snapshot.
Last updated