Structural differences and limitations with Databricks
Last updated
Last updated
Required license: Professional or Enterprise
Databricks workspaces do not support workspace inheritance.
You can only assign the De-Identify or Truncate table modes.
For Truncate mode, the table is ignored completely. The table does not exist in the destination database.
Based on the version of Databricks, a Databricks workspace can only use the following generators:
Databricks 10.4 and earlier | Databricks 11.3 and later |
---|---|
Databricks workspaces do not support subsetting.
However, for tables that use the De-Identify table mode, you can provide a WHERE
clause to filter the table. For details, go to Using table filtering for data warehouses and Spark-based data connectors.
Databricks workspaces do not support upsert.
For Databricks workspaces, you cannot write the destination data to container artifacts.
For Databricks workspaces, you cannot write the destination data to an Ephemeral snapshot.
Address Alphanumeric String Key ASCII Key Business Name Categorical Character Scramble Character Substitution Company Name Conditional Constant Continuous Custom Categorical Date Truncation Email File Name Find and Replace FNR Geo HIPAA Address Hostname Integer Key IP Address MAC Address Name Noise Generator Null Numeric String Key Phone Random Boolean Random Double Random Hash Random Integer Random Timestamp Random UUID Regex Mask Sequential Integer Shipping Container SSN Struct Mask Timestamp Shift Unique Email URL UUID Key XML Mask
Address Business Name
Categorical
Character Scramble
Company Name
Conditional
Constant
Continuous
Custom Categorical
Date Truncation
FNR
HIPAA Address
Integer Key
IP Address
JSON Mask
MAC Address
Name
Noise Generator
Null
Random Double
Random Hash
Random Integer
Random UUID Regex Mask
SSN
Struct Mask
Timestamp Shift Generator
UUID Key