Data connector summary

Coming soon!

Development is underway to support the following new data connectors:

  • SAP ASE (formerly Sybase)

  • Amazon DynamoDB (DynamoDB)

Tonic Structural currently provides the following data connectors:

ConnectorTypeSupported versionsStructural limitations and differences

Spark

Recommend EMR-6.1.0 or EMR-6.2.0 with Spark 3.0.0 or Spark 3.0.1.

Any version that works with Spark 2.4.x (but not 2.4.2) or Spark 3.x should work.

Professional and Enterprise licenses only. Not available on Structural Cloud. No workspace inheritance. Limited logging information on the Jobs view. Limited to De-Identify and Truncate table modes. Some generators not supported. No subsetting. No upsert. No output data to container artifacts. No output to an Ephemeral snapshot. Supports table filters and partition settings on de-identified tables.

Data warehouse

Professional and Enterprise licenses only. Not available on Structural Cloud. No Incremental and Scale table modes. Some generators not supported. No subsetting. No upsert. No output to container artifacts. No output to an Ephemeral snapshot. Supports filters on de-identified tables.

Spark

Tested on Databricks v7.4, 9.1, and 10.4.

Any version that works with Spark 2.4.x (but not 2.4.2), Spark 3.0.x, or Spark 3.1.x should work.

Professional and Enterprise licenses only. No workspace inheritance. Limited to De-Identify and Truncate table modes. Some generators not supported. No subsetting. No output to container artifacts. No output to an Ephemeral snapshot. Supports table filters and partition settings on de-identified tables.

Application database

V11.5

Enterprise licenses only. Not available on Structural Cloud. Limited to De-Identify and Truncate table modes. No upsert. No output to container artifacts. No output to an Ephemeral snapshot.

File connector

Can select .csv, .tsv, .json, .xml, and Parquet files from either Amazon S3, Google Cloud Storage, or a local file system. Can also select .txt or .gzip files that contain CSV, XML, or JSON content.

Professional and Enterprise licenses only. No workspace inheritance. No subsetting. No upsert. No post-job scripts. No output to container artifacts. No output to an Ephemeral snapshot.

Data warehouse

However, within Tonic it functions more like an application database.

Tonic uses the REST API or Storage API to interact with the data.

Professional and Enterprise licenses only. No hidden datasets as source or destination. No Incremental table mode. No Cross-Table Sum generator. No subsetting. No upsert. No output to container artifacts. No output to an Ephemeral snapshot. Supports filters on de-identified tables.

Application database

3.6 and above Also supports Amazon DocumentDB

Professional and Enterprise licenses only. On the Structural application, the term "table" is generally replaced with "collection". Database View and Table View are replaced with Collection View. No Privacy Report download Limited to De-Identify, Truncate, and Preserve Destination modes for collections. Some generators not supported. No upsert. No output to container artifacts. No output to an Ephemeral snapshot. No post-job scripts. No workspace inheritance.

Application database

5.6, 5.7, and 8.x

Also supports

  • MariaDB 10.0 and above

  • Amazon Aurora

Application database

12.1 and above

Enterprise licenses only. No Incremental table mode. No output to container artifacts.

Application database

10 through 16 Also supports Amazon Aurora

SaaS (Software as a Service)

Minimum Professional edition

Professional and Enterprise licenses only.

Limited to De-identify and Truncate table modes.

Some generators not supported.

No upsert.

No post-job scripts.

No output to container artifacts.

No output to an Ephemeral snapshot.

Data warehouse

Professional and Enterprise licenses only. Some generators not supported. No Scale and Incremental table modes. No upsert. No output to container artifacts. No output to an Ephemeral snapshot. Supports filters on de-identified tables.

Data warehouse

Professional and Enterprise licenses only. Some generators are not supported. No Scale and Incremental table modes. No upsert. No output to container artifacts. No output to an Ephemeral snapshot. Supports filters on de-identified tables.

Spark

Professional and Enterprise licenses only. Not available on Structural Cloud. No workspace inheritance. Limited to De-Identify and Truncate table modes. Some generators not supported. No subsetting. No upsert. No output to container artifacts. No output to an Ephemeral snapshot.

Application database

2014 and above Also supports Azure SQL

Professional and Enterprise licenses only.

Application database

2024.1 and above

Yugabyte SQL (YSQL) only

Professional and Enterprise licenses only.

Limited to De-Identify, Truncate, and Scale table modes.

Some generators not supported.

No upsert.

No output to container artifacts.

No output to an Ephemeral snapshot.

Last updated