Data connector summary

Coming soon!

Development is underway to support the following new data connectors:

  • Amazon DynamoDB (DynamoDB)

Tonic Structural currently provides the following data connectors:

ConnectorTypeSupported versionsStructural limitations and differences

Spark

Recommend EMR-6.1.0 or EMR-6.2.0 with Spark 3.0.0 or Spark 3.0.1.

Any version that works with Spark 2.4.x (but not 2.4.2) or Spark 3.x should work.

Professional and Enterprise licenses only. Not available on Structural Cloud. No data science mode. No workspace inheritance. Limited logging information on the Job History view. Limited to De-Identify and Truncate table modes. Some generators not supported. No subsetting. No upsert. No output data to container artifacts. No output to an Ephemeral snapshot. Supports table filters and partition settings on de-identified tables.

Data warehouse

Professional and Enterprise licenses only. Not available on Structural Cloud. No data science mode. No Incremental and Scale table modes. Some generators not supported. No subsetting. No upsert. No output to container artifacts. No output to an Ephemeral snapshot. Supports filters on de-identified tables.

Spark

Tested on Databricks v7.4, 9.1, and 10.4.

Any version that works with Spark 2.4.x (but not 2.4.2), Spark 3.0.x, or Spark 3.1.x should work.

Professional and Enterprise licenses only. No data science mode. No workspace inheritance. Limited to De-Identify and Truncate table modes. Some generators not supported. No subsetting. No output to container artifacts. No output to an Ephemeral snapshot. Supports table filters and partition settings on de-identified tables.

Application database

V11.5

Enterprise licenses only. Not available on Structural Cloud. No data science mode. Limited to De-Identify and Truncate table modes. No upsert. No output to container artifacts. No output to an Ephemeral snapshot.

File connector

Can select .csv, .tsv, .json, .xml, and Parquet files from either Amazon S3, Google Cloud Storage, or a local file system. Can also select .txt or .gzip files that contain CSV, XML, or JSON content.

Professional and Enterprise licenses only. No workspace inheritance. No subsetting. No upsert. No post-job scripts. No output to container artifacts. No output to an Ephemeral snapshot.

Data warehouse

However, within Tonic it functions more like an application database.

Tonic uses the REST API or Storage API to interact with the data.

Professional and Enterprise licenses only. No hidden datasets as source or destination. No Incremental table mode. No Cross-Table Sum generator. No subsetting. No upsert. No output to container artifacts. No output to an Ephemeral snapshot. Supports filters on de-identified tables.

Application database

3.6 and above Also supports Amazon DocumentDB

Professional and Enterprise licenses only. No data science mode. On the Structural application, the term "table" is generally replaced with "collection". Database View and Table View are replaced with Collection View. Limited to De-Identify, Truncate, and Preserve Destination modes for collections. Some generators not supported. No upsert. No output to container artifacts. No output to an Ephemeral snapshot. No post-job scripts. No workspace inheritance.

Application database

5.6, 5.7, and 8.x

Also supports

  • MariaDB 10.0 and above

  • Amazon Aurora

Application database

12.1 and above

Enterprise licenses only. No Incremental table mode. No output to container artifacts.

Application database

10 through 16 Also supports Amazon Aurora

SaaS (Software as a Service)

Minimum Professional edition

Professional and Enterprise licenses only.

No data science mode.

Limited to De-identify and Truncate table modes.

Some generators not supported.

For subsetting, no WHERE clauses or upstream filters.

No upsert.

No post-job scripts.

No output to container artifacts.

No output to an Ephemeral snapshot.

Data warehouse

Professional and Enterprise licenses only. Some generators not supported. No Scale and Incremental table modes. No upsert. No output to container artifacts. No output to an Ephemeral snapshot. Supports filters on de-identified tables.

Data warehouse

Professional and Enterprise licenses only. Some generators are not supported. No Scale and Incremental table modes. No upsert. No output to container artifacts. No output to an Ephemeral snapshot. Supports filters on de-identified tables.

Spark

Professional and Enterprise licenses only. Not available on Structural Cloud. No data science mode. No workspace inheritance. Limited to De-Identify and Truncate table modes. Some generators not supported. No subsetting. No upsert. No output to container artifacts. No output to an Ephemeral snapshot.

Spark

Professional and Enterprise licenses only. Not available on Structural Cloud. No data science mode. No workspace inheritance. Limited to De-Identify and Truncate table modes. Some generators not supported. No subsetting. No upsert. No output to container artifacts. No output to an Ephemeral snapshot. Supports table filters and partition settings on de-identified tables.

Application database

2014 and above Also supports Azure SQL

Professional and Enterprise licenses only.

Last updated