Data connector summary

Coming soon!

Development is underway to support the following new data connectors:

  • Salesforce

  • Amazon DynamoDB (DynamoDB)

Tonic Structural currently provides the following data connectors:

ConnectorTypeSupported versionsStructural limitations and differences

Spark

Recommend EMR-6.1.0 or EMR-6.2.0 with Spark 3.0.0 or Spark 3.0.1.

Any version that works with Spark 2.4.x (but not 2.4.2) or Spark 3.x should work.

Professional and Enterprise licenses only. Not available on Structural Cloud. No support for data science mode.

No support for workspace inheritance.

Limited logging information on the Job History view.

Limited to De-Identify and Truncate table modes.

Some generators not supported.

No subsetting.

No upsert. Cannot write output data to container artifacts.

Supports table filters and partition settings on de-identified tables.

Data warehouse

Professional and Enterprise licenses only. Not available on Structural Cloud. No support for data science mode.

Incremental and Scale table modes not supported. Some generators not supported.

No subsetting.

No upsert. Cannot write output data to container artifacts. Supports filters on de-identified tables.

Spark

Tested on Databricks v7.4, 9.1, and 10.4.

Any version that works with Spark 2.4.x (but not 2.4.2), Spark 3.0.x, or Spark 3.1.x should work.

Professional and Enterprise licenses only. No support for data science mode.

No support for workspace inheritance.

Limited to De-Identify and Truncate table modes.

Some generators not supported.

No subsetting. Cannot write output data to container artifacts.

Supports table filters and partition settings on de-identified tables.

Application database

V11.5

Enterprise licenses only.

Not available on Structural Cloud.

No support for data science mode. Limited to De-Identify and Truncate table modes.

No subsetting.

No upsert.

Cannot write output data to container artifacts.

File connector

Can select .csv, .tsv, .json, and .xml files from either Amazon S3, Google Cloud Storage, or a local file system. Can also select .txt or .gzip files that contain CSV, XML, or JSON content.

Professional and Enterprise licenses only.

No workspace inheritance.

No subsetting. No upsert. No post-job scripts. Cannot write output data to container artifacts.

Data warehouse

However, within Tonic it functions more like an application database.

Tonic uses the REST API or Storage API to interact with the data.

Professional and Enterprise licenses only. No hidden datasets as source or destination.

Incremental table mode not supported. Cross-Table Sum generator not supported. No subsetting.

No upsert. Cannot write output data to container artifacts. Supports filters on de-identified tables.

Application database

3.6 and above Also supports Amazon DocumentDB

Professional and Enterprise licenses only. No support for data science mode.

On the Structural application, the term "table" is generally replaced with "collection".

Database View and Table View are replaced with Collection View.

Limited to De-Identify, Truncate, and Preserve Destination modes for collections.

Some generators not supported. No upsert. Cannot write output data to container artifacts.

No post-job scripts. No workspace inheritance.

Application database

5.6, 5.7, and 8.0

Also supports

  • MariaDB 10.0 and above

  • Amazon Aurora

Application database

12c and above

Enterprise licenses only.

Incremental table mode not supported. Cannot write output data to container artifacts.

Application database

10 through 16 Also supports Amazon Aurora

Data warehouse

Professional and Enterprise licenses only.

Some generators not supported. Scale and Incremental table modes not supported.

No upsert. Cannot write output data to container artifacts. Supports filters on de-identified tables.

Data warehouse

Professional and Enterprise licenses only.

Some generators are not supported.

Scale and Incremental table modes are not supported. No upsert. Cannot write output data to container artifacts.

Supports filters on de-identified tables.

Spark

Professional and Enterprise licenses only. Not available on Structural Cloud. No support for data science mode.

No support for workspace inheritance.

Limited to De-Identify and Truncate table modes.

Some generators not supported.

No subsetting. No upsert. Cannot write output data to container artifacts.

Spark

Professional and Enterprise licenses only. Not available on Structural Cloud. No support for data science mode.

No support for workspace inheritance.

Limited to De-Identify and Truncate table modes.

Some generators not supported.

No subsetting.

No upsert. Cannot write output data to container artifacts. Supports table filters and partition settings on de-identified tables.

Application database

Also supports Azure SQL

Professional and Enterprise licenses only. Cannot write output data to container artifacts.

Last updated