Data connector summary
Coming soon!
Development is underway to support the following new data connectors:
Salesforce
Amazon DynamoDB (DynamoDB)
Tonic Structural currently provides the following data connectors:
Last updated
Coming soon!
Development is underway to support the following new data connectors:
Salesforce
Amazon DynamoDB (DynamoDB)
Tonic Structural currently provides the following data connectors:
Last updated
Connector | Type | Supported versions | Structural limitations and differences |
---|---|---|---|
Spark
Recommend EMR-6.1.0 or EMR-6.2.0 with Spark 3.0.0 or Spark 3.0.1.
Any version that works with Spark 2.4.x (but not 2.4.2) or Spark 3.x should work.
Professional and Enterprise licenses only. Not available on Structural Cloud. No data science mode. No workspace inheritance. Limited logging information on the Job History view. Limited to De-Identify and Truncate table modes. Some generators not supported. No subsetting. No upsert. No output data to container artifacts. No output to an Ephemeral snapshot. Supports table filters and partition settings on de-identified tables.
Data warehouse
Professional and Enterprise licenses only. Not available on Structural Cloud. No data science mode. No Incremental and Scale table modes. Some generators not supported. No subsetting. No upsert. No output to container artifacts. No output to an Ephemeral snapshot. Supports filters on de-identified tables.
Spark
Tested on Databricks v7.4, 9.1, and 10.4.
Any version that works with Spark 2.4.x (but not 2.4.2), Spark 3.0.x, or Spark 3.1.x should work.
Professional and Enterprise licenses only. No data science mode. No workspace inheritance. Limited to De-Identify and Truncate table modes. Some generators not supported. No subsetting. No output to container artifacts. No output to an Ephemeral snapshot. Supports table filters and partition settings on de-identified tables.
Application database
V11.5
Enterprise licenses only. Not available on Structural Cloud. No data science mode. Limited to De-Identify and Truncate table modes. No subsetting. No upsert. No output to container artifacts. No output to an Ephemeral snapshot.
File connector
Can select .csv, .tsv, .json, .xml, and Parquet files from either Amazon S3, Google Cloud Storage, or a local file system. Can also select .txt or .gzip files that contain CSV, XML, or JSON content.
Professional and Enterprise licenses only. No workspace inheritance. No subsetting. No upsert. No post-job scripts. No output to container artifacts. No output to an Ephemeral snapshot.
Data warehouse
However, within Tonic it functions more like an application database.
Tonic uses the REST API or Storage API to interact with the data.
Professional and Enterprise licenses only. No hidden datasets as source or destination. No Incremental table mode. No Cross-Table Sum generator. No subsetting. No upsert. No output to container artifacts. No output to an Ephemeral snapshot. Supports filters on de-identified tables.
Application database
3.6 and above Also supports Amazon DocumentDB
Professional and Enterprise licenses only. No data science mode. On the Structural application, the term "table" is generally replaced with "collection". Database View and Table View are replaced with Collection View. Limited to De-Identify, Truncate, and Preserve Destination modes for collections. Some generators not supported. No upsert. No output to container artifacts. No output to an Ephemeral snapshot. No post-job scripts. No workspace inheritance.
Application database
5.6, 5.7, and 8.0
Also supports
MariaDB 10.0 and above
Amazon Aurora
Application database
12.1 and above
Enterprise licenses only. No Incremental table mode. No output to container artifacts. No output to an Ephemeral snapshot.
Application database
10 through 16 Also supports Amazon Aurora
Data warehouse
Professional and Enterprise licenses only. Some generators not supported. No Scale and Incremental table modes. No upsert. No output to container artifacts. No output to an Ephemeral snapshot. Supports filters on de-identified tables.
Data warehouse
Professional and Enterprise licenses only. Some generators are not supported. No Scale and Incremental table modes. No upsert. No output to container artifacts. No output to an Ephemeral snapshot. Supports filters on de-identified tables.
Spark
Professional and Enterprise licenses only. Not available on Structural Cloud. No data science mode. No workspace inheritance. Limited to De-Identify and Truncate table modes. Some generators not supported. No subsetting. No upsert. No output to container artifacts. No output to an Ephemeral snapshot.
Spark
Professional and Enterprise licenses only. Not available on Structural Cloud. No data science mode. No workspace inheritance. Limited to De-Identify and Truncate table modes. Some generators not supported. No subsetting. No upsert. No output to container artifacts. No output to an Ephemeral snapshot. Supports table filters and partition settings on de-identified tables.
Application database
2014 and above Also supports Azure SQL
Professional and Enterprise licenses only.