Links

System requirements for Databricks

Supported versions of Databricks

Tonic supports Spark 2.4.x, Spark 3.0.x, and Spark 3.1.x. Spark 2.4.2 is not supported.
Any version of Databricks that runs one of those Spark versions should be compatible. Tonic specifically has been tested against Databricks versions 7.4, 9.1, and 10.4.

Supported providers

Tonic supports the following data providers:
Source Provider
Output Provider
Parquet
Parquet
CSV
Parquet
Avro
Avro
JSON
JSON
ORC
ORC
Delta
Delta

Supported table types

Databricks supports both MANAGED and EXTERNAL tables.
  • MANAGED tables store all of their data within Databricks.
  • EXTERNAL tables store their data on a separate file system (often S3).
Tonic can read from both table types. When it writes output data, Tonic only writes to EXTERNAL tables.
Last modified 4mo ago