Spark with Livy

Apache Livy provides a REST API for triggering Spark Jobs.

Tonic Structural supports using Livy to run Spark Jobs.

Structural process for Spark with Livy

How Structural data generation works with Spark with Livy

System requirements

Supported versions of Spark and Livy

Structural differences and limitations

Features that are unavailable or work differently in Spark with Livy workspaces

Configure workspace data connections

Data connection settings for Spark with Livy workspaces