Setting up the Spark SDK

After you create the workspace, including the data connections, the next step is to set up the SDK.

For a Spark SDK workspace, at the top right corner of the workspace management view, the Generate Data button is replaced with an SDK Setup button.

SDK Setup option for a Spark SDK workspace

To get started, click SDK Setup.

Generating an API token

On the API Token tab of the setup panel, to create an API Token, click Create API token.

API Token tab of the Spark SDK setup panel

After you create the API token, use the copy icons to copy the following values, which you will need to run the data generation:

  • API token

  • Workspace ID

API Token tab with a generated token

When you're finished, click Next.

Downloading the Structural SDK JAR file

On the Download SDK tab of the SDK setup panel, to download the Structural SDK JAR file, click Download the JAR.

Place the JAR file on the Spark master node. Your Spark jobs must include this JAR file.

You can optionally include the SDK as a Maven dependency. To display the repository entries for the Spark SDK, On the Download SDK tab, click Maven.

Maven dependency entries for the Spark SDK

Last updated

Was this helpful?