Configuring the file connector storage type and output options

On the workspace details view for a file connector workspace, you:

• Identify the type of storage. After you add a file group to the workspace, you cannot change the storage type.

• Indicate where to write the transformed files

• If needed, provide credentials to access the cloud storage.

Identifying the type of storage

On the workspace creation view:

1. Under Connection Type, under File/Blob Storage, click Files.

2. Select the type of file storage where the source files are located.

   1. To choose files from Amazon S3, click Amazon S3. Note that this option is not supported on Tonic Cloud.

   2. To choose files from GCS, click Google Cloud Storage.

   3. To upload files from a local file system, click Local Filesystem.

   After you add a file group to the workspace, you cannot change the storage type.

Selecting the cloud storage folder to write the transformed files to

For Amazon S3 and Google Cloud Storage, under Output location, provide the path to the folder where Structural writes the transformed files.

When the source files come from a local file system, Tonic Structural writes the output files to the large file store in the Structural application database. You can then download the most recently generated files.

Providing credentials to access AWS

On Structural Cloud, to write files to Amazon S3, you must provide the AWS credentials in the workspace configuration.

On a self-hosted instance, if you provide AWS credentials in the workspace configuration, then Structural uses those credentials.

If you do not provide credentials in the workspace configuration, then Structural uses either:

• The credentials set in the following environment settings:

  • TONIC_AWS_ACCESS_KEY_ID - An AWS access key that is associated with an IAM user or role.

  • TONIC_AWS_SECRET_ACCESS_KEY - The secret key that is associated with the access key

  • TONIC_AWS_REGION - The AWS Region to send the authentication request to

  For more information, go to Configuring environment settings.

• The credentials for the IAM role on the host machine.

Providing the AWS credentials

To provide the credentials, under AWS Credentials:

1. In the AWS Access Key field, enter the AWS access key that is associated with an IAM user or role.

2. In the AWS Secret Key field, enter the secret key that is associated with the access key.

3. From the AWS Region dropdown list, select the AWS Region to send the authentication request to.

Providing separate output credentials

By default, Structural uses the same AWS credentials to both retrieve the source files and write the output files.

To provide different AWS credentials for the output location:

1. Toggle Set different credentials for output to the on position.

2. In the AWS Access Key field, enter the AWS access key that is associated with an IAM user or role.

3. In the AWS Secret Key field, enter the secret key that is associated with the access key.

4. From the AWS Region dropdown list, select the AWS Region to send the authentication request to.

Providing credentials to access Google Cloud Storage

To write files to a folder in Google Cloud Storage, you must provide Google Cloud Platform credentials in the workspace configuration.

Under GCP Credentials:

1. For Service Account File, select the service account file (JSON file) for the source files.

2. In the GCP Project ID field, provide the identifier of the project that contains the source files.