Creating a dataset

Required global permission: Create datasets

When you create a dataset, you specify:

• The type of output to produce

• The source location for the files.

• If the files are in cloud storage, the connection credentials.

Setting the name, source type, and output type

To create a dataset:

1. On the Datasets page, click Create a Dataset.

Dataset creation panel

1. In the Dataset Name field, provide a name for the dataset.

2. Under Output Format, select the type of output to generate.

3. Under File Source, select the source type. If the source type is a cloud storage option, then provide the required credentials.

4. Click Save.

5. For cloud storage datasets, Textual prompts you to configure the initial file selection. For more information, go to Selecting cloud storage files.

Providing credentials for Amazon S3

If the source type is Amazon S3, provide the credentials to use to connect to Amazon S3.

Credentials fields for an Amazon S3 dataset

1. Select the location of the credentials. For a self-hosted instance, you can either provide credentials manually, or use credentials that are configured in environment variables. Note that after you save the dataset, you cannot change the selection.

2. In the Access Key field, provide an AWS access key that is associated with an IAM user or role. For an example of a role that has the required permissions for an Amazon S3 dataset, go to .

3. In the Access Secret field, provide the secret key that is associated with the access key.

4. From the Region dropdown list, select the AWS Region to send the authentication request to.

5. In the Session Token field, provide the session token to use for the authentication request.

6. To test the credentials, click Test AWS Connection.

7. By default, connections to Amazon S3 use Amazon S3 encryption. To instead use AWS KMS encryption:

   1. Click Show Advanced Options.

   2. From the Server-Side Encryption Type dropdown list, select AWS KMS.

   3. In the Server-side Encryption AWS KMS ID field, provide the KMS key ID. Note that if the KMS key doesn't exist in the same account that issues the command, you must provide the full key ARN instead of the key ID.

   Note that after you save the new dataset, you cannot change the encryption type.

8. Click Save.