Uploading and deleting local files

For a local file dataset, you upload and remove new files directly.

On Tonic Textual Cloud, and by default for self-hosted instances, Textual stores the files in the application database.

On a self-hosted instance, you can instead configure an S3 bucket where Textual stores the files.

For more information, go to Setting the S3 bucket for file uploads.

For an example of an IAM role with the required permissions, go to Example IAM role for Amazon S3 datasets (was Example IAM role for Amazon S3 pipelines).

Adding files to the dataset

Required dataset permission: Upload files to a dataset

From the dataset details page, to add files to the dataset:

1. In the panel at the top left, click Upload Files.

Dataset files list with the upload option

1. Search for and select the files.

Textual uploads and then processes the files. For more information about file processing, go to Tracking and managing file processing.

Do not leave the page while files are uploading. If you leave the page before the upload is complete, then the upload stops.

You can leave the page while Textual is processing the file.

On a self-hosted instance, when a file fails to upload, you can download the associated logs. To download the logs, click the options menu for the file, then select Download Logs.

Removing files from the dataset

Required dataset permission: Delete files from a dataset

To remove a file from the dataset:

Options menu for a dataset file

1. In the file list, click the options menu for the file.

2. In the options menu, click Delete File.