Tracking and managing file processing

When you add files to a local files dataset, or change the file selection for a cloud storage dataset, Tonic Textual automatically scans the files to identify the entities that they contain.

When you change the dataset configuration, Textual also prompts you to run a new scan. For example, a new scan is required when you:

• Configure added values

• Change the available custom entity types

The file list reflects the current scanning status for the file. A file is initially queued for scanning. When the scan starts, the status changes to scanning. When Textual finishes processing a file, it marks the file as scanned.

When a file needs to be rescanned, a warning icon displays in front of the file name.

Warning icon for a file that needs to be rescanned

As Textual processes each file, it updates the results.

Pausing the file processing

If needed, you can pause the file processing. To pause the processing, click the pause icon.

The information in the results only reflect the files that are scanned.

For a cloud storage dataset, when you generate output, Textual only includes files that are scanned.

Starting a scan on a paused file

Required dataset permission: Start a scan of dataset files

After you pause the scan, you can start a scan on individual files.

To start a scan on a file, click the refresh icon for the file.

Refresh icon for a dataset file

Downloading logs for files that fail to process

Required dataset permission: Start a scan of dataset files

When Textual is unable to process a file, it displays an error for that file.

To download log files for the failed file:

1. Click the options menu for the file.

2. Click Download Logs.