For the complete documentation index, see llms.txt. This page is also available as Markdown.

Managing dataset file scans

To detect entity values, Textual scans the dataset files.

Automatic scans

Textual automatically runs a scan when you:

Starting a scan manually

Required dataset permission:

  • To scan all files: Start a scan of all dataset files

  • To scan a single file: Start a scan of a dataset file

When you change the dataset configuration, Textual prompts you to run a new scan.

For example, a new scan is required when you:

Textual displays an overall prompt to start a new scan, as well as a warning icon next to each affected file.

Prompts to run a new scan

To start a scan of all of the affected files:

  1. Click the Scan button in the main prompt.

  2. On the confirmation panel, click Continue.

To start scan of an individual file, click its refresh icon.

Refresh icon for a dataset file

Tracking the scan status

The file list reflects the current scanning status for the file.

  1. A file is initially queued for scanning.

  2. When the scan starts, the status changes to scanning.

  3. When Textual finishes processing a file, it marks the file as scanned.

As Textual processes each file, it updates the dataset results.

Pausing a scan

If needed, you can pause the scan. To pause the scan, click the pause icon.

The information in the dataset results only reflect the scanned files.

For a cloud storage dataset, when you generate output, Textual only includes files that are scanned.

Resuming a scan on a paused file

Required dataset permission: Start a scan of a dataset file

After you pause the scan, you can start a scan on individual files.

To start a scan on a file, click the refresh icon for the file.

Refresh icon for a dataset file

Downloading logs for files that fail to process

Required dataset permission: Start a scan of all dataset files

When Textual is unable to process a file, it displays an error for that file.

To download log files for the failed file:

  1. Click the options menu for the file.

  2. Click Download Logs.

Last updated

Was this helpful?