Viewing pipeline lists and details

In Tonic Textual, a pipeline identifies a set of files that Textual processes into content that can be imported into an LLM system.

Displaying the list of pipelines

The Textual Home page displays both datasets and pipelines.

Textual home page list of datasets and pipelines

To display only the list of pipelines, in the Textual navigation menu, click Pipelines.

The Pipelines page displays the list of pipelines.

Pipelines page

If there are no pipelines, then the Pipelines page displays a panel to allow you to create a pipeline.

Displaying details for a pipeline

To display the details for a pipeline, on the Textual Home page or Pipelines page, click the pipeline name.

Details for an Amazon S3 pipeline

Here is a pipeline details page for an Amazon S3 pipeline:

Pipeline details page for an Amazon S3 pipeline

For an Amazon S3 pipeline, the details include:

• The Run Pipeline option, which starts a new pipeline run. For more information, go to Starting a pipeline run.

• The settings option, which you use to change the configuration settings for the pipeline. For more information, go to Editing a pipeline.
• The list of processed files. For more information, go to Viewing pipeline files and runs.

• The list of pipeline runs. For more information, go to Viewing the list of pipeline runs.
• For pipelines that are configured to also redact files, the redaction configuration. For more information, go to Selecting the handling option for the entity types.

Details for a Databricks pipeline

Here is a pipeline details page for a Databricks pipeline:

Pipeline details page for a Databricks pipeline

For a Databricks pipeline, the details include:

• The Run Pipeline option, which starts a new pipeline run. For more information, go to Starting a pipeline run.

• The settings option, which you use to change the configuration settings for the pipeline. For more information, go to Editing a pipeline.
• The list of processed files. For more information, go to Viewing pipeline files and runs.

• The list of pipeline runs. For more information, go to Viewing the list of pipeline runs.
• For pipelines that are configured to also redact files, the redaction configuration. For more information, go to Selecting the handling option for the entity types.

Details for an Azure pipeline

Here is a pipeline details page for an Azure pipeline:

Pipeline details page for an Azure pipeline

For an Azure pipeline, the details include:

• The Run Pipeline option, which starts a new pipeline run. For more information, go to Starting a pipeline run.

• The settings option, which you use to change the configuration settings for the pipeline. For more information, go to Editing a pipeline.
• The list of processed files. For more information, go to Viewing pipeline files and runs.

• The list of pipeline runs. For more information, go to Viewing the list of pipeline runs.
• For pipelines that are configured to also redact files, the redaction configuration. For more information, go to Selecting the handling option for the entity types.

Details for an uploaded file pipeline

And here is a pipeline details page for an uploaded file pipeline:

Pipeline details page for an uploaded file pipeline

The pipeline details include:

• The Upload Files option, which you use to add files to the pipeline. For more information, go to Selecting files for an uploaded file pipeline.

• The settings option, which you use to change the configuration settings for the pipeline. For more information, go to Editing a pipeline.
• The list of files in the pipeline. Includes both new and processed files. For more information, go to Viewing pipeline files and runs.

• For pipelines that are configured to also redact files, the redaction configuration. For more information, go to Selecting the handling option for the entity types.