Configuring added and excluded values for an entity type

For each entity type in a dataset, you can configure additional values to detect, and values to exclude.

You might add values that Textual does not detect because, for example, they are specific to your organization or industry.

You might exclude a value because:

  • Textual labeled the value incorrectly.

  • You do not want to redact a specific value. For example, you might want to preserve known test values.

Note that for a pipeline that redacts files, you cannot exclude or add specific values.

Viewing whether an entity type has added or excluded values

For the detected entity types list, the add values and exclude values icons indicate whether there are configured included and blocked values for the entity type.

For the undetected entity types, the list only displays the add value icon.

When added or excluded values are configured, the corresponding icon is green.

When there are no configured values, the corresponding icon is black.

Displaying the Custom Entity Detection panel

From the Custom Entity Detection panel, you configure both added and excluded values for entity types.

To display the panel, either:

  • Click the add values or exclude values icon for an entity type

  • In the word count panel, click Custom Entity Detection

The panel contains an Add to detection tab for added values, and an Exclude from detection tab for excluded values.

Selecting the entity type to add or exclude values for

The entity type dropdown list at the top of the Custom Entity Detection panel indicates the entity type that you are configuring added and excluded values for.

If you display the panel from an add values or exclude values icon, then the initial selected entity type is the entity type for which you clicked the icon. To configure values for a different entity type, select the entity type from the list.

If you display the panel from the Custom Entity Detection option, then there is no default selection. You must select the entity type.

Configuring added values

On the Add to detection tab, you configure the added values for the selected entity type.

Each value can be a specific word or phrase, or a regular expression to identify the values to add. Regular expressions must be C# compatible.

Configuring a new added value

To add an added value:

  1. Click the empty entry.

  2. Type the value into the field.

Editing an added value

To edit an added value:

  1. Click the value.

  2. Update the value text.

Testing an added value

For each added value, you can test whether Textual correctly detects it.

To test a value:

  1. From the Test Entry dropdown list, select the number for the value to test.

  2. In the text field, type or paste content that contains a value or values that Textual should detect.

The Results field displays the text and highlights matching values.

Removing an added value

To remove an added value, click its delete icon.

Configuring excluded values

On the Exclude from detection tab, you configure the excluded values for the selected entity type.

Each value can be either a specific word or phrase to exclude, or a regular expression to identify the values to exclude. The regular expression must be C# compatible.

Adding an excluded value

To add an excluded value:

  1. Click the empty entry.

  2. Type the value into the field.

Editing an excluded value

To edit an excluded value:

  1. Click the value.

  2. Update the value text.

Testing an excluded value

For each excluded value, you can test whether Textual correctly detects it.

To test the value that you are currently editing:

  1. From the Test Entry dropdown list, select the number for the value to test.

  2. In the text field, type or paste content that contains a value or values to exclude.

The Results field displays the text and highlights matching values.

Removing an excluded value

To remove an excluded value, click its delete icon.

Saving the updated added and excluded values

The new added and excluded values are not reflected in the entity types list until Textual runs a new scan.

When you save the changes, you can choose whether to run a new scan on the dataset files.

To save the changes and also start a scan, click Save and Scan Files.

To save the changes, but not run a scan, click Save Without Scanning Files. When you do not run the scan, then on the dataset details page, Textual displays a prompt to run a scan.

Last updated