Enabling model-based custom entity types

To enable model-based custom entity types on a self-hosted instance, you must configure the connection to the LLM that you want to use.

To configure the connection, set the following environment variables:

  • MODEL_BASED_ENTITIES_LLM_URL - The URL to the LLM to use for model-based custom entity types.

  • MODEL_BASED_ENTITIES_LLM_MODEL_NAME - The name of the LLM model to use for model-based custom entity types.

  • MODEL_BASED_ENTITIES_LLM_API_KEY - The API key to use to connect to the LLM for model-based custom entity types.

Last updated

Was this helpful?