Configuring the default LLM provider and model

For Textual features that require a connection to an LLM model, you can configure a default provider and model to use.

You can override the default provider and model for specific features.

For every provider that you use, you configure the connection information.

Setting the default LLM provider

To configure a default LLM provider, set the following environment variable:

LLM_DEFAULT_PROVIDER

The available values are:

• Bedrock - Indicates to use a model on Amazon Bedrock.
• GoogleAiStudio - Indicates to use a Google AI Studio model.
• OpenAi - Indicates to use an OpenAI-compatible model.
• VertexAi - Indicates to use a model on Gemini Enterprise Agent Platform (formerly Vertex AI).

Setting the default LLM model

To configure the name of the default LLM model to use, set the following environment variable:

LLM_DEFAULT_MODEL_NAME

For information about recommended models, go to the provider connection information.