Configuring the default LLM provider and model
Last updated
Was this helpful?
For Textual features that require a connection to an LLM model, you can configure a default provider and model to use.
You can override the default provider and model for specific features.
For every provider that you use, you configure the connection information.
To configure a default LLM provider, set the following environment variable:
LLM_DEFAULT_PROVIDER
The available values are:
Bedrock - Indicates to use a model on Amazon Bedrock.
GoogleAiStudio - Indicates to use a Google AI Studio model.
OpenAi - Indicates to use an OpenAI-compatible model.
VertexAi - Indicates to use a model on Gemini Enterprise Agent Platform (formerly Vertex AI).
To configure the name of the default LLM model to use, set the following environment variable:
LLM_DEFAULT_MODEL_NAME
For information about recommended models, go to the provider connection information.
Last updated
Was this helpful?
Was this helpful?