Using your own LLM key for AI usage

Requires an Enterprise license.

Enterprise accounts can choose to provide an Anthropic or Amazon Bedrock LLM key to use for Fabricate AI features.

When you provide your own LLM key, Tonic.ai does not charge your for AI usage, only for basic access. However, any configured limit on AI usage cost still applies.

Enabling the option to provide your own key

To enable the option to use your own LLM key, you must contact Tonic.ai.

After Tonic.ai configures your account to require a custom LLM key, then before you can use any AI features, including Data Agent databases, you must provide the LLM key.

Selecting the LLM provider

On the My Account page, under LLM Provider Settings, from the Provider dropdown list, select the LLM provider to use.

You can use either Anthropic or Amazon Bedrock.

LLM Provider Settings to configure the LLM key for an Enterprise account

Providing an Anthropic key

If you choose Anthropic, then in the Anthropic API Key field, provide your Anthropic key.

Providing an Amazon Bedrock key

If you choose Amazon Bedrock, then:

  1. In the Amazon Bedrock API Key field, provide your Amazon Bedrock key.

  2. In the AWS Region field, specify the AWS Region where your account is located.

Testing and saving the LLM provider key

To test the provided key, click Test Credentials.

To save the configuration, click Save Changes.

Last updated