Skip to main content
Bring your own LLM provider key is only available on Chainloop’s Enterprise paid plan.

Overview

Chainloop integrates with Large Language Model (LLM) providers to power AI-driven policy evaluation, data analysis and more. AI providers can be registered from the Integrations page in your organization. Once configured, they are automatically used by LLM-driven policies and the chainloop.evidence_prompt builtin function. AI Provider integrations

Supported Providers

If you have both Anthropic and OpenAI registered, Anthropic will take precedence and be used as the default provider for LLM evaluations.

Anthropic

Register an Anthropic integration by providing your API key. Chainloop will use it to send evidence and prompts to Anthropic’s Claude models for evaluation. Registration fields:

OpenAI

Register an OpenAI integration by providing your API key. This connects directly to OpenAI’s API. Registration fields:

OpenAI on Microsoft Foundry

The OpenAI integration also supports connecting to Azure-hosted OpenAI models through Microsoft Foundry. To use Azure OpenAI, provide a custom endpoint pointing to your Azure OpenAI deployment alongside your API key. Registration fields:
The Endpoint field is what distinguishes a direct OpenAI registration from an Azure OpenAI one. When an endpoint is provided, Chainloop routes requests to your Azure deployment instead of the OpenAI API directly.