Available LLM integrations

We support integrations with OpenAI, Anthropic, Google, Hugging Face, and more.

• AI21
• Apertis
• Anthropic
• AnyScale
• ASI
• Azure OpenAI
• Baseten
• Bedrock
• Clarifai
• Cleanlab
• Cohere
• CometAPI
• Dashscope
• Dashscope Multi-Modal
• EverlyAI
• Featherless AI
• Fireworks
• Friendli
• Google Gen AI
• Gradient
• Gradient Model Adapter
• Groq
• Heroku
• HuggingFace Camel-7B
• HuggingFace StableLM
• HuggingFace Llama2
• Konko
• LangChain
• LiteLLM
• Llama API
• Llama CPP
• LocalAI
• MariTalk
• MistralAI
• Modelscope
• MonsterAPI
• MyMagic
• NeutrinoAI
• Nebius AI
• Nvidia TensorRT-LLM
• Nvidia Triton
• Ollama
• OpenAI
• OpenRouter
• Perplexity
• Pipeshift
• PremAI
• Portkey
• Predibase
• Replicate Llama2
• Replicate Vicuna
• Replicate Vector Index Llama2
• RunGPT
• SageMaker
• SambaNova Systems
• Together.ai
• Upstage
• Vercel AI Gateway
• vLLM
• Xorbits Inference
• Yi