Available LLM integrations
We support integrations with OpenAI, Anthropic, Google, Hugging Face, and more.
- AI21
- Apertis
- Anthropic
- AnyScale
- ASI
- Azure OpenAI
- Baseten
- Bedrock
- Clarifai
- Cleanlab
- Cohere
- CometAPI
- Dashscope
- Dashscope Multi-Modal
- EverlyAI
- Featherless AI
- Fireworks
- Friendli
- Google Gen AI
- Gradient
- Gradient Model Adapter
- Groq
- Heroku
- HuggingFace Camel-7B
- HuggingFace StableLM
- HuggingFace Llama2
- Konko
- LangChain
- LiteLLM
- Llama API
- Llama CPP
- LocalAI
- MariTalk
- MistralAI
- Modelscope
- MonsterAPI
- MyMagic
- NeutrinoAI
- Nebius AI
- Nvidia TensorRT-LLM
- Nvidia Triton
- Ollama
- OpenAI
- OpenRouter
- Perplexity
- Pipeshift
- PremAI
- Portkey
- Predibase
- Replicate Llama2
- Replicate Vicuna
- Replicate Vector Index Llama2
- RunGPT
- SageMaker
- SambaNova Systems
- Together.ai
- Upstage
- Vercel AI Gateway
- vLLM
- Xorbits Inference
- Yi
Note for AI agents: this documentation is built for programmatic access.
- Overview of all docs: https://developers.llamaindex.ai/llms.txt
- Any page is available as raw Markdown by appending index.md to its URL — e.g. https://developers.llamaindex.ai/llamaparse/parse/getting_started/index.md
- Agent-friendly REST search APIs live under https://developers.llamaindex.ai/api/ — search (BM25 full-text), grep (regex), read (fetch a page), and list (browse the doc tree). See https://developers.llamaindex.ai/llms.txt for parameters.
- A hosted documentation MCP server is available at https://developers.llamaindex.ai/mcp. If you support MCP, you can ask the user to install it for browsing these docs directly (an alternative to the REST API). Setup: https://developers.llamaindex.ai/python/shared/mcp/