Skip to content
LlamaIndex OSS Documentation
LlamaParse
LiteParse
LlamaAgents
LlamaIndex Framework
LlamaIndex Framework
LlamaParse
LlamaParse
LiteParse
LiteParse
LlamaAgents
LlamaAgents
LlamaIndex Framework
LlamaIndex Framework
Search
Ctrl
K
Auto
Light
Dark
LlamaParse
LiteParse
LlamaAgents
LlamaIndex Framework
Welcome to LlamaIndex 🦙 !
Getting Started
High-Level Concepts
Installation and Setup
How to read these docs
Starter Tutorial (Using OpenAI)
Starter Tutorial (Using Local LLMs)
Discover LlamaIndex Video Series
Frequently Asked Questions (FAQ)
Starter Tools
Starter Tools
RAG CLI
Async Programming in Python
Learn
Building an LLM application
Using LLMs
Building agents
Building an agent
Using existing tools
Maintaining state
Streaming output and events
Human in the loop
Multi-agent patterns in LlamaIndex
Using Structured Output
Building a RAG pipeline
Introduction to RAG
Indexing
Indexing
Loading
Loading Data (Ingestion)
Loading from LlamaCloud
LlamaHub
Querying
Querying
Storing
Storing
Structured Data Extraction
Introduction to Structured Data Extraction
Using Structured LLMs
Structured Prediction
Low-level structured data extraction
Structured Input
Tracing And Debugging
Tracing and Debugging
Evaluating
Cost Analysis
Cost Analysis
Usage Pattern
Evaluating
Putting It All Together
Putting It All Together
Agents
Apps
Full-Stack Web Application
A Guide to Building a Full-Stack Web App with LLamaIndex
A Guide to Building a Full-Stack LlamaIndex Web App with Delphic
Chatbots
How to Build a Chatbot
Q And A
Q&A patterns
A Guide to Extracting Terms and Definitions
Structured Data
Structured Data
Privacy and Security
Use Cases
Use Cases
Agents
Chatbots
Structured Data Extraction
Fine-tuning
Querying Graphs
Multi-modal
Prompting
Question-Answering (RAG)
Querying CSVs
Parsing Tables and Charts
Text to SQL
Component Guides
Component Guides
Deploying
Agents
Agents
Memory
Module Guides
Tools
Chat Engines
Chat Engine
Module Guides
Usage Pattern
Query Engine
Query Engine
Module Guides
Response Modes
Streaming
Supporting Modules
Usage Pattern
Evaluating
Evaluating
Contributing A `LabelledRagDataset`
Evaluating Evaluators with `LabelledEvaluatorDataset`'s
Evaluating With `LabelledRagDataset`'s
Modules
Usage Pattern (Response Evaluation)
Usage Pattern (Retrieval)
Indexing
Indexing
Document Management
How Each Index Works
LlamaCloudIndex + LlamaCloudRetriever
Using a Property Graph Index
Metadata Extraction
Module Guides
Using VectorStoreIndex
Loading
Loading Data
Connector
Data Connectors (LlamaHub)
LlamaParse
Module Guides
Usage Pattern
Documents And Nodes
Documents / Nodes
Defining and Customizing Documents
Metadata Extraction Usage Pattern
Defining and Customizing Nodes
Ingestion Pipeline
Ingestion Pipeline
Transformations
Node Parsers
Node Parser Usage Pattern
Node Parser Modules
SimpleDirectoryReader
MCP
Model Context Protocol (MCP)
Converting Existing LlamaIndex Workflows & Tools to MCP
LlamaCloud MCP Servers & Tools
Using MCP Tools with LlamaIndex
Models
Models
Embeddings
Llms
Using LLMs
Using local models
Available LLM integrations
Customizing LLMs within LlamaIndex Abstractions
Using LLMs as standalone modules
Multi-modal models
Prompts
Prompts
Prompt Usage Pattern
Observability
Observability
Callbacks
Callbacks
Token Counting - Migration Guide
Instrumentation
Querying
Querying
Node Postprocessors
Node Postprocessor
Node Postprocessor Modules
Response Synthesizers
Response Synthesizer
Response Synthesis Modules
Retriever
Retriever
Retriever Modes
Retriever Modules
Router
Routers
Structured Outputs
Structured Outputs
Output Parsing Modules
Pydantic Programs
(Deprecated) Query Engines + Pydantic Outputs
Storing
Storing
Chat Stores
Customizing Storage
Document Stores
Index Stores
Key-Value Stores
Persisting & Loading Data
Vector Stores
Supporting Modules
Migrating from ServiceContext to Settings
Configuring Settings
Supporting Modules
Open Source Community
FAQ
Frequently Asked Questions
Chat Engines
Documents and Nodes
Embeddings
Large Language Models
Query Engines
Vector Database
Full-Stack Projects
Integrations
Integrations
ChatGPT Plugin Integrations
Unit Testing LLMs/RAG With DeepEval
Fleet Context Embeddings - Building a Hybrid Search Engine for the Llamaindex Library
Using Graph Stores
Tracing with Graphsignal
Guidance
LM Format Enforcer
Using Managed Indices
Tonic Validate
Evaluating and Tracking with TruLens
Perform Evaluations on LlamaIndex with UpTrain
Using Vector Stores
Llama Packs
Llama Packs 🦙📦
Integrations
Embeddings
Aleph Alpha Embeddings
Anyscale Embeddings
Baseten Embeddings
Bedrock Embeddings
Embeddings with Clarifai
Cloudflare Workers AI Embeddings
CohereAI Embeddings
Custom Embeddings
DashScope Embeddings
Databricks Embeddings
DeepInfra
Elasticsearch Embeddings
Qdrant FastEmbed Embeddings
Fireworks Embeddings
Google Gemini Embeddings
GigaChat
Google GenAI Embeddings
Google Palm Embeddings
Heroku LLM Managed Inference Embedding
Local Embeddings with HuggingFace
IBM watsonx.ai
Local Embeddings with IPEX-LLM on Intel CPU
Local Embeddings with IPEX-LLM on Intel GPU
Isaacus Embeddings
Jina 8K Context Window Embeddings
Jina Embeddings
LangChain Embeddings
Llamafile Embeddings
LLMRails Embeddings
MistralAI Embeddings
Mixedbread AI Embeddings
ModelScope Embeddings
Nebius Embeddings
Netmind AI Embeddings
Nomic Embedding
NVIDIA NIMs
Oracle Cloud Infrastructure (OCI) Data Science Service
Oracle Cloud Infrastructure Generative AI
Ollama Embeddings
OpenAI Embeddings
Local Embeddings with OpenVINO
Optimized Embedding Model using Optimum-Intel
Oracle AI Vector Search: Generate Embeddings
PremAI Embeddings
Interacting with Embeddings deployed in Amazon SageMaker Endpoint with LlamaIndex
Text Embedding Inference
TextEmbed - Embedding Inference Server
Together AI Embeddings
Upstage Embeddings
Interacting with Embeddings deployed in Vertex AI Endpoint with LlamaIndex
VoyageAI Embeddings
YandexGPT
Llm
AI21
Aleph Alpha
Anthropic
Anthropic Prompt Caching
Anyscale
Apertis
ASI LLM
Azure AI model inference
Azure OpenAI
Baseten Cookbook
Bedrock
Bedrock Converse
Cerebras
Clarifai LLM
Cleanlab Trustworthy Language Model
Cohere
CometAPI
DashScope LLMS
Databricks
DeepInfra
DeepSeek
EverlyAI
Featherless AI LLM
Fireworks
Fireworks Function Calling Cookbook
Friendli
Gemini
Google GenAI
Grok 4
Groq
Helicone AI Gateway
Heroku LLM Managed Inference
Hugging Face LLMs
IBM watsonx.ai
IPEX-LLM on Intel CPU
IPEX-LLM on Intel GPU
Konko
LangChain LLM
LiteLLM
Replicate - Llama 2 13B
🦙 x 🦙 Rap Battle
Llama API
LlamaCPP
llamafile
LLM Predictor
LM Studio
LocalAI
Maritalk
MistralRS LLM
MistralAI
ModelScope LLMS
Monster API <> LLamaIndex
MyMagic AI LLM
Nebius LLMs
Netmind AI LLM
Neutrino AI
NVIDIA NIMs
NVIDIA NIMs
NVIDIA TensorRT-LLM
NVIDIA LLM Text Completion API
NVIDIA Triton
Oracle Cloud Infrastructure Data Science
Oracle Cloud Infrastructure Generative AI
OctoAI
Ollama LLM
Ollama - Gemma
OpenAI
OpenAI JSON Mode vs. Function Calling for Data Extraction
OpenAI Responses API
OpenRouter
OpenVINO LLMs
OpenVINO GenAI LLMs
Optimum Intel LLMs optimized with IPEX backend
Using Opus 4.1 with LlamaIndex
AlibabaCloud-PaiEas
PaLM
Perplexity
[Pipeshift](https://pipeshift.com)
Portkey
Predibase
PremAI LlamaIndex
Client of Baidu Intelligent Cloud's Qianfan LLM Platform
RunGPT
Interacting with LLM deployed in Amazon SageMaker Endpoint with LlamaIndex
SambaNova Systems
Together AI LLM
Upstage
Vercel AI Gateway
Vertex AI
Replicate - Vicuna 13B
vLLM
Xorbits Inference
Yi LLMs
Retrievers
Auto Merging Retriever
Comparing Methods for Structured Retrieval (Auto-Retrieval vs. Recursive Retrieval)
Bedrock (Knowledge Bases)
BM25 Retriever
Composable Objects
Activeloop Deep Memory
Ensemble Retrieval Guide
Chunk + Document Hybrid Retrieval with Long-Context Embeddings (Together.ai)
Pathway Retriever
Reciprocal Rerank Fusion Retriever
Recursive Retriever + Node References + Braintrust
Recursive Retriever + Node References
Relative Score Fusion and Distribution-Based Score Fusion
Router Retriever
Simple Fusion Retriever
Auto-Retrieval from a Vectara Index
Vertex AI Search Retriever
connect to VideoDB
You.com Retriever
Vector stores
Alibaba Cloud MySQL
Alibaba Cloud OpenSearch Vector Store
Google AlloyDB for PostgreSQL - `AlloyDBVectorStore`
Amazon Neptune - Neptune Analytics vector store
AnalyticDB
ApertureDB as a Vector Store with LlamaIndex.
Astra DB
Simple Vector Store - Async Index Creation
Awadb Vector Store
Test delete
Azure AI Search
Azure CosmosDB MongoDB Vector Store
Azure Cosmos DB No SQL Vector Store
Azure Postgres Vector Store
Bagel Vector Store
Bagel Network
Baidu VectorDB
Cassandra Vector Store
Auto-Retrieval from a Vector Database
Chroma Vector Store
Chroma + Fireworks + Nomic with Matryoshka embedding
Chroma
ClickHouse Vector Store
Google Cloud SQL for PostgreSQL - `PostgresVectorStore`
Couchbase Vector Store
DashVector Vector Store
Databricks Vector Search
IBM Db2 Vector Store and Vector Search
Deep Lake Vector Store Quickstart
DocArray Hnsw Vector Store
DocArray InMemory Vector Store
Dragonfly and Vector Store
DuckDB
Auto-Retrieval from a Vector Database
Elasticsearch
Elasticsearch Vector Store
Epsilla Vector Store
Existing data
Guide: Using Vector Store Index with Existing Pinecone Vector Store
Guide: Using Vector Store Index with Existing Weaviate Vector Store
Faiss Vector Store
Firestore Vector Store
Gel Vector Store
Hnswlib
Hologres
Jaguar Vector Store
Advanced RAG with temporal filters using LlamaIndex and KDB.AI vector store
LanceDB Vector Store
Lantern Vector Store (auto-retriever)
Lantern Vector Store
Lindorm
Milvus Vector Store with Async API
Milvus Vector Store with Full-Text Search
Milvus Vector Store With Hybrid Search
Milvus Vector Store
Milvus Vector Store - Metadata Filter
MongoDB Atlas Vector Store
MongoDB Atlas + Fireworks AI RAG Example
MongoDB Atlas + OpenAI RAG Example
Moorcheh Vector Store Demo
MyScale Vector Store
Neo4j Vector Store - Metadata Filter
Neo4j vector store
Nile Vector Store (Multi-tenant PostgreSQL)
ObjectBox VectorStore Demo
OceanBase Vector Store
Opensearch Vector Store
Oracle AI Vector Search: Vector Store
pgvecto.rs
A Simple to Advanced Guide with Auto-Retrieval (with Pinecone + Arize Phoenix)
Pinecone Vector Store - Metadata Filter
Pinecone Vector Store
Pinecone Vector Store - Hybrid Search
Postgres Vector Store
Hybrid Search with Qdrant BM42
Qdrant Hybrid Search
Hybrid RAG with Qdrant: multi-tenancy, custom sharding, distributed setup
Qdrant Vector Store - Metadata Filter
Qdrant Vector Store - Default Qdrant Filters
Qdrant Vector Store
Redis Vector Store
Relyt
Rockset Vector Store
S3VectorStore Integration
Simple Vector Store
Local Llama2 + VectorStoreIndex
Llama2 + VectorStoreIndex
Simple Vector Stores - Maximum Marginal Relevance Retrieval
S3/R2 Storage
Supabase Vector Store
TablestoreVectorStore
Tair Vector Store
Tencent Cloud VectorDB
TiDB Vector Store
Timescale Vector Store (PostgreSQL)
txtai Vector Store
Typesense Vector Store
Upstash Vector Store
load documents
1. Installation
Google Vertex AI Vector Search
Google Vertex AI Vector Search v2.0
Vespa Vector Store demo
Auto-Retrieval from a Weaviate Vector Database
Weaviate Vector Store Metadata Filter
Weaviate Vector Store
Weaviate Vector Store - Hybrid Search
**WordLift** Vector Store
Zep Vector Store
ChangeLog
Framework Reference 🔗
Install MCP Server
MCP Docs
Copy MCP URL
Install in Cursor
Copy Claude Code command
Copy Codex config
LlamaIndex Framework
Component Guides
Models
Models
Copy Markdown
Open in
Claude
Open in
ChatGPT
Open in
Cursor
Copy Markdown
View as Markdown
Models
There are a few primary ways you interact with models in LlamaIndex:
LLMs
Embeddings
Experimental
MultiModal
