If your favorite system is not on the list, please open an issue for us in the respective Github repo and we’ll take care of it. In the meantime, you can still use OpenLLMetry to report the LLM and vector DB calls manually.

LLM Foundation Models

Model SDKPythonTypescript
Azure OpenAI
Aleph Alpha
Anthropic
Amazon Bedrock
Amazon SageMaker
Cohere
IBM watsonx
Google Gemini
Google VertexAI
Mistral AI
Ollama
OpenAI
Replicate
together.ai
HuggingFace Transformers

Vector DBs

Vector DBPythonTypescript
Chroma DB
Marqo
Milvus
Pinecone
Qdrant
Weaviate

Frameworks

FrameworkPythonTypescript
Haystack by deepset
Langchain
LlamaIndex
Burr