Tracing
What's Supported?
A list of the models, vector DBs and frameworks that OpenLLMetry supports out of the box.
If your favorite system is not on the list, please open an issue for us in the respective Github repo and we’ll take care of it. In the meantime, you can still use OpenLLMetry to report the LLM and vector DB calls manually.
LLM Foundation Models
Model SDK | Python | Typescript |
---|---|---|
Azure OpenAI | ✅ | ✅ |
Aleph Alpha | ✅ | ❌ |
Anthropic | ✅ | ✅ |
Amazon Bedrock | ✅ | ✅ |
Amazon SageMaker | ✅ | ❌ |
Cohere | ✅ | ✅ |
IBM watsonx | ✅ | ⏳ |
Google Gemini | ✅ | ✅ |
Google VertexAI | ✅ | ✅ |
Mistral AI | ✅ | ⏳ |
Ollama | ✅ | ⏳ |
OpenAI | ✅ | ✅ |
Replicate | ✅ | ⏳ |
together.ai | ✅ | ⏳ |
HuggingFace Transformers | ✅ | ⏳ |
Vector DBs
Vector DB | Python | Typescript |
---|---|---|
Chroma DB | ✅ | ✅ |
Marqo | ✅ | ❌ |
Milvus | ✅ | ⏳ |
Pinecone | ✅ | ✅ |
Qdrant | ✅ | ✅ |
Weaviate | ✅ | ⏳ |
Frameworks
Framework | Python | Typescript |
---|---|---|
Haystack by deepset | ✅ | ❌ |
Langchain | ✅ | ✅ |
LlamaIndex | ✅ | ✅ |
Burr | ✅ | ❌ |
Was this page helpful?