Tracing
What's Supported?
A list of the models, vector DBs and frameworks that OpenLLMetry supports out of the box.
If your favorite system is not on the list, please open an issue for us in the respective Github repo and we’ll take care of it.
In the meantime, you can still use OpenLLMetry to report the LLM and vector DB calls manually.
LLM Foundation Models
| Model SDK | Python | Typescript |
|---|---|---|
| Azure OpenAI | ✅ | ✅ |
| Aleph Alpha | ✅ | ❌ |
| Anthropic | ✅ | ✅ |
| Amazon Bedrock | ✅ | ✅ |
| Amazon SageMaker | ✅ | ❌ |
| Cohere | ✅ | ✅ |
| IBM watsonx | ✅ | ⏳ |
| Google Gemini | ✅ | ✅ |
| Google VertexAI | ✅ | ✅ |
| Groq | ✅ | ⏳ |
| Mistral AI | ✅ | ⏳ |
| Ollama | ✅ | ⏳ |
| OpenAI | ✅ | ✅ |
| Replicate | ✅ | ⏳ |
| together.ai | ✅ | ⏳ |
| HuggingFace Transformers | ✅ | ⏳ |
Vector DBs
| Vector DB | Python | Typescript |
|---|---|---|
| Chroma DB | ✅ | ✅ |
| Elasticsearch | ✅ | ✅ |
| LanceDB | ✅ | ⏳ |
| Marqo | ✅ | ❌ |
| Milvus | ✅ | ⏳ |
| pgvector | ✅ | ✅ |
| Pinecone | ✅ | ✅ |
| Qdrant | ✅ | ✅ |
| Weaviate | ✅ | ⏳ |
Frameworks
| Framework | Python | Typescript |
|---|---|---|
| Burr | ✅ | ❌ |
| CrewAI | ✅ | ❌ |
| Haystack by deepset | ✅ | ❌ |
| Langchain | ✅ | ✅ |
| LlamaIndex | ✅ | ✅ |