OpenLLMetry

Dashboard API

Community

GitHub

traceloop

Start now

Website

Chat with our chatbot below and view traces and monitoring directly in Traceloop.

Demo

Monitor, debug and test the quality of your LLM outputs

Introduction

What is OpenLLMetry?

Install OpenLLMetry for Python by following these 3 easy steps and get instant monitoring.

Python

Install OpenLLMetry for Node.js by following these 3 easy steps and get instant monitoring. 

Node.js

Install OpenLLMetry for Next.js by following these 3 easy steps and get instant monitoring.

Next.js

Install OpenLLMetry for Go by following these 3 easy steps and get instant monitoring.

Install OpenLLMetry for Ruby by following these 3 easy steps and get instant monitoring.

Ruby

Documentation of the initialization options for the SDKs.

SDK Initialization Options

Not seeing anything? Here are some things to check.

Troubleshooting

A list of the models, vector DBs and frameworks that OpenLLMetry supports out of the box.

What's Supported?

Enrich your traces by annotating chains and workflows in your app

Workflow Annotations

Learn how to enrich your traces by versioning your workflows and prompts

Versioning

How to associate traces with entities in your own application

Associating Entities with Traces

Tracking User Feedback

What should I do if my favorite vector DB or LLM is not supported by OpenLLMetry?

Manually reporting calls to LLMs and Vector DBs

How to overcome issues with automatic instrumentations on Next.js and some Webpack environments.

Issues with Auto-instrumentation (Typescript / Javascript)

How to use OpenLLMetry with `ThreadPoolExecutor` and other thread-based libraries.

Usage with Threads (Python)

Without OpenLLMetry SDK

Connect to any observability platform - Traceloop, Dynatrace, Datadog, Honeycomb, and others

Overview

Traceloop

LLM Observability with Traceloop

Axiom

LLM Observability with Axiom and OpenLLMetry

Azure Application Insights

Datadog

LLM Observability with Datadog and OpenLLMetry

Dynatrace

LLM Observability with Dynatrace and OpenLLMetry

Grafana

LLM Observability with Grafana and OpenLLMetry

Highlight

LLM Observability with Highlight and OpenLLMetry

Honeycomb

LLM Observability with Honeycomb and OpenLLMetry

HyperDX

LLM Observability with HyperDX and OpenLLMetry

Instana

LLM Observability with Instana and OpenLLMetry

KloudMate

LLM Observability with KloudMate and OpenLLMetry

New Relic

LLM observability with New Relic and OpenLLMetry

OpenTelemetry Collector

LLM observability with OpenTelemetry Collector

Service Now Cloud Observability

LLM Observability with Service Now Cloud Observability and OpenLLMetry

SigNoz

LLM Observability with SigNoz and OpenLLMetry

Sentry

LLM Observability with Sentry and OpenLLMetry

Splunk

LLM Observability with Splunk and OpenLLMetry

Prompts, Completions and Embeddings

Telemetry

Detect hallucinations and regressions in the quality of your LLMs

Quick Start

Manage your prompts on the Traceloop platform

Prompt Registry

Use your managed prompts with the Traceloop SDKs

Fetching Prompts

Connect Traceloop to Posthog to combine LLM insights with your product analytics

Learn

Monitoring

Prompt Management

Integrations

Demo