Observability for Ollama with Highlight

OpenLLMetry lets you trace any model running locally or remotely on Ollama. With 5 minutes of work you can get complete view of your system directly into Honeycomb. See how below.

Step 1

Install the Traceloop SDK and initialize it. It will automatically log all calls to Ollama, whether you're running a model locally or remotely, with prompts and completions as separate spans.

Step 2

Route traces to Highlights’s OTLP endpoint and set the Highlight project ID in the headers.

Discover use cases

No items found.