Observability for Anthropic with Instana

Step 1

Install the Traceloop SDK and initialize it. It will automatically log all calls to Anthropic, with prompts and completions as separate spans.

import boto3
import json

from traceloop.sdk import Traceloop
from traceloop.sdk.decorators import task, workflow

Traceloop.init(app_name="joke_generation_service")
client = Anthropic()

import * as traceloop from "@traceloop/node-server-sdk";
import Anthropic from "@anthropic-ai/sdk";

traceloop.initialize({
  appName: "sample_anthropic",
  apiKey: process.env.TRACELOOP_API_KEY,
  disableBatch: true,
});
const anthropic = new Anthropic({});

async function main() {
  const completion = await anthropic.messages.create({
    max_tokens: 1024,
    model: "claude-3-opus-20240229",
    messages: [
      {
        role: "user",
        content: "How does a court case get to the Supreme Court?",
      },
    ],
  });
  console.log(completion.content);
}

main();

Step 2

Configure your Instana agent to receive traces and metrics from OpenLLMetry

# In your Instana OS agent configuration file
com.instana.plugin.opentelemetry:
  enabled: true
  grpc:
    enabled: true
        
# In the environment of your application
TRACELOOP_BASE_URL=instana-agent-hostname:4317

Docs

Observability for Anthropic with Instana

Step 1

Step 2

Discover use cases

Trace prompts and completions in Anthropic

More things you can connect to {platform}

OpenAI

Gemini

Mistral AI

Bedrock

Ollama

LlamaIndex

together.ai

Cohere

LangChain

Watsonx

Chroma