Observability for Anthropic with Dynatrace

Step 1

Install the Traceloop SDK and initialize it. It will automatically log all calls to Anthropic, with prompts and completions as separate spans.

import boto3
import json

from traceloop.sdk import Traceloop
from traceloop.sdk.decorators import task, workflow

Traceloop.init(app_name="joke_generation_service")
client = Anthropic()

import * as traceloop from "@traceloop/node-server-sdk";
import Anthropic from "@anthropic-ai/sdk";

traceloop.initialize({
  appName: "sample_anthropic",
  apiKey: process.env.TRACELOOP_API_KEY,
  disableBatch: true,
});
const anthropic = new Anthropic({});

async function main() {
  const completion = await anthropic.messages.create({
    max_tokens: 1024,
    model: "claude-3-opus-20240229",
    messages: [
      {
        role: "user",
        content: "How does a court case get to the Supreme Court?",
      },
    ],
  });
  console.log(completion.content);
}

main();

Step 2

Go to your Dynatrace environment and create a new access token under Manage Access Tokens. The access token needs the following permission scopes that allow the ingest of OpenTelemetry spans, metrics and logs (openTelemetryTrace.ingest, metrics.ingest, logs.ingest). Set the following environment variables.

TRACELOOP_BASE_URL=https://<YOUR_ENV>.live.dynatrace.com\api\v2\otlp
TRACELOOP_HEADERS=Authorization=Api-Token%20<YOUR_ACCESS_TOKEN>

Docs

Observability for Anthropic with Dynatrace

Step 1

Step 2

Discover use cases

Trace prompts and completions in Anthropic

More things you can connect to {platform}

Watsonx

LlamaIndex

Ollama

Bedrock

Gemini

Mistral AI

OpenAI

together.ai

Cohere

LangChain

Chroma