Observability for Cohere with Traceloop

Step 1

Install the Traceloop SDK and initialize it. It will automatically log all calls to Cohere, with prompts and completions as separate spans.

import boto3
import json

from traceloop.sdk import Traceloop
from traceloop.sdk.decorators import task, workflow

Traceloop.init(app_name="joke_generation_service")
co = cohere.Client(os.environ.get("COHERE_API_KEY"))

import * as traceloop from "@traceloop/node-server-sdk";
import { CohereClient } from "cohere-ai";

traceloop.initialize({
  appName: "sample_cohere",
  apiKey: process.env.TRACELOOP_API_KEY,
  disableBatch: true,
});

const cohere = new CohereClient({
  token: process.env.COHERE_API_KEY ?? "",
});

const sampleGenerate = async () => {
  return await traceloop.withWorkflow({ name: "sample_generate" }, async () => {
    const response = await cohere.generate({
      model: "command-light",
      prompt: "What happened to Pluto?",
      k: 1,
      temperature: 2,
    });

    return response.generations?.[0].text;
  });
};

traceloop.withAssociationProperties({}, async () => {
  console.log(await sampleGenerate());
});

Step 2

On Traceloop, API keys can be generated from the Traceloop Dashboard, for each of the three supported environments (Development, Staging, Production).

TRACELOOP_API_KEY=<Your API Key>

Docs

Observability for Cohere with Traceloop

Step 1

Step 2

Discover use cases

Trace prompts and completions in Cohere

More things you can connect to {platform}

Gemini

Ollama

LangChain

Chroma

Mistral AI

together.ai

Anthropic

Bedrock

OpenAI

Watsonx

LlamaIndex