LLM Observability with Oracle Cloud Infrastructure Application Performance Monitoring(APM) service
Oracle Cloud Infrastructure Application Performance Monitoring(APM) service natively supports and can ingest OpenTelemetry (OTLP) spans and metrics. Traceloop’s OpenLLMetry library enables instrumenting LLM frameworks and applications in Open Telemetry format and can be routed to OCI Application Performance Monitoring for observability and evaluation of LLM applications.
If you are using an OpenTelemetry Collector, you can route metrics and traces to OCI APM by simply adding an OTLP exporter to your collector configuration.