
OpenLLMetry
github.com/traceloop/openllmetry- Category
- Developer Tools
- Rank
- No. 376Tools index
- Pricing
- Open Source
- Type
- TOOL
- Builder
- traceloop
- GitHub
- 7.4k stars
- Latest release
- 0.62.3
- Added
- Jul 4, 2026
About
OpenLLMetry by Traceloop is a set of open-source OpenTelemetry extensions that add tracing and observability to LLM apps and agents, exporting to any OTel-compatible backend.
What it does
A Python toolkit that watches model, framework, vector database, and ordinary application activity. Teams can start through a single SDK setup or add selected instrumentations to an existing telemetry setup. It records traces, metrics, and optional logs, then sends them through configured exporters.
Why it's ranked here
OpenLLMetry is a strong choice for Python teams already invested in observability standards. Its unusually broad provider, framework, vector database, and destination coverage reduces integration work. Direct instrumentation packages also let experienced teams avoid adopting the higher-level SDK.
What's good
The SDK supports custom exporters, span processors, propagation, sampling, resource attributes, and post-processing callbacks. Teams can independently control tracing, content capture, metrics, and logging. The documented destination list includes major commercial platforms, cloud services, and the OpenTelemetry Collector.
Tradeoffs
Content tracing defaults to enabled, so teams handling sensitive prompts should change configuration deliberately. The telemetry documentation is internally inconsistent: it says collection has stopped, then explains collected anonymous exception data. JavaScript and TypeScript support lives in a separate repository, adding operational separation for mixed-language systems.
How to use it well
Use it in Python LLM services where model calls must join existing application traces and observability pipelines. Start with the SDK for quick coverage, then select individual instrumentations when tighter control matters. Configure content capture and exporters explicitly. It does not replace the backend used to store, query, and inspect telemetry.
Technical notes+
packages/traceloop-sdk/traceloop/sdk/__init__.py exposes Traceloop.init, wiring tracing plus conditional metrics and logging, with custom SpanExporter, SpanProcessor, sampler, propagator, resource attributes, instrument allowlists, and blocklists. packages/traceloop-sdk/traceloop/sdk/config/__init__.py defaults tracing, content tracing, and metrics on, while logging defaults off. packages/opentelemetry-semantic-conventions-ai/opentelemetry/semconv_ai/__init__.py defines vendor enums, metric names, project attributes, upstream-aligned GenAI attributes, and extensive legacy aliases. package.json declares a private Nx workspace over packages/*; its MIT license field conflicts with README.md, which states Apache 2.0.
Observed
- License
- README.md states Apache 2.0; root package metadata declares MIT.
- Primary language
- Python
- Installation
- Published SDK installed with pip as traceloop-sdk.
- Interface
- Python SDK plus directly usable instrumentation packages.
- Workspace structure
- Private Nx workspace containing packages under packages/*.
- Language scope
- JavaScript and TypeScript support is maintained in a separate repository.
- Protocol coverage
- The documented instrumentation coverage includes MCP.
Read from README.md, package.json, packages/sample-app/sample_app/__init__.py, packages/traceloop-sdk/traceloop/sdk/__init__.py, packages/opentelemetry-semantic-conventions-ai/opentelemetry/semconv_ai/__init__.py, packages/traceloop-sdk/traceloop/sdk/utils/__init__.py, packages/traceloop-sdk/traceloop/sdk/client/__init__.py, packages/traceloop-sdk/traceloop/sdk/config/__init__.py, packages/traceloop-sdk/traceloop/sdk/prompts/__init__.py, packages/traceloop-sdk/traceloop/sdk/tracing/__init__.py, packages/traceloop-sdk/traceloop/sdk/datasets/__init__.py, packages/traceloop-sdk/traceloop/sdk/evaluator/__init__.py, packages/traceloop-sdk/traceloop/sdk/generated/__init__.py.
Tags
Tech Stack
Comments (0)
No comments yet
Indexed by a proprietary survey. Corrections welcome.