Toolbox/Observability & tracing/AgentOps-AI/agentops

AgentOps-AI/agentops

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

View on GitHub →
PythonMITagentagentopsaievalsevaluation-metrics
Stars
5.8k
Δ 7d
+6
Δ 30d
+57
Age
3 yrs
Last push
71d ago
5.8k5.8k5.7k5.6k5.6kJun 7Jul 23Sep 4
90-day star history

Where this sits in the catalog

Most-wanted open issues

Ranked by 👍 reactions. 108 open issues total, checked 2026-08-29.

Alternatives in Observability & tracing

Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm…

16.2k
+117d
Python
2 yrs

Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, E…

2.7k
+197d
TypeScript
2 yrs

Trace-native CI/CD for AI agents — production failures become regression tests that block the PR. Auto-detect,…

1.2k
-17d
Python
3 mo

Trace-native CI/CD for AI agents — production failures become regression tests that block the PR. Auto-detect,…

1.2k
-17d
Python
3 mo

Version control for AI agents — track what your agent did, blame any line to a prompt, inspect any step.

789
+37d
Go
4 mo

An infinite canvas for your AI coding agents. Every repo is a region on one zoomable live map - watch Claude C…

639
HTML
2 wk