Toolbox/Observability & tracing/Jwuthri/Tracely-ai

Jwuthri/Tracely-ai

Trace-native CI/CD for AI agents — production failures become regression tests that block the PR. Auto-detect, cluster, freeze into hermetic cases, replay in CI for $0.

View on GitHub →
PythonMITai-agentsci-cdevalsllm-evaluationllm-observability
Stars
1.2k
Δ 7d
-1
Δ 30d
Age
3 mo
Last push
7h ago
1.2k1.2k1.1k1.0k984Aug 23Aug 29Sep 4
90-day star history

Where this sits in the catalog

Most-wanted open issues

Ranked by 👍 reactions. 8 open issues total, checked 2026-08-30.

Alternatives in Observability & tracing

Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm…

16.2k
+117d
Python
2 yrs

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and a…

5.8k
+67d
Python
3 yrs

Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, E…

2.7k
+197d
TypeScript
2 yrs

Trace-native CI/CD for AI agents — production failures become regression tests that block the PR. Auto-detect,…

1.2k
-17d
Python
3 mo

Version control for AI agents — track what your agent did, blame any line to a prompt, inspect any step.

789
+37d
Go
4 mo

An infinite canvas for your AI coding agents. Every repo is a region on one zoomable live map - watch Claude C…

639
HTML
2 wk