Toolbox/Evals & benchmarks/ai-evals-course/evals-skills

ai-evals-course/evals-skills

Skills that guide AI coding agents to help you build product-specific AI evals.

View on GitHub →
Apache-2.0
Stars
1.5k
Δ 7d
+38
Δ 30d
+906
Age
3 mo
Last push
25d ago
1.6k1.3k996672349Aug 26Sep 22Oct 20
90-day star history

Where this sits in the catalog

Head to head with its peers

The same six axes and the same star history, two projects at a time.

Alternatives in Evals & benchmarks

非线智能 NoneLinear - ReLE评测:中文AI大模型能力评测(持续更新):目前已囊括374个大模型,覆盖chatgpt、gpt-5.4、谷歌gemini-3.1-pro、Claude-4.6、文心ERNIE-…

⭐6.5k
+157d
3 yrs

A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

⭐3.8k
+147d
Python
3 yrs

A model-driven harness for AI coding agents: semantic modeling, app generation, progressive API Assist and evi…

⭐2.8k
+27d
Python
7 yrs

An open-source Harness Engineering platform for coding agents—define harnesses as code, run controlled experim…

⭐2.4k
+187d
JavaScript
3 mo

Measuring frontier coding agents on original, long-horizon engineering tasks

⭐1.8k
+287d
Python
5 mo

Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 1…

⭐600
+107d
Python
10 mo