Evals & benchmarks

非线智能 NoneLinear - ReLE评测：中文AI大模型能力评测（持续更新）：目前已囊括374个大模型，覆盖chatgpt、gpt-5.4、谷歌gemini-3.1-pro、Claude-4.6、文心ERNIE-…

A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

Deterministic execution for non-deterministic AI.

Measuring frontier coding agents on original, long-horizon engineering tasks

Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 1…

GateMem: a benchmark and evaluation toolkit for memory governance in multi-principal shared-memory LLM agents.

Pier is a Harbor fork built for DeepSWE, with stronger support for CLI agents in air-gapped (no-internet) task…

The benchmark tasks and evaluation harness for "PhysicianBench: Evaluating LLM Agents in Real-World EHR Enviro…

CoDA-Bench is a benchmark for code agents on data-intensive tasks. 🎈代码智能体能搞定数据密集型任务吗?