Harness Toolbox/Evals & benchmarks/aisa-group/PostTrainBench

aisa-group/PostTrainBench

Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hours

View on GitHub →
PythonMITai-safetyclaude-codecodex-cligemini-clipost-training
Stars
455
Δ 7d
+24
Δ 30d
+90
Age
7 mo
Last push
20h ago
474416359301243Apr 19Jun 3Jul 17
90-day star history

Alternatives in Evals & benchmarks

非线智能 NoneLinear - ReLE评测:中文AI大模型能力评测(持续更新):目前已囊括374个大模型,覆盖chatgpt、gpt-5.4、谷歌gemini-3.1-pro、Claude-4.6、文心ERNIE-…

6.3k
+327d
3 yrs

A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

3.6k
+257d
Python
2 yrs

Deterministic execution for non-deterministic AI.

2.8k
Python
7 yrs

Measuring frontier coding agents on original, long-horizon engineering tasks

1.2k
+837d
Python
2 mo

GateMem: a benchmark and evaluation toolkit for memory governance in multi-principal shared-memory LLM agents.

191
+277d
Python
1 mo

Pier is a Harbor fork built for DeepSWE, with stronger support for CLI agents in air-gapped (no-internet) task…

116
+137d
Python
2 mo