Toolbox/Evals & benchmarks/datacurve-ai/pier

datacurve-ai/pier

Pier is a Harbor fork built for DeepSWE, with stronger support for CLI agents in air-gapped (no-internet) tasks and more faithful, consistent agent trajectories

View on GitHub →
PythonApache-2.0
Stars
181
Δ 7d
+10
Δ 30d
+44
Age
4 mo
Last push
7d ago
1921591259158Jun 8Jul 24Sep 4
90-day star history

Where this sits in the catalog

Alternatives in Evals & benchmarks

非线智能 NoneLinear - ReLE评测:中文AI大模型能力评测(持续更新):目前已囊括374个大模型,覆盖chatgpt、gpt-5.4、谷歌gemini-3.1-pro、Claude-4.6、文心ERNIE-…

6.4k
+117d
3 yrs

A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

3.7k
+107d
Python
3 yrs

A model-mediated harness for reliable agentic software development.

2.8k
+37d
Python
7 yrs

An open-source Harness Engineering platform for coding agents—define harnesses as code, run controlled experim…

2.2k
+1247d
JavaScript
1 mo

Measuring frontier coding agents on original, long-horizon engineering tasks

1.6k
+817d
Python
3 mo

Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 1…

546
+97d
Python
9 mo