Toolbox/Evals & benchmarks/datacurve-ai/pier

datacurve-ai/pier

Pier is a Harbor fork built for DeepSWE, with stronger support for CLI agents in air-gapped (no-internet) tasks and more faithful, consistent agent trajectories

View on GitHub →
PythonApache-2.0
Stars
209
Δ 7d
+3
Δ 30d
+16
Age
5 mo
Last push
21d ago
218192167141116Jul 23Aug 30Oct 20
90-day star history

Where this sits in the catalog

Alternatives in Evals & benchmarks

非线智能 NoneLinear - ReLE评测:中文AI大模型能力评测(持续更新):目前已囊括374个大模型,覆盖chatgpt、gpt-5.4、谷歌gemini-3.1-pro、Claude-4.6、文心ERNIE-…

⭐6.5k
+157d
3 yrs

A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

⭐3.8k
+147d
Python
3 yrs

A model-driven harness for AI coding agents: semantic modeling, app generation, progressive API Assist and evi…

⭐2.8k
+27d
Python
7 yrs

An open-source Harness Engineering platform for coding agents—define harnesses as code, run controlled experim…

⭐2.4k
+187d
JavaScript
3 mo

Measuring frontier coding agents on original, long-horizon engineering tasks

⭐1.8k
+287d
Python
5 mo

Skills that guide AI coding agents to help you build product-specific AI evals.

⭐1.5k
+387d
3 mo