Harness Toolbox/Evals & benchmarks/jeinlee1991/chinese-llm-benchmark

jeinlee1991/chinese-llm-benchmark

非线智能 NoneLinear - ReLE评测:中文AI大模型能力评测(持续更新):目前已囊括374个大模型,覆盖chatgpt、gpt-5.4、谷歌gemini-3.1-pro、Claude-4.6、文心ERNIE-X1.1、ERNIE-5.0、qwen3.6-max、qwen3.6-plus、百川、讯飞星火、商汤senseChat等商用模型, 以及step3.5-flash、kimi-k2.6、ernie4.5、MiniMax-M2.7、deepseek-v4、Qwen3.6、llama4、智谱GLM-5.1、MiMo-V2、LongCat、gemma4、mistral等开源大模型。不仅提供排行榜,也提供规模超200万的大模型缺陷库!方便广大社区研究分析、改进大模型。

View on GitHub →
agentic-aiartificial-intelligencellm-agentllm-evaluation
Stars
6.3k
Δ 7d
+32
Δ 30d
+139
Age
3 yrs
Last push
4d ago
6.3k6.2k6.1k5.9k5.8kApr 19Jun 2Jul 17
90-day star history

Most-wanted open issues

Ranked by 👍 reactions. 14 open issues total, checked 2026-07-17.

Alternatives in Evals & benchmarks

A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

3.6k
+257d
Python
2 yrs

Deterministic execution for non-deterministic AI.

2.8k
Python
7 yrs

Measuring frontier coding agents on original, long-horizon engineering tasks

1.2k
+837d
Python
2 mo

Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 1…

455
+247d
Python
7 mo

GateMem: a benchmark and evaluation toolkit for memory governance in multi-principal shared-memory LLM agents.

191
+277d
Python
1 mo

Pier is a Harbor fork built for DeepSWE, with stronger support for CLI agents in air-gapped (no-internet) task…

116
+137d
Python
2 mo