evals-skills vs teaql-agent-kit
teaql-agent-kit is much bigger: 2.8k stars against 548.
They split the axes: evals-skills leads on customization and privacy and setup ease, teaql-agent-kit on context depth.
Stars and commit dates come from our own daily tracking. The six axes are read off each project's documentation by our review pipeline, so they describe what a project says about itself, not what we measured in its code.
Where they stand today
Provides modular, reusable agent 'skills' (not just benchmarks), including an error-discovery skill that builds a dependency-free single-file review app for guided failure-mode analysis.
- Stars
- 548
- Tracked growth
- not tracked long enough
- Maturity
- ●●●●●
- Last commit
- 6d ago
- Language
- mixed
- License
- none declared
- Cost to run
- Free, local
Provides a TEAQL-focused, auditable evaluation harness that measures software-engineering discipline and token-efficiency for coding agents rather than offering general-purpose agent automation.
- Stars
- 2.8k
- Tracked growth
- +1.1%
- Maturity
- ●●●●●
- Last commit
- 21h ago
- Language
- Python
- License
- MIT
- Cost to run
- Your API key or model costs may apply
Six axes, head to head
Each axis runs 0 to 5. The label under a score is what that project's own docs claim, not a category average.
| Axis | evals-skills | teaql-agent-kit |
|---|---|---|
Context depth How much of your codebase it sees before it answers: the open diff, the diff plus related files, or the whole repository. | ●●●●● Single-file analysis | ●●●●● Diff + related files |
Noise control How it keeps output volume down — severity thresholds, deduplication, incremental runs over new commits only. | ●●●●● Severity prioritization | ●●●●● Guides & checkpoints |
Customization How far it bends to your team: custom rules, prompts, style guides, per-path config. | ●●●●● Custom skills/plugins | ●●●●● Config & prompts |
Privacy Whether your code stays on your own infrastructure: fully local, self-hostable, or cloud API only. | ●●●●● Fully local | ●●●●● Cloud via API key |
Model freedom Whether you can point it at any provider, or it is wired to one. | ●●●●● Fixed provider | ●●●●● Single fixed provider |
Setup ease What it takes to get a first useful run out of it. | ●●●●● One-command install | ●●●●● Manual setup |
Which one to pick
Pick evals-skills if…
Easy setup — one-command install via npx and a local, dependency-free review app for interactive error discovery and building product-specific evals.
- Customization: Custom skills/plugins (5/5 against 3/5)
- Privacy: Fully local (5/5 against 3/5)
- Setup ease: One-command install (5/5 against 2/5)
Pick teaql-agent-kit if…
Evaluation-first — pick this when you need reproducible, auditable benchmarks of coding agents working with TEAQL contracts, explicit guardrails, and token-efficiency measurement.
- Context depth: Diff + related files (3/5 against 1/5)
What people want from each one
Questions people ask
Is evals-skills better than teaql-agent-kit?
They split the axes: evals-skills leads on customization and privacy and setup ease, teaql-agent-kit on context depth. evals-skills is worth picking when easy setup — one-command install via npx and a local, dependency-free review app for interactive error discovery and building product-specific evals.
Which of evals-skills and teaql-agent-kit keeps my code private?
evals-skills: Fully local (5/5). teaql-agent-kit: Cloud via API key (3/5).
What does each one cost to run?
evals-skills: Free, local. teaql-agent-kit: Your API key or model costs may apply.
Full profiles: ai-evals-course/evals-skills and teaql/teaql-agent-kit. Everything else in Evals & benchmarks.