Toolbox/Agent SDKs & frameworks/Maximilian-Winter/llama-cpp-agent

Maximilian-Winter/llama-cpp-agent

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.

View on GitHub →
PythonNOASSERTIONagentsllamacppllmllmsfunction-calling
Stars
659
Δ 7d
0
Δ 30d
0
Age
2 yrs
Last push
225d ago
661658656653650Jul 24Aug 31Oct 20
90-day star history

Where this sits in the catalog

GroupFrameworks & SDKs
CategoryAgent SDKs & frameworks#80 of 97 by stars
RankingsNot in any top 20 today — see the rankings
NearbyMulti-agent orchestration (152)Workflow & graph engines (15)Low-code builders (21)Runtimes & sandboxes (18)

Most-wanted open issues

Ranked by 👍 reactions. 22 open issues total, checked 2026-10-13.

Issue👍CommentsOpened
Stop LLM output on user request?
1112 yrs
Request for image input support
122 yrs
[enhancement] Support for `Literal`
022 yrs
Slow processing of follow-up prompt
032 yrs
Very poor performance writing code, possibly due to structure?
002 yrs

Alternatives in Agent SDKs & frameworks

deepseek-ai/deepseek-harness

DeepSeek Harness: Everything is a Plugin.

⭐255.2k
+6,4947d
TypeScript
2 mo
langchain-ai/langchain

The agent engineering platform.

⭐148.1k
+3777d
Python
4 yrs
Leonxlnx/taste-skill

Agent skills that give coding agents taste: art direction, reference images and a browser check instead of gen…

⭐99.6k
JavaScript
8 mo
heygen-com/hyperframes

Write HTML. Render video. Built for agents.

⭐68.0k
TypeScript
7 mo
zhayujie/CowAgent

Open-source personal AI assistant & Agent Harness. Plans tasks, runs tools and skills, self-evolves with memor…

⭐47.5k
+1007d
Python
4 yrs
agno-agi/agno

Build, run, and manage agent platforms.

⭐42.8k
+1317d
Python
4 yrs