Toolbox/Agent SDKs & frameworks/Maximilian-Winter/llama-cpp-agent

Maximilian-Winter/llama-cpp-agent

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.

View on GitHub →
PythonNOASSERTIONagentsllamacppllmllmsfunction-calling
Stars
660
Δ 7d
+1
Δ 30d
+8
Age
2 yrs
Last push
179d ago
662656651645639Jun 9Aug 3Sep 1
90-day star history

Where this sits in the catalog

Most-wanted open issues

Ranked by 👍 reactions. 22 open issues total, checked 2026-08-31.

Alternatives in Agent SDKs & frameworks

DeepSeek Harness: Everything is a Plugin.

211.8k
+10,4097d
TypeScript
3 wk

The agent engineering platform.

145.6k
+4467d
Python
3 yrs

Open-source super AI assistant & Agent Harness. Plans tasks, runs tools and skills, self-evolves with memory a…

46.8k
+727d
Python
4 yrs

Build, run, and manage agent platforms.

42.0k
+947d
Python
4 yrs

The Frontend Stack for Agents & Generative UI. React, Angular, Mobile, Slack, and more. Makers of the AG-UI P…

37.2k
+1077d
TypeScript
3 yrs

Build and run agents you can see, understand and trust.

30.6k
+7397d
Python
2 yrs