Toolbox/Applied agents

Robotics & embodied

agents that plan, code and debug for robots and simulators

20 repositories, most starred first
State of the category

PhyAgentOS/PhyAgentOS PhyAgentOS is the clearest adoption leader, offering a session-centered runtime that lets the same agent workflows run unchanged across simulation and real hardware; if you need a single, well-adopted foundation for sim→real agent execution and multi-layer safety, start there. Choosing otherwise usually reflects a specific need the leader doesn't prioritize (ROS/MCP wiring, benchmarks, strict offline operation, specialized safety patterns, or out‑of‑the‑box GUIs).

ROS & MCP Integration
Teams that use ROS or the MCP standard need tooling that integrates LLMs without rewriting robot code, because many fleets and legacy robots demand drop‑in bridges and ROS-native APIs.
Sim-to-real Adapters
Groups building agents for both simulation and hardware need adapter/session patterns so the same workflows run unchanged across sim and real robots, avoiding duplicated engineering effort.
Benchmarks & Training
Practitioners improving embodied agent performance need tooling, environments, and benchmark suites to evaluate code-as-policy agents and enable RL/finetuning or data collection at scale.
Safety & Auditing
Production teams require fail‑closed execution, auditable receipts, and human‑in‑the‑loop review patterns to manage risk and compliance when agents control physical systems.
Local & Edge
Robotics deployments in sensitive, low‑connectivity, or resource‑constrained settings need fully local/offline stacks and lightweight supervision so models and control remain private and reliable on edge hardware.
Find your fit

Which one matches your setup?

Answer any of the questions — the shortlist updates as you go. Recommendations come from the capability passports below, nothing else.

Where should reviews happen?
Can code leave your infrastructure?
What matters most?
Model access?
Pick at least one answer to get a shortlist.
Side by side

Comparison matrix

Axes are extracted from each project's docs by our review pipeline; the maturity score is computed from stars, growth and commit activity — not an opinion. Click a column to sort.

Runs inModelsContextCost to run
⭐ 3.0k +48/7d
CLIFixed providerWorkspace & protocolsMulti-layer validation●●●●●Self-hostable●●●●●Free, self-hosted
⭐ 3.0k +48/7d
CLIFixed providerWorkspace-wide contextMulti-layer safety●●●●●Self-hostable●●●●●Free, self-hosted; optional external services
⭐ 3.0k +48/7d
CLIFixed providerWorkspace-wide protocolMulti-layer safety●●●●●Fully self-hosted●●●●●Free, self-hosted (local compute)
⭐ 1.5k +10/7d
CLIBYOKOpenAIAnthropicGeminiFull robot contextMinimal guidance●●●●●Self-hostable●●●●●Depends on external model providers; uses your model client / API key.
⭐ 230 +5/7d
CLICIWeb appOpenAIAnthropicGeminiDiff onlyBasic filtering●●●●●Self-hostable●●●●●Free, self-hostable; optional model API costs
⭐ 191 +6/7d
CLIIDEBYOKTool-onlySim-safe defaults●●●●●Runs fully local●●●●●Free; local GPU required for some backends/training
⭐ 1.7k +5/7d
CLIBYOKSystem-level contextNone mentioned●●●●●Self-hostable●●●●●Your LLM/API key (your usage costs)
⭐ 878 +16/7d
CLIWeb appCIBYOKGeminiFixed providerDiff onlyNone mentioned●●●●●Self-hostable●●●●●Your API key or local GPU
⭐ 607 +5/7d
CLIBYOKDiff onlyNone●●●●●Self-hostable●●●●●Open-source, self-hosted; model API costs may apply
⭐ 147
CLIFixed providerOpenAIPrompt + few-shotScreener + verify●●●●●Fully local●●●●●Local model checkpoints to download; optional OpenAI API key for the GPT judge
⭐ 141
CLIWeb appGeminiSingle-script contextNo explicit controls●●●●●Cloud API (your key)●●●●●Requires cloud LLM access (your API key).
⭐ 95 +5/7d
CLIIDECoding-agent pluginBYOKRuntime-onlyBasic filters●●●●●Fully local●●●●●Free, self-hosted (Docker/local)
Ranked by maturity — 7 more in the full catalog below.
At a glance

Capability profiles

Six axes, 0–5 each. The shape tells you the strategy: a wide hexagon is a generalist, a spike is a specialist. Showing the 8 most established — the rest are in the full catalog.

ContextNoiseCustomPrivacyModelsMaturity

Decouples cognition from physical hardware with a session-centered runtime and adapter/bridge architecture that lets the same sessions run unchanged across simulation and real robots while enforcing multi-layer safety and auditable execution.

ContextNoiseCustomPrivacyModelsMaturity

Provides a session-centered runtime that decouples cognition from physical targets so the same agent workflows run across simulation and real hardware via small target adapters.

ContextNoiseCustomPrivacyModelsMaturity

Decouples cognition from physical hardware with a session-centered runtime and small target adapters so the same agent codebase runs across sim and real robots.

ContextNoiseCustomPrivacyModelsMaturity

Bridges ROS and the MCP standard to let LLMs fully observe and control robots without modifying robot source code.

ContextNoiseCustomPrivacyModelsMaturity

Provides an auditable, fail-closed physical execution runtime that binds high-level agent intent to robot bodies and issues evidence-bearing receipts and leases.

ContextNoiseCustomPrivacyModelsMaturity

Unifies simulation and real hardware under one natural-language Agent API with built-in mesh networking and ROS 2 interoperability, letting the same code run in sim or on robots.

ContextNoiseCustomPrivacyModelsMaturity

Integrates LangChain LLMs with live ROS1/ROS2 systems to let developers inspect, diagnose, and operate robots via natural language.

ContextNoiseCustomPrivacyModelsMaturity

Provides an end-to-end, robotics-focused framework that benchmarks and improves Code-as-Policy agents with interactive robot gym environments, multi-tier benchmarks, a training-free agent, and RL fine-tuning tools bundled together.

All repositories (20)

PhyAgentOS is a Recursive Self-Improving (RSI) physical agent operating system that enables agents to recursi…

⭐3.0k
+487d
Python
7 mo

PhyAgentOS is a Recursive Self-Improving (RSI) physical agent operating system that enables agents to recursi…

⭐3.0k
+487d
Python
7 mo

PhyAgentOS is a Recursive Self-Improving (RSI) physical agent operating system that enables agents to recursi…

⭐3.0k
+487d
Python
7 mo

PhyAgentOS is a Recursive Self-Improving (RSI) physical agent operating system that enables agents to recursi…

⭐3.0k
Python
7 mo

ROSA 🤖 is an AI Agent designed to interact with ROS1- and ROS2-based robotics systems using natural language…

⭐1.7k
+57d
Python
2 yrs

Connect AI models like Claude & GPT with robots using MCP and ROS.

⭐1.5k
+107d
Python
1 yr

[ICML 2026] A Framework for Benchmarking and Improving Coding Agents for Robot Manipulation

⭐878
+167d
Python
7 mo

RAI is a vendor agnostic agentic framework for Physical AI robotics, utilizing ROS 2 tools to perform complex…

⭐607
+57d
Python
2 yrs

A unified, agentic system for general-purpose robots, enabling multi-modal perception, mapping and localizatio…

⭐403
+47d
Python
11 mo

Agent skills that make AI coding assistants write production-grade robotics software. ROS1, ROS2, design patte…

⭐384
+107d
Python
7 mo

Seamlessly integrate state-of-the-art transformer models into robotics stacks

⭐302
Python
2 yrs

Physical AI runtime for embodied agents — governed action, verified experience, physical memory, and skill evo…

⭐230
+57d
Python
7 mo

Control robots and physical hardware with natural language through Strands Agents.

⭐191
+67d
Python
8 mo

Official codebase for Spotter: Let the Embodied Model Lead, and the VLM Reflect for It

⭐147
-307d
Python
3 wk

🦾Make your robot autonomous with LLM agent. Set it up with the same ease as normal agents in CrewAI or Autoge…

⭐141
Python
1 yr

ROS2 MCP: the MCP server that lets AI agents see, understand and operate ROS 2 robots. MPL-2.0.

⭐95
+57d
Python
1 yr

A simple MCP server for the SO-ARM100 control

⭐86
Python
1 yr

EmbodiedAgents is a fully-loaded ROS2 based framework for creating interactive physical agents that can unders…

⭐71
+27d
Python
3 yrs

A general-purpose robotic agent framework based on LLMs. The LLM can independently reason, plan, and execute a…

⭐26
+17d
Python
10 mo

Offline fault diagnosis assistant for the AgiBot X2 Ultra humanoid: drop in a log package, get a three-round r…

⭐22
Python
5 mo

More in Applied agents