Best Robotics harnesses for AI agents
The most-adopted Robotics harnesses an AI agent can use, ranked by GitHub stars, with what each is best for. Loadbay is an MCP server, so an agent can pull this list live:
claude mcp add --transport http loadbay https://loadbay.xyz/api/mcp
-
1. RuView
82,353★ ·
Most adopted — the default starting point. Best for Claude Code, MCP hosts, ESP32-S3. WiFi sensing platform that converts commodity radio signals into real-time spatial intelligence, shipping a SENSE-BRIDGE MCP server exposing presence, vital-sign, and activity tools to AI agents. -
2. Genesis
29,364★ · Python
Best for PyTorch. Simulation platform for general-purpose robotics and embodied-AI learning with a unified physics engine. -
3. lerobot
25,062★ · Python
Best for PyTorch, Gymnasium. End-to-end robot-learning library with pretrained policies, datasets, and sim environments for real-world robotics. -
4. PyBullet (Bullet3)
14,553★ · C++
Best for Python, ROS, URDF. Bullet Physics SDK with the widely used PyBullet module for real-time simulation for robotics, RL, and sim-to-real. -
5. CARLA
14,075★ · C++
Best for Python, ROS, ROS2. Open-source simulator for autonomous-driving research with photorealistic urban environments, sensors, and a Python API. -
6. MuJoCo
13,902★ · C++
Best for Python, dm_control, Gymnasium. General-purpose physics simulator, the de-facto standard engine for contact-rich robot learning and control. -
7. openpi
12,406★ · Python
Best for JAX, PyTorch, LeRobot. Physical Intelligence open release of pi0/pi0.5 vision-language-action models and runtime for robot manipulation. -
8. xiaozhi-esp32-server
9,955★ ·
Best for ESP32, MCP, MQTT. Backend server for the xiaozhi-esp32 open-source AI voice assistant that exposes an MCP access point so AI agents can connect to and control ESP32-based edge devices. Supports WebSocket, MQTT/UDP, voice fingerprint recognition, and knowledge-base integration. -
9. Text-to-CAD Skills
8,852★ ·
Best for Claude Code, OpenAI Codex, SendCutSend. Agent skills library enabling AI agents to generate and edit CAD models, URDF robot descriptions, DXF drawings, and G-code for slicers through natural language, with direct 3D printer job management. -
10. IsaacLab
7,472★ · Python
Best for Isaac Sim, Gymnasium. Unified framework for robot learning built on NVIDIA Isaac Sim with GPU-accelerated simulation environments.