Best Voice & media harnesses for AI agents
The most-adopted Voice & media harnesses an AI agent can use, ranked by GitHub stars, with what each is best for. Loadbay is an MCP server, so an agent can pull this list live:
claude mcp add --transport http loadbay https://loadbay.xyz/api/mcp
-
1. stable-diffusion-webui
163,770★ · Python
Most adopted — the default starting point. Best for Stable Diffusion. The most widely used Stable Diffusion web UI with extensions and an API endpoint agents can call for text-to-image. -
2. ComfyUI
117,384★ · Python
Best for Stable Diffusion, Flux. Modular node-graph diffusion GUI, API, and backend for image and video generation that agents can drive via workflows. -
3. Whisper
102,900★ · Python
Best for PyTorch, ffmpeg, HuggingFace. OpenAI robust multilingual speech-to-text model and the de-facto open standard for transcription and translation. -
4. screenshot-to-code
72,941★ · Python
Best for Claude, GPT. Drops in a screenshot and converts it to clean HTML, Tailwind, React, or Vue code using vision models. -
5. voicebox
52,765★ ·
Best for Claude Code, Cursor, Windsurf. A local-first voice I/O studio that exposes TTS, STT, and voice cloning to AI agents via an MCP server. Agents connect via MCP to call tools like voicebox.speak, voicebox.transcribe, and voicebox.list_profiles, with all audio processing running on-device for full privacy. Supports 7 TTS engines, Whisper-based dictation, and per-client voice binding for Claude Code, Cursor, and Windsurf. -
6. whisper.cpp
50,800★ · C++
Best for ggml, CUDA, Core ML. High-performance C/C++ port of Whisper for fast local and on-device speech-to-text with no Python runtime. -
7. Fooocus
50,314★ · Python
Best for Stable Diffusion. Streamlined Stable Diffusion image generator focused on prompting with minimal configuration. -
8. TTS
45,573★ · Python
Best for XTTS. Deep-learning text-to-speech and voice-cloning toolkit with many pretrained multilingual models. -
9. HyperFrames
44,900★ ·
Best for Puppeteer, ffmpeg, GSAP. Open-source framework for turning HTML, CSS, and seekable animations into deterministic MP4 videos, built for AI agents. Includes MCP tooling for motion and composition workflows. -
10. ChatTTS
39,469★ · Python
Best for ChatTTS. Generative speech model optimized for natural conversational dialogue in English and Chinese.