webclaw
Fast, local-first web content extraction Rust binary that scrapes, crawls, and converts web pages to structured Markdown; ships a CLI, REST API, and MCP server for LLM and agent pipelines.
Connects to: Claude, Cursor, LangChain, Any MCP client, RAG pipelines · · AGPL-3.0 1,712★
Use it with an AI agent
Loadbay is an MCP server, so an agent can search the catalog and find this harness:
claude mcp add --transport http loadbay https://loadbay.xyz/api/mcp
- Source: https://github.com/0xMassi/webclaw
- This harness as JSON: /api/harnesses/webclaw
- Agent setup: /setup.md
- Browse all 700+ harnesses on Loadbay