tensorzero
Open-source LLM gateway and optimization platform that sits between agents and LLM providers, unifying model access, observability, evaluation, and A/B experimentation in one system. Agents route inference calls through TensorZero to gain automatic prompt optimization, LLM-as-judge evaluation, and production-grade performance.
Connects to: OpenAI, Anthropic, AWS Bedrock, Azure OpenAI, Google Vertex AI, OpenTelemetry, Prometheus · · Apache-2.0 11,724★
Use it with an AI agent
Loadbay is an MCP server, so an agent can search the catalog and find this harness:
claude mcp add --transport http loadbay https://loadbay.xyz/api/mcp
- Source: https://github.com/tensorzero/tensorzero
- This harness as JSON: /api/harnesses/tensorzero
- Agent setup: /setup.md
- Browse all 700+ harnesses on Loadbay