Arch: A Modular Edge and AI Gateway for Agentic Apps
2025-07-14
Arch is a modular edge and AI gateway proxy server designed to simplify building agentic applications. It handles the tedious low-level work, such as applying guardrails, clarifying ambiguous user input, routing prompts to the correct agent, and unifying access to any LLM, allowing developers to build and ship agentic apps faster. Built on Envoy, Arch offers features like routing, guardrails, and observability, and supports various languages and frameworks. A simple currency exchange agent demo showcases its ease of use, with interaction via curl commands. Arch supports both model-based and preference-based LLM routing strategies and provides detailed logging and observability.