Arch Gateway: Secure and Efficient Prompt Handling for GenAI Apps

Arch Gateway, built by Envoy Proxy contributors, simplifies and optimizes the development of generative AI applications. It leverages purpose-built LLMs to handle prompts, providing intent-based routing, robust security (preventing jailbreaks), API integration, and comprehensive observability. Arch Gateway supports multiple LLMs and utilizes Envoy for high performance and scalability. A user-friendly CLI and detailed documentation are provided, with a quickstart guide demonstrating the creation of a simple AI agent, such as a currency exchange agent.