Kotlin-powered Local LLM Proxy: A Boon for JetBrains AI Assistant

2025-05-03
Kotlin-powered Local LLM Proxy: A Boon for JetBrains AI Assistant

Limited by the free quota of JetBrains AI Assistant, the author developed a Kotlin/Ktor application that proxies multiple LLM APIs, such as OpenAI, Claude, and Gemini, as LM Studio and Ollama APIs, enabling their use within JetBrains IDEs. Leveraging reflection-free features, it's built as a GraalVM native image for cross-platform compatibility and fast startup. It supports streaming chat, features easy configuration, and hot reloading.

Development