In-Browser Graph RAG Chatbot using Kuzu-Wasm and WebLLM
2025-03-10
This blog post demonstrates a fully in-browser chatbot built with Kuzu-Wasm and WebLLM, leveraging Graph Retrieval-Augmented Generation (Graph RAG) to answer natural language questions about LinkedIn data. The application utilizes the benefits of WebAssembly, enabling local data processing for enhanced privacy and simplified deployment. The architecture, implementation, data ingestion, WebLLM prompting, and performance observations are detailed. While current limitations exist, such as model size and speed, the advancements in WebAssembly and the emergence of smaller, better LLMs suggest a bright future for such advanced pipelines running entirely within the browser.