Open-Source Tool Unveils the Inner Workings of Large Language Models

Anthropic has open-sourced a new tool to trace the "thought processes" of large language models. This tool generates attribution graphs, visualizing the internal steps a model takes to arrive at a decision. Users can interactively explore these graphs on the Neuronpedia platform, studying behaviors like multi-step reasoning and multilingual representations. This release aims to accelerate research into the interpretability of large language models, bridging the gap between advancements in AI capabilities and our understanding of their inner workings.