GPU Glossary: A Comprehensive Guide to GPU Architecture

The Modal team has created a comprehensive GPU glossary to address the fragmented nature of GPU documentation. This interactive online dictionary connects concepts across different levels of the stack, from CUDA architecture to nvcc compiler flags. Users can navigate via hyperlinks or read linearly. The glossary covers device hardware (CUDA architecture, Streaming Multiprocessors, etc.), device software (CUDA programming model, PTX, etc.), and host software (CUDA C++, NVIDIA drivers, etc.), providing developers with a comprehensive and easily understandable resource for GPU knowledge.