LegoGPT: Building Stable LEGO Models from Text Prompts
2025-05-09
Researchers have developed LegoGPT, an AI model that generates physically stable LEGO brick models from text prompts. Trained on a massive dataset of over 47,000 LEGO structures encompassing over 28,000 unique 3D objects and detailed captions, LegoGPT predicts the next brick to add using next-token prediction. To ensure stability, it incorporates an efficient validity check and physics-aware rollback during inference. Experiments show LegoGPT produces stable, diverse, and aesthetically pleasing LEGO designs closely aligned with the input text. A text-based texturing method generates colored and textured designs. The models can be assembled manually or by robotic arms. The dataset, code, and models are publicly released.