UniK3D: Universal Camera Monocular 3D Estimation

UniK3D revolutionizes monocular 3D reconstruction by accurately estimating metric 3D scenes from single images, regardless of camera type. Unlike previous methods reliant on simplified assumptions, UniK3D directly predicts 3D points without extra information. Its key innovation lies in a spherical 3D representation and a novel camera representation, overcoming limitations of traditional approaches in wide-angle and panoramic settings. Zero-shot evaluation across 13 diverse datasets demonstrates state-of-the-art performance in 3D, depth, and camera metrics, particularly excelling in challenging large field-of-view scenarios. Code and models are available on GitHub.