Perceptually-Aligned Dynamic Facial Projection Mapping: High-Speed Tracking & Co-axial Setup
2025-02-03
Researchers developed a novel high-speed dynamic facial projection mapping (DFPM) system that significantly reduces misalignment artifacts. This is achieved through a high-speed face-tracking method using a cropped-area-limited interpolation/extrapolation-based face detection and a fast Ensemble of Regression Trees (ERT) for landmark detection (0.107ms). A lens-shift co-axial projector-camera setup maintains high optical alignment with minimal error (1.274 pixels between 1m and 2m). This system achieves near-perfect alignment, improving immersive experiences in makeup and entertainment.