Foreground and shadow occlusion handling for outdoor augmented reality

A novel approach to handling foreground and shadow occlusion in outdoor augmented reality (AR) has been developed, addressing the challenges posed by unpredictable illumination changes. The method introduces outdoor illumination constraints that improve the segmentation of foreground objects when integrated into a probabilistic model using multiple cues. Additionally, an effective technique for resolving shadow occlusion is presented, utilizing shadow detection and recasting with a spherical vision camera. These advancements were tested in the Virtual Asuka (VA) project, demonstrating their effectiveness in synthesizing virtual objects accurately within real-world scenes.

Lu, B. V., Kakuta, T., Kawakami, R., Oishi, T., & Ikeuchi, K. (2010). Foreground and shadow occlusion handling for outdoor augmented reality. 2010 IEEE International Symposium on Mixed and Augmented Reality, 109–118. https://doi.org/10.1109/ismar.2010.5643558