ISMAR 2011

Having nice global illumination between real and virtual objects is not enough to get a plausible illusion. There are still some important points missing that make virtual objects easily distinguishable from real objects:

• The tracking often jitters or worse gets lost for virtual objects
• The colors of virtual objects do not match the colors of the surrounding real objects
• The virtual objects have a perfect appearance while the real objects don't
• Camera artifacts introduce distortions to the real objects, but normally not to virtual ones as they are rendered on top of the video image

So in order to get a plausible illusion we have to deal with those problems. In our paper "Adaptive Camera-Based Color Mapping For Mixed-Reality Applications" we tried to find an automatic method that adapts the color mapping characteristics of the camera onto the virtual objects.