Building a Pipeline for Gathering and Rendering With Spatially Variant Incident Illumination Using Real Time Video Light Probes

Sammanfattning: Lighting plays an important part in computer graphics. When making photo realistic renderings the ultimate goal is to generate an image that would be indistinguishable from a real photograph or to seamlessly integrate a synthetic object into a photo. One of the key elements is to get correct lighting and shading in the rendering since the human vision is very well attuned to subtile variations of the lighting. Recent image based techniques has been developed that uses high dynamic range omni directional images, light probes, from the real world as light information to illuminate synthetic objects. Such images are capturing the incident light information in the point it was taken. By using these images as lighting information the objects illuminated will integrate seamlessly into a background photography of the scene. However these techniques assumes that the lighting is spatially constant throughout the scene. By using more light probes spatial variations in the scene can be captured. We will here present a pipeline for capturing and rendering with spatially variant light probes using a device that can capture light probes at very high dynamic range. Using this pipeline we have captured high frequency variations in a scene and scenes with complex real world lighting and used this information to render objects representing these variations.