This year’s virtual edition of SIGGRAPH, the premiere computer graphics conference, formally ended yesterday after a few days of announcements and sessions.
At SIGGRAPH 2021, NVIDIA presented a few of its latest researches in how to advance real-time graphics. Arguably the most interesting demonstration was that of Neural Radiance Caching, a new technique specifically designed for path traced global illumination.
NVIDIA shared the CUDA source code for Neural Radiance Caching so that developers and researchers may further experiment with it. There’s also a detailed technical paper available for purview if you want to learn the math behind this technology.
Combined with NVIDIA’s state-of-the-art direct lighting algorithm, ReSTIR, Neural Radiance Caching can improve rendering efficiency of global illumination by up to a factor of 100—two orders of magnitude.
At the heart of the technology is a single tiny neural network that runs up to 9x faster than TensorFlow v2.5.0. Its speed makes it possible to train the network live during gameplay in order to keep up with arbitrary dynamic content. On an NVIDIA RTX 3090 graphics card, Neural Radiance Caching can provide over 1 billion global illumination queries per second.
It’s not all about lighting, however. NVIDIA’s graphics researchers have also worked on the so-called neural reflectance field textures, or NeRF-Tex for short, which aim to model complex materials such as fur, fabric, or grass in a more accurate way.
The related technical paper can be found here. For a visual demonstration of NVIDIA’s latest graphics research projects, including Neural Radiance Caching and NeRF-Tex, check out the footage below.
