NVIDIA’s New Technique: Beautiful Models For Less! 🌲

dear fellow Scholars this is 2 minute papers with Dr car today we are going to see how crazy good nvidia's new system is at simplifying virtual objects these objects are used to create photorealistic footage for featurelength movies Virtual Worlds and more but here comes the problem sometimes these geometries are so detailed they are prohibitively expensive to store and render efficiently here are some examples from one of our papers that were quite challenging to iterate on and render this took several minutes to render and always ate all the memory in my computer so what can we do if we would still like to get crisp high quality geometry but cheaper and quicker I'll show you in a moment this is part of a super complex scene get this it is so complex that it takes nearly 100 GB of storage space to render just one image of this and is typically used for benchmarking rendering algorithms this is the nurburging of light transport algorithms if you will well hold on to your papers because I said that I'll show you in a moment what we can do to get all this at a more affordable cost but in fact you are looking at the results of the new method right now yes parts of this image are the original geometry and other parts have already been simplified so which is which do you see the difference please stop the video and let me know in the comments below I'll wait thank you so let's see together yes this is the original geometry that requires over 5 billion triangles and this is the simplified one which what can this really be this uses less than 1% of the number of triangles compared to this in fact it's less than half a percent that is insanity this really means that about every 200 triangles are replaced with just one triangle and it still looks mostly the same that sounds flat out impossible to me wow so how does this witchcraft even work well now you see this is the power of differentiable rendering the problem formulation is as follows we tell the algorithm that here are the results that you need to get find the geometry and material properties that will result in this it runs all this by means of optimization which means that it will have a really crude initial guess that doesn't even seem to resemble the target geometry but then over time it starts refining it and it gets closer and closer to the reference this process is truly a sight to behold look at how beautifully it is approximating the target geometry this looks very close and is much cheaper to store and render I loved this example too previously this differentiable rendering concept has been used to be able to take a photograph and find a photorealistic material model that we can put in our simulation program that matches it this work did very well with materials but it did not capture the geometry this other work did something similar to this new paper which means that it jointly found the geometry and material properties but as you see high frequency details were not as good as with this one you see here these details are gone and now just 2 years and one paper later we can get a piece of geometry that is so detailed that it needs billions of triangles and it can be simplified 200 to one now if even that is not enough admittedly it is still a little red mentary but it even works for animated characters I wonder where we will be two more papers down the line from here and for now wow scientists at Nvidia knocked it out of the park with this one huge congratulations to the team what a time to be alive so there you go this was quite a ride and I hope you enjoyed it at least half as much as I did and if you enjoyed it at least as much as I did

and are thinking that this light transport thing is pretty cool and you would like to learn more about it I held a master level course on this topic at the Technical University of Vienna since I was always teaching it to a handful of motivated students I thought that the teachings shouldn't only be available for the privileged few who can afford a college education no the teachings should be available for everyone free education for everyone that's what I want so the course is available free of charge for everyone no strings attached so make sure to click the link in the video description to get started we write a full light simulation program from scratch there and learn about physics the world around us and more this episode has been supported by Lambda GPU Cloud if you're looking for inexpensive Cloud gpus for AI check out Lambda GPU Cloud they've recently launched Quadro RTX 6000 RTX 8,000 and V100 instances and hold on to your papers because Lambda GPU Cloud can cost less than half of AWS and Asia plus they are the only cloud service with 48 GB RTX 8000 join researchers at organizations like apple MIT and Caltech in using Lambda Cloud instances workstations or servers make sure to go to lbs. com papers to sign up for one of their amazing GPU instances today our thanks to Lambda for their long-standing support and for helping us make better videos for you thanks for watching and for your generous support and I'll see you next time