# Google’s New AI: Next-Level Virtual Worlds!

## Метаданные

- **Канал:** Two Minute Papers
- **YouTube:** https://www.youtube.com/watch?v=31oxj6mcsOM
- **Дата:** 29.06.2023
- **Длительность:** 4:27
- **Просмотры:** 104,774
- **Источник:** https://ekstraktznaniy.ru/video/13120

## Описание

❤️ Check out Weights & Biases and say hi in their community forum here: https://wandb.me/paperforum

📝 The paper "Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fields" is available here:
https://jonbarron.info/zipnerf/

📝 The paper "PhotoMat: A Material Generator Learned from Single Flash Photos " is available here:
https://people.engr.tamu.edu/nimak/Papers/SIGGRAPH2023_PhotoMat/index.html

My latest paper on simulations that look almost like reality is available for free here:
https://rdcu.be/cWPfD 

Or this is the orig. Nature Physics link with clickable citations:
https://www.nature.com/articles/s41567-022-01788-5

🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
Aleksandr Mashrabov, Alex Balfanz, Alex Haro, Andrew Melnychuk, Benji Rabhan, Bret Brizzee, Bryan Learn, B Shang, Christian Ahlin, Eric Martel, Geronimo Moralez, Gordon Child, Jace O'Brien, Jack Lukic, John Le, Kenneth Davis, Klaus Busse, Kyle Davis, Lorin Atzberger, Lukas Bi

## Транскрипт

### Segment 1 (00:00 - 04:00) []

Dear Fellow Scholars, this is Two Minute  Papers with Dr. Károly Zsolnai-Fehér. Today you are going to see virtual  worlds like you’ve never seen before! This is done with something that we call  NERFs. So, what are NERFs? Essentially,   we grab a smartphone and a set of images go in,  and reality comes out. When there is a gap between   the images, it can synthesize all this information  and it almost looks like reality. Absolute magic. Now, many of these are neural network-based  techniques and take quite a while to compute.    However, later NVIDIA published a technique  by the name instant NERFs. As the name says,   this trains incredibly quickly and is one of  the best techniques in its class. And today,   these can be produced from a smartphone camera,  and can be generated in a matter of seconds. But, there is a problem. Do you see the  problem? Well, let me ask you another   question - how do you spot a Fellow Scholar  who watches Two Minute Papers? Well, of course,   they are always looking at thin structures. Why?   Well, look! So, instant NERFs are super fast,   but have trouble with thin structures. And  now, hold on to your papers Fellow Scholars,   and let’s look at how this new paper deals with  the same problem. Oh my, that is outstanding! But wait, it is only better on thin structures,   or is it generally better than this  previous technique? Well, let’s see. Yes,   thin structures are still present, but the  new one is significantly better in terms   of quality. Wow. And this is just one year and  one more paper down the line. Very impressive. Also, here is a comparison against Mip-NERF, this  is real good, so I bet the new one isn’t better,   especially that this previous one ran  for about 20 times longer. Let’s see.    Is that really possible? The new one  is still better. 20 times faster,   and we don’t even have to pay for it by  giving up quality. This is still better. With this, we can now just grab a smartphone  and scan a real place and make a virtual   world out of it. This can be used for a video  games, videoconferencing, animation movies,   you name it. Now, not even this work is perfect,  you see, specular reflections like this display   are not that faithful to reality, and if we look  at severely undersampled regions, this can happen.    However, just think about the fact that all  this came just one more paper down the line. Now combine this together with this amazing  light transport paper that can take photos   of real-world objects and create a super  advanced, digital material model with just   the right physical parameters to replicate it.   So, NERFs can help with the geometry, and light   transport materials. And a  potential combination of the two could create   even more incredible virtual worlds and games for  us in the near future. What a time to be alive! Thanks for watching and for your generous  support, and I'll see you next time!