# NVIDIA’s AI: 100x Faster Virtual Characters!

## Метаданные

- **Канал:** Two Minute Papers
- **YouTube:** https://www.youtube.com/watch?v=Y2JJylfbuKM
- **Дата:** 19.02.2025
- **Длительность:** 6:35
- **Просмотры:** 98,464

## Описание

❤️ Check out Lambda here and sign up for their GPU Cloud: https://lambdalabs.com/papers

📝 The papers are available here:
https://research.nvidia.com/labs/prl/publication/park2023nearrealtime/
https://gao-jiawei.com/Research/CooHOI/

📝 My paper on simulations that look almost like reality is available for free here:
https://rdcu.be/cWPfD 

Or this is the orig. Nature Physics link with clickable citations:
https://www.nature.com/articles/s41567-022-01788-5

🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
Benji Rabhan, B Shang, Christian Ahlin, Gordon Child, John Le, Juan Benet, Kyle Davis, Loyal Alchemist, Lukas Biewald, Michael Tedder, Owen Skarpness, Richard Sundvall, Steef, Taras Bobrovytsky, Thomas Krcmar, Tybie Fitzhugh, Ueli GallizziIf you wish to appear here or pick up other perks, click here: https://www.patreon.com/TwoMinutePapers

My research: https://cg.tuwien.ac.at/~zsolnai/
X/Twitter: https://twitter.com/twominutepapers
Thumbnail design: Felícia Zsolnai-Fehér - http://felicia.hu

## Содержание

### [0:00](https://www.youtube.com/watch?v=Y2JJylfbuKM) Segment 1 (00:00 - 05:00)

I feel delighted because virtual characters in games and animated movies are about to get a lot more realistic why well when animating them instead of just trying to do what looks good we can run simulations instead to find out how they would move in reality nothing new about that we've been doing this for decades now however get this these simulations can go down to the level of muscles that is incredible but there is one big problem what is the problem well cost it takes a long time to compute just imagine we are going down to the level of muscles and soft tissues and compute the interactions of millions of little triangles and we repeat that for every time instant and you have to make sure to avoid all of these awkward collisions too yes we still have to wait a lot for a high quality result so this is hopeless for a real time application but wait remember these super resolution techniques out there where in goes a coarse image and out comes a really detailed result synthesizing details with AI techniques is now possible but this is for images not for 3D models and are you thinking what I am thinking oh yes why not do super resolution but in 3D yep that is exactly what this paper does this is super resolution for simulations in goes this really coarse blocky result and what comes out probably nothing good right let's see oh my that is absolutely fantastic so how much faster is this 10x 15x nope this makes the whole process more than a 100 times faster yes something that took an all nighter now only takes 5 minutes and what used to take a minute now takes less than a second that is amazing so that was easy right just throw an AI at the problem and there we go well nope not so fast dear fellow Scholars this is 2minute papers with Dr car episode 942 if you just try a core simulation and upscale it you will get a completely different result because the topology of your model is different than the real detailed model you are simulating a completely different person how would that be useful but they did it somehow so how here is a genius idea yes AI you are allowed to do the super resolution but at the same time use the knowledge of what you have learned from higher resolution simulations but wait wait we said that with the naive technique you are getting a simulation of a different person with this technique do you get the actual person or just something that moves like that person well let's have a look together here is the course input and here is the result of the new technique and then here comes the moment of truth let's compare it to a high resolution simulation that takes forever that will be the reference my goodness it is so close there are differences yes but this is so close it is probably reasonable to say that this is exactly the person we want and in the textured results oh my try to not look at the teeth I know it's hard but you can do it also very close just avoid the teeth so it works by looking at pairs of low and their corresponding high resolution simulations and tries to learn as much from them as possible but then what about unseen Expressions can it do that the paper is really selling the fact that it generalizes to unseen expressions and I have to be honest I am not so keen on these results they are a little too wobbly for me but wait a second this result hides a secret I am seeing something that is incredible do you see it too there is no nose deformation information in the training data of this system and when the nose moves in the input it also synthesizes realistic tiny little deformations in the output that is huge I mean not the nose the phenomenon that it is able to predict these tiny little defamations of the nose induced by the mouth movements insanity and it gets better it also generalizes to new people and new kinds of movements yes this is a virtual world so you can run your silly little experiments all you want the perks of being a computer Graphics SL AI researcher it is the best and we even get paid to do this what a time to be alive and we are still not done yet I would like to send a huge thank you for

### [5:00](https://www.youtube.com/watch?v=Y2JJylfbuKM&t=300s) Segment 2 (05:00 - 06:00)

the scientists behind the paper because the paper and the source code are available for free for all of us and it's crazy that almost nobody is talking about this paper you almost only hear about here on two-minute papers and now we invoke the first law of papers says that research is a process do not look at where we are will be two more papers down the line for instance I would love to have this concept applied to General computer animation for example this other work focuses on Multi character interaction I mean if you need some help moving to a new house I would ask for nobody else than these little Scholars look I bet they won't even complain when the couch crushes their legs now imagine if all of them were fully simulated characters down to the level of individual muscles facial gestures and everything all with just one Ai and all that in real time it is coming and I cannot wait to create my own little Virtual Worlds with it to run your own experiments on an Nvidia GPU check out Lambda I use it myself regularly for these videos H look at that you can generate high quality images in less than a second per image I did a ton more of them and paid less than a dollar for all this crazy seriously try it out now at lbs. com slapers or click the link in the description

---
*Источник: https://ekstraktznaniy.ru/video/12595*