# NVIDIA’s New AI: Huge Game Changer!

## Метаданные

- **Канал:** Two Minute Papers
- **YouTube:** https://www.youtube.com/watch?v=4TpwfbUjCYs
- **Дата:** 19.01.2025
- **Длительность:** 6:15
- **Просмотры:** 107,490
- **Источник:** https://ekstraktznaniy.ru/video/17180

## Описание

❤️ Check out Lambda here and sign up for their GPU Cloud: https://lambdalabs.com/papers

📝 The paper "CLoSD - Closing the Loop between Simulation and
Diffusion for multi-task character control" is available here:
https://guytevet.github.io/CLoSD-page/

📝 My paper on simulations that look almost like reality is available for free here:
https://rdcu.be/cWPfD 

Or this is the orig. Nature Physics link with clickable citations:
https://www.nature.com/articles/s41567-022-01788-5

🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
Alex Balfanz, Alex Haro, B Shang, Benji Rabhan, Gaston Ingaramo, Gordon Child, John Le, Juan Benet, Kyle Davis, Loyal Alchemist, Lukas Biewald, Martin, Michael Albrecht, Michael Tedder, Owen Skarpness, Richard Sundvall, Taras Bobrovytsky,, Thomas Krcmar, Tybie Fitzhugh, Ueli Gallizzi.
If you wish to appear here or pick up other perks, click here: https://www.patreon.com/TwoMinutePapers

My research: https://cg.tuwien.ac.at

## Транскрипт

### Segment 1 (00:00 - 05:00) []

this new AI based technique enables us to write a piece of text and animate a virtual character to do exactly as we say so first do a squat yep that does it for the exercise today we are fellow skyers after all now walk like a zombie that looks good now end of shift engage Couch Potato mode perfect now I only need a bunch of research papers to read and I am a happy man now there is one problem here what is the problem what you just saw is nearly impossible to pull off why is that well let's use a previous technique and I want to see a bloodthirsty Warrior mercilessly destroying its enemies well this is not that and this technique was published less than a year ago so you fellow scholar see that this is a tough problem if you want to use a diffusion based AI model and this paper is an incredible collaboration between Nvidia and four other universities to correct the code to creating believable animations with diffusion based AI techniques as many of you know these start out from noise but this noise in this case does not create an image but character animation instead as you know these diffusion base methods can be used for way more than just images for instance they can even take a piece P of noise and create geometry out of it so why not animation well here is the reason oh yes we can start out from noise and slowly eliminate it but still at the end Some Noise remains and we have some consistency issues so a diffusion model by itself is not sufficient here but this new technique has a brilliant idea to fix it dear fellow Scholars this is 2minute papers with Dr car what is the brilliant idea well look at the blue markers here this is what the noisy diffusion model says the character should be doing actually it's pretty good but oh my do you see what I see here the left and right foot at some point just make a pop yep artifacting issues so here is where this new technique comes into play oh yes it fixes these problems finally creating a believable movement sequence absolutely love loving this and this is why it is called closed because a new controller system works together with this diffusion model to corrected okay so what can it do well it can create a sequence where for instance we walk from A to B okay but we can already do that so is that it why is that useful now hold on to your papers fellow Scholars because there are many ways to take this journey and we can add a simple piece of text that tells the character how to do that look at that what a beauty hopping walking jogging or it can even Walt to the desired point so cool so we can tell it to sit down on the sofa and relax I said Relax oh now we're talking and those merciless attacks can now not only be punches and these finally work now but with the power of TX prompting it can also push with two hands or even do a high kick so is it perfect well let's have a look together now I got to say these punches are not something that strike fear in my heart they wouldn't do a lot of damage maybe if a fight breaks out in a virtual retirement home this could be appropriate so is that perfect not even close I mean look at how wobbly these moves still are no wonder because this is a research paper that takes something that was previously impossible and makes it possible so yes this is early you will likely not see this in the games coming next week but don't forget one thing Ai and computer Graphics research progresses incredibly quickly here you see what AI video generation was capable of just a year ago and today wow so don't just look at what we can do now try to think two more papers down the line and imagine what we will be capable of that is the first law of papers now this is a good paper so it describes how each individual proposed technique changes the outcome for the better you can see these little pieces in action but it also documents how the success rates increase with these correction steps I mean previous techniques could not get out of the couch at all or only with a 2% success rate and now the new one oh my look it can get up from the couch 9 8% of the

### Segment 2 (05:00 - 06:00) [5:00]

time that's better than what most humans can do isn't it so from now on no more Couch Potato AIS are allowed and there are cases where we are up to 100% incredible and all this in just one paper what a time to be alive and yes here we love taking a deeper look at papers and measurements welcome to two-minute papers and they did not keep the details to themselves the entire research paper and source code for the project is available for all of us free of charge thank you so in future video games characters May finally be able to perform new moves that they were never programmed to do so what would you fellow Scholars use this for let me know in the comments below to run your own experiments on an Nvidia GPU check out Lambda I use it myself regularly for these videos H look at that you can generate high quality images in less than a second per image I did a ton more of them and paid less than a dollar for all this crazy seriously try it out now at lamb labs. com slapers or click the link in the description