# Googles New GameNGen SURPRISES Everyone! (GameNGen Simulates DOOM  Videogames)

## Метаданные

- **Канал:** TheAIGRID
- **YouTube:** https://www.youtube.com/watch?v=HEhI692Rj4Y
- **Дата:** 30.08.2024
- **Длительность:** 9:25
- **Просмотры:** 10,647
- **Источник:** https://ekstraktznaniy.ru/video/14099

## Описание

Prepare for AGI with me - https://www.skool.com/postagiprepardness 
🐤 Follow Me on Twitter https://twitter.com/TheAiGrid
🌐 Checkout My website - https://theaigrid.com/


Links From Todays Video:
https://gamengen.github.io/

Welcome to my channel where i bring you the latest breakthroughs in AI. From deep learning to robotics, i cover it all. My videos offer valuable insights and perspectives that will expand your knowledge and understanding of this rapidly evolving field. Be sure to subscribe and stay updated on my latest videos.

Was there anything i missed?

(For Business Enquiries)  contact@theaigrid.com

#LLM #Largelanguagemodel #chatgpt
#AI
#ArtificialIntelligence
#MachineLearning
#DeepLearning
#NeuralNetworks
#Robotics
#DataScience

## Транскрипт

### Segment 1 (00:00 - 05:00) []

so ladies and gentlemen this news is actually news that most certainly surprised me if you ever wondered how video games worked opeta yet could imagine a world where video games aren't created by traditional coding methods but are instead entirely powered by artificial intelligence today we're diving into a groundbreaking concept from Google Deep Mind called game and gen a new approach where AI Takes the Wheel in generating interactive video game environments in 100% real time that humans can actually play so let's actually talk about the basics of traditional game engines so you can grasp the understanding of why this research is so impactful and why everyone was stunned so games like Doom fortnite or Minecraft are built using game engines now these engines are like software Frameworks that handle everything from reading your keyboard input to updating the game world and then of course rendering that on your screen now traditionally these engines are carefully coded by developers to create an immersive experience but instead of this what if instead of coding every little detail we could use an AI to generate the game environment on the Fly whilst the human plays and this idea is what we're going to be talking about in today's video so let's look at game gen and gen is the first game engine that is entirely powered by a neural model which is a type of AI that simulates how the human brain works and what does this mean well essentially instead of relying on tons of handwritten code game and gen uses AI to generate the game's environment and interactions in real time based on what's happens in the game so imagine playing a game like Doom but instead of the game being rendered through tradition programming methods it is created in real time by an AI model and this is essentially what game Engen does so you might be thinking how does game Eng gen work so this system is built on something called a diffusion model so you have to think of it as a very Advanced predictive system that can guess what happens in a game environment by of course looking at previous actions the AI watches how the game unfolds frame by frame like watching a flip book animation and it learns to predict what should happen next if a player presses a button to the left or to shoot the AI figures out the new game State and then renders the corresponding frames now game n gen does this so efficiently that it can run Doom a classic and complex game at over 20 frames per second using specialized hardware and this is crucial this speed is crucial because for a game to actually feel smooth and responsive it needs to run High frame weights I'm not sure if you've ever played a game before and you've suffered from something that Gamers call lag I've experienced it myself and it's not something that works if you're actually trying to play the video so this is rather important for the consistency and the coherence of humans actually enjoying the game and usually higher frame rates respond better with Gamers and frame rates don't just exist at 30 frames per second or even 60 frames per second that you might be watching this video in some monitors allow for 244 frames which results in extraordinarily smooth gameplay this is where we're going to be talking about training game and gen so in order to train the AI to simulate a game environment the researchers followed a two-phase approach number one is to train an AI agent so at first they created an AI agent that learns to play Doom by itself this AI agent is like a virtual player that goes through millions and millions of game scenarios learning different actions outcomes and environments then number two is generating the game data the game sessions played by this agent are recorded and then turned into training data and this data is then used to teach the AI model to predict what the next game frame should look like based on the previous actions and Frames now the real world performance of this looks almost identical to the original game in fact when human testers were asked to identify whether a clip was from the original game or the AI simulation they could only do so slightly better than if they were guessing randomly and this shows us from these preliminary results that AI generated environments are incredibly realistic now in terms of image quality the AI achieves a level of detail compared to Modern video compression techniques and this means that the game doesn't just run smoothly it actually

### Segment 2 (05:00 - 09:00) [5:00]

looks pretty good too now you might be thinking why on Earth is this even important well this is important because this could represent a massive shift in how video games are made traditionally speaking creating a game requires thousands and thousands of hours of coding designing testing and iterating but with AI driven engines like game and gen creating games could become way faster way cheaper and more accessible so imagine being able to create a game World simply by just describing it in words or by drawing a few simple sketches and this could theoretically open up game development to a whole new group of creators who don't necessarily know how to code how to program or even how to build game now these implications don't just apply to game and gen this technology could be potentially applied to any interactive software think about virtual simulations for training education or even entertainment where AI generates the environment based on the user input in real time now there were some limitations of this which was solved quickly One Challenge the researchers faced was something called autor regressive drift simply put the AI generates more and more frames in a row and as these small mistakes can accumulate this leads to unrealistic results that look nothing like the actual game imagine a pain painter who's copying a painting line by line but with every line the mistakes add up until the whole painting looks off to solve this they introduced a technique called noise augmentation which basically means adding a controlled Randomness to the training process and this way the AI learns to correct itself and stay more aligned with what the game should actually look like now you might be thinking what's next are Google just going to dump This research are they going to continue going so the researchers behind game and gen are actually quite excited about its potential but they also acknowledge some limitations for instance the AI memory is limited to a few seconds of game history which can sometimes lead to inaccuracies also while it works well with doom which is a relatively older and simpler game future versions will need to handle more complex and of course modern games now despite these challenges game and gen represents a big step towards a new way of thinking about interactive digital environments and that idea of AI generated worlds is no longer science fiction It's Quickly becoming a reality now one of the things I did want to do is some experiments myself on certain websites using today's available tools with current image generation techniques we can actually provide certain environments with an image that looks rather like current modern game environments for example right here you can see that I've prompted GPT 40 to create a F1 game firstperson gameplay style screenshot literally in a couple of seconds managed to create me this image of an F1 car barreling Down The Long Road at some kind of F1 virtual environment now with this of course it isn't currently playable but with new technology that was only released 2 to 3 months ago we can actually animate this in a remarkable amount of time you can see that in just a few seconds I'm able to get this footage that looks remarkably realistic now the thing about this is that this is currently using runways gen 3 Alpha turbo and this was literally done within around I think 6 or 7 seconds so you can imagine if in the future it's going to be possible with the inference speed increases with increasing levels of Technology regarding AI could we on the Fly generate completely new video games simply from text to image prompts and then of course enter a completely generated world I think this future is not that far off provided that there still is more research and development into this but this quick example showing you guys that you can make stuff like this yourself shows you the AI generated game world might not be as far off as many people have thought if you enjoyed the video I'd love to see you on the next one and hats off to Google Deep Mind for such amazing research