# Googles Genie 2 Just SHOCKED The Entire AI Indstry (AI Generated Videogames)

## Метаданные

- **Канал:** TheAIGRID
- **YouTube:** https://www.youtube.com/watch?v=HoOFpHJeV0A
- **Дата:** 05.12.2024
- **Длительность:** 13:14
- **Просмотры:** 16,417

## Описание

Googles Genie 2 Just SHOCKED The Entire AI Indstry (AI Generated Videogames)

Prepare for AGI with me - https://www.skool.com/postagiprepardness 
🐤 Follow Me on Twitter https://twitter.com/TheAiGrid
🌐 Checkout My website - https://theaigrid.com/


Links From Todays Video:
https://deepmind.google/discover/blog/genie-2-a-large-scale-foundation-world-model/

Welcome to my channel where i bring you the latest breakthroughs in AI. From deep learning to robotics, i cover it all. My videos offer valuable insights and perspectives that will expand your knowledge and understanding of this rapidly evolving field. Be sure to subscribe and stay updated on my latest videos.

Was there anything i missed?

(For Business Enquiries)  contact@theaigrid.com

Music Used

LEMMiNO - Cipher
https://www.youtube.com/watch?v=b0q5PR1xpA0
CC BY-SA 4.0
LEMMiNO - Encounters
https://www.youtube.com/watch?v=xdwWCl_5x2s

#LLM #Largelanguagemodel #chatgpt
#AI
#ArtificialIntelligence
#MachineLearning
#DeepLearning
#NeuralNetworks
#Robotics
#DataScience

## Содержание

### [0:00](https://www.youtube.com/watch?v=HoOFpHJeV0A) Segment 1 (00:00 - 05:00)

so Google just changed absolutely everything with G2 their large scale AI model that can basically create AI generated video games from a single image prompt what you're seeing on screen now is the prompt first and then you're seeing the user control the character in this AI generated game games are about to change on a level that we can't even fathom and this is something that allows endless variety of action controllable playable 3D environments for training and evaluating embodied AI agents and this is literally just based on a single prompt and this can be played by a human or an AI agent using keyboard and mouse inputs now this is actually quite different from Google's genie1 which was pretty similar it was an AI generated game but it was unfortunately comined to a diverse array of 2D worlds but with Genie 2 this is a significant Leap Forward as it allows you to generate a vast diversity of Rich 3D worlds now Google state that Genie is a world model meaning it can simulate Virtual Worlds including the cons quence of taking any action for example that means jumping swimming Etc and it was trained on a large scale video data set and like other generative models it actually demonstrates various emergent capabilities at scale such as object interactions complex character animation physics and the ability to predict the behavior of other AI agents in game now we're going to take a look at some more example videos of people interacting with genie2 where you just use a single image to actually depict what kind of game you want to play one of the things cougle actually talk about is the fact that genie2 responds intelligently to actions taken by pressing keys on a keyboard identifying the character and moving it correctly for example the model has to figure out that arrow keys should move the robot not the trees or the clouds and this is really important because the model has to understand what kind of object you're going to be controlling and where to move that object right here you can see a cute humanoid robot is in the woods and the user is able to control them in various directions we can also see a humanoid robot in ancient Egypt this character is being controlled and is able to look around certain environments we can also see a first-person view of a robot on a purple planet and we can see the different controls for forward backward left and right and of course we can see this last one here of a firstperson view of a robot in a loft apartment in a big city being able to control this robot such as jumping moving forward moving back is really impr this is where we actually have something called generating counterfactuals and this is where they state that they can actually generate diverse trajectories from the same starting frame which is where they basically mean that even if they all start with the same frame they can generate many different outcomes and different scenarios that start at the same exact starting point which is really interesting because it means that these AI agents in the games can explore different worlds and different realities all starting from the same point so this is something that I find to be truly fascinating because it allows everyone to experience different realities but also allows the AI to get a better world model now the next thing that I'm going to discuss is probably the most crazy this is where we actually have one of the most incredible things this is what they call long-term memory now the reason that this is so important for AI generated games is because the games are generated on the Fly meaning that you need to essentially generate things as they happen and it's not an actual game engine which means that there's no base level of code or physical renderings now this is a tricky problem in generative AI but somehow Google have managed to solve this to the point where if you look One Direction and then you look back in the same direction the same elements and objects still remain now this is pretty crazy because a lot of individuals have played an AI generated game before and I'm going to show you guys exactly what I mean what problem exists and how Google have done something absolutely incredible so take a look at this gameplay which is AI generated Minecraft and I'm going to show you guys when I play this AI generated game what changes so I want you guys to quickly take a look at this game play this is AI generated Minecraft and you can see that right now this game play is being generated step by step but something crazy is going to happen when I look down and I look at a different environment when I look up again you can see that the area has changed this mountain spawned in out of nowhere and if I look down again and then I look up again you're going to see that the entire environment has once again changed that mountain disappeared and I can do this several different times to generate completely strange wonderful and random environments which is why long-term memory is needed next what we have that is super interesting is the fact that this model gen2 actually generates plausible content on the Fly and maintains a consistent world for up to a minute so I think this one here is pretty incredible because not only in this demo are we seeing the character have different abilities and different spells depending on what kind of game this is but we can literally see this character run around jump and explore

### [5:00](https://www.youtube.com/watch?v=HoOFpHJeV0A&t=300s) Segment 2 (05:00 - 10:00)

for up to an entire minute now it might not seem that impressive to people who aren't in the AI space but for those of you who have been in this space for quite some time you'll know that this is remarkably impressive when it comes to generating a coherent scene for this long I mean being able to run around this environment is just absolutely incredible and I think something that a lot of us in the AI Community are constantly thinking at this moment in time is that if this is the worst these models will ever look when it comes to AI generated games we can only imagine playing for hours and hours in AI generated worlds in the future this kind of thing definitely opens up the creative area for those of you who want to explore different things and for those of you who are super creative Google actually also talk about how you also have diverse environments they talk about how Genie 2 can create different perspectives such as a firstperson view which we've seen before which is of course really cool but one of the coolest things is that you can also generate third person views like if you're in a driving video game for those of you who are familiar with those games you'll know that you sit above the car right behind the car and you get the POV as if you're looking over the car in order to drive that car a very thrilling and really good camera POV but we can also see is that you can also get isometric views which is really cool for those explore games where you want to explore with a character now they also talk about how genie2 learned to create complex 3D visual scenes and we can see that in this game a user is running around well not running around but walking around and looking at this Mecha Robot and then walking right underneath that robot to examine the 3D structure now one of the coolest things about this environment a lot of people would be asking is whether or not you actually can interact with this environment and one of the things you can do is of course interact so you can see right here that this character is jumping and is actually popping the balloons in the environment which is really cool and you can see the buttons being pressed actually showcase that jumping and of course attacking are things that the character is doing once again we also manag to see another character that shoots a barrel and it actually explodes which is you know if you are a gamer you'll know that is exactly what happens when you shoot those red barrels and you can see as well that this user is able to go into this place where they're literally able to open a door and enter a new environment which is truly stunning when me take a look at what this means for the future of gaming the next thing they actually talk about is character animation so you can see that Genie here is able to animate this character jumping it's also here that seems to be some kind of Mecca or some kind of you know robot character that is walking that would have essentially a different level of walk animation now you can also see that when this character manages to try and climb the ladder you can see that this animation of them climbing the ladder is also done really well as well which is super fascinating because it shows us that the model is able to generate a vast different amount of characters and also understand that different characters move in different ways next what we do have is we have NPC so it actually talks about how you can interact with other agents in game and even have complex interactions with them my favorite is this one where you can see this user that interacts with this pink fluffy character and then manages to you know I guess you could say shoot this character slice the character or do something along those lines and the character just unfortunately disappears you can see in this other example a user goes in the cave and there's is able to walk around with another character that seemingly is in there which is really interesting and then we have this last one which is like this Assassin's Creed or Red Dead Redemption style game where you're running around with another character that is seemingly following you on your adventures which is pretty interesting because these are some really interesting AI generated games now what we actually see next here is how Genie 2 manages to model the physics of these games so right here we can see a boat that is turning drifting and we can see that the water physics that is in the game is remarkably accurate for such a short clip so this is something that is really interesting because a lot of the times one of the hardest problems for these generative AI engines is to manage the physics correctly so for these physical games it's of course going to be something that's really important as the characters are going to have to interact with the objects in the world and of course ensure that whatever it is that they're interacting with whether it be a tree a rock you know or for example some water it's going to have to model that physics in an way so another thing that we do take a look at when it comes to physics is the smoke simulation so for those of you guys that do play games you'll know that the atmosphere is really important for ensuring a great gaming experience and right here we can see that the smoke physics is something that is quite accurately represented even though it's in the background of the image we also do have gravity here which is a vital Factor when determining how a game works because if you don't have gravity things aren't going to work properly and you can see that with this car driving around on this Cliffside Edge and it manages to drive off the

### [10:00](https://www.youtube.com/watch?v=HoOFpHJeV0A&t=600s) Segment 3 (10:00 - 13:00)

cliff we can see that it instantly starts to plummet to its death where it remains and then of course manages to drive on we also have lighting which is remarkable genuinely remarkable because this is something that is pretty hard to do even by video game standards with current render engines and we're seeing that this is something that currently works even in these AI generated games I'm genuinely not sure how it does but it is something that seems to be working now what's crazy about all of this is that we have reflections actually working now I'm not sure it's going to look like those insane RTX Graphics videos but the fact that we do have Reflections in mirrors and Reflections in the street puddles is something that is absolutely incredible some game engines even struggle to you know accurately model this kind of thing so the fact that this AI generated game engine G2 is actually a little bit more advanced than we would have initially thought considering just how hard it is to get accurate Reflections to be done well so another thing that they actually show us with gen2 is that this allows you to rapidly prototype new generative experiences so you can actually prompt genie2 with different images generated by Google's AI image model and then you can see how Genie is able to navigate these different avatars we saw the playing one we can also see this Dragon one here where we see that it's actually able to get the correct dragon that is flapping its wings we can also see in other examples for example let's say we wanted to do a game about an eagle we could potentially use genie2 to develop many different ideas and prototypes rapidly and quickly without of course doing the investment of making the game essentially what they're stating here is that in the future when maybe you've got Genie 4 or Genie 5 you're going to be able to Simply use an image and then from that image you're going to be able to test if the experience is worthwhile exploring as a video game or as whatever it is that you want to explore something that I think makes sense now you can also use images like Concepts art and then also step into those and explore those as Real Time games so this is something that is absolutely incredible because this is something that means that this model has outof distribution generalization capabilities which is completely incredible because most models don't have this which basically just is a fancy way of stating that look this model can perform well on tasks that it wasn't specifically trained on now we also have something interesting which is where they talk about using these agents for games so you can see you have this image and then they prompted it to walk through the blue door to see what it could find and then shortly after that they also prompted their AI agen SEMA to use the controls and go through the red door which was really cool and then they also had some outtakes which is where we get these this character actually prefers to parkour over snowboarding which is pretty hilarious cuz sometimes these characters don't do what you want them to do and then we also got the outtake of where while not taking any action a random ghost appeared in the garden which is pretty funny or pretty scary depending on what you believe so I think overall this is something that is remarkably fascinating and it's really interesting regarding the future of video games I know many people have speculated whether or not we're going to be exploring completely AI generated worlds in the future and I think genie2 shows us that there is a real path to that level of exploration and I really can't wait for Google to cook up something next

---
*Источник: https://ekstraktznaniy.ru/video/13628*