# Googles Latest Breakthrough is HERE! (Unbounded AI) Generative Worlds

## Метаданные

- **Канал:** TheAIGRID
- **YouTube:** https://www.youtube.com/watch?v=idb7X2bJFDA
- **Дата:** 09.11.2024
- **Длительность:** 10:56
- **Просмотры:** 17,012
- **Источник:** https://ekstraktznaniy.ru/video/13775

## Описание

Prepare for AGI with me - https://www.skool.com/postagiprepardness 
🐤 Follow Me on Twitter https://twitter.com/TheAiGrid
🌐 Checkout My website - https://theaigrid.com/


Links From Todays Video:
https://generative-infinite-game.github.io

Welcome to my channel where i bring you the latest breakthroughs in AI. From deep learning to robotics, i cover it all. My videos offer valuable insights and perspectives that will expand your knowledge and understanding of this rapidly evolving field. Be sure to subscribe and stay updated on my latest videos.

Was there anything i missed?

(For Business Enquiries)  contact@theaigrid.com

#LLM #Largelanguagemodel #chatgpt
#AI
#ArtificialIntelligence
#MachineLearning
#DeepLearning
#NeuralNetworks
#Robotics
#DataScience

## Транскрипт

### Segment 1 (00:00 - 05:00) []

so Google have presented some really interesting research that regards generative AI games on this paper you can see that it shows Google presents unbounded a generative infinite game of character life simulation and this is basically the architecture that is needed to create fully AI generated games where you have an entire narrative story developed by the player who is able to control exactly what is going on in the story so I'm going to break down exactly how this works because a lot of the stuff here does seem quite rudimentary but with the way things are headed I wouldn't be surprised if within the next 2 years we have entirely AI generated worlds and games and trust me when you see the things that are in this video you're going to start to see why this is going to happen so most of you guys understand what traditional game engines Alik you can see that with traditional game engines there are essentially these rules and of course code pieces that are governing exactly how the game works there's engines behind the game formula there are of course codes physic there of course mechanics to how these games work now of course this is something that has been traditional in gaming for almost 20 years this is how gaming traditionally works and essentially what Google is aiming to do here is basically set the foundations for something that completely changes this entire reality and I wouldn't be surprised if this happens in the future because my oh my gaming is going to get a huge change in a variety of different ways so essentially we've actually seen something like this before if you guys have been part of the Gaming Community you'll probably remember this trailer from Game Spot that was essentially going to be an AI generated game now essentially what this was is this is pretty similar to what Google are trying to do here and you can see it says every bird every Trish every ocean every ruin every Star was procedural and basically this was a game trailer that was trying to have a game that every single world that you went to was completely AI generated so imagine you went to a star or a planet and as you went to that star or the planet it was able to design the ships all the elements it was able to design the kinds of things that are lurking in the shadows for you everything there was generated on the Fly just using llms to creatively generate that then of course because generative AI is working in so many different fields like text video I mean images sound all of those things can be used to create that entire reality and this is what the game tried to do 10 years ago and essentially of course this game no man's Sky didn't actually work unfortunately at the time but with current technology Google are basically saying that look this kind of thing is of course possible now one of the things that you need to do is you need to of course have custom character creation and basically remember how AI generated characters are a thing now like you can literally make any kind of character you can think of on Mid journey and you can customize that character in a variety of different ways you can adjust their you know head size face size these are the kind of things that we're basically going to be able to do in the future with certain games and we're going to have a ridiculous level of character control and consistency regarding that now one of the things that they wanted to do with this research was they wanted to maintain their character consistency so in this paper they talk about how they use a variety of different methods to actually maintain that style of character consistency and it's pretty cool because if you go on Mid Journey right now and you type in um consistent character consistent character a male a female redhead uh Explorer you will literally get yourself you know a few images a bunch of different images that are all of the same character doing different poses different animation stances I mean it's really cool to see where the field already is with regards to character consistency so this is something that I thought was really cool and this is essentially one major part of this because when you're generating the real- time game you actually need to ensure that your character is consistent one of thing that you're going to be doing here is if you have a fully generated game like not just the character is consistent you'll actually have something that is pretty incredible so if it's not just the character you're going to need to ensure that if you're generating every frame with your generative AI tool you're going to have to make sure that the character does remain consistent and this is what they aim to do with their software so another thing that they also do is they also make sure that the environment that gets generated is remarkably consistent so I actually generated my own character in chat GPT and you can see here this is a very basic example so if you go into chat GPT or GPT 40 right now and you prompt the AI system to do anything like let's say for example you say give me a screenshot from a video game of a certain character you can describe the character as looking like yourself looking like a random person I used the prompt give me a picture of a random video game character with a HUD with health bars and stamina bars and this is the image that came up and what I did then is I then used some other generative AI tools to be able to do something really cool so what I did was I took my character I took the health bars and the statistics and then I used that to then generate other environments so I generated environment that was you can see in some kind of I guess you could say green land that looked really cool really playful I

### Segment 2 (05:00 - 10:00) [5:00]

then generated that again and did that for um I guess you could say some kind of Tropical Paradise but once you see that look you can have your character roaming in many different environments across many different places you can see right here that this is going to be something that a lot of people are going to have so much fun with I mean imagine creating your character and you're able to literally control where it goes you're able to walk around and say okay go to this environment okay let's go to the tree Dimension uh tropical forest Dimension okay let's see if you what happens if you eat this what happens if your character eats that I mean it's going to be really cool now of course remember how before I talked about of course how they ensured character consistency Google has a new method because other people have tried this with other methods and there's a little bit of a problem with their method so you can see right here the character the environment and the semantic alignment basically environment consistency just maintains that the environment that they're in actually remains consistent with what it is that you're describing character consistency this is essentially where of course the character that you've got you know whatever image of or character that you generate in the first instance that character is going to be completely maintained and then of course semantic alignment basically means prompt adherence so if you do state something really well it makes sure that it manages to capture the entire essence of your prompt one of the worst things that does happen is when you input a prompt into chat GPT and it doesn't efficiently get what you're trying to communicate so with that they have developed their own unique system so you can see their's manages to capture every single essence of the AI generated world now they actually made some unique advances in AI as well so one of the things they actually spoke about was the fact that they managed to distill a large language model so the process of distillation is basically where you make a smaller llm a lot smarter from a big llm so it's quite like diluting juice but it still tastes pretty decent so essentially what they did was they used two llms to play the game together one llm acts as a player the other one acts as the game master and they recorded 5,000 different gameplay scenarios from GPT 40 and basically they use that distilled llm and they actually perform very well when you compare them to Big llm so it was trained on 5,000 recorded gameplay sessions and of those 5,000 different gameplay scenarios they managed to really drive down home exactly how well this should work into that large language model so they used GPT 4 and now the model is basically as good as GPT 4 which is pretty insane now crazily okay I remember I was always thinking to myself why are Google building out these really small models and for those of you who don't know what I'm talking about most people aren't up to date with Google's AI news just because they aren't like right now in terms of the height cycle one of the major players but they've actually been developing this model called Gemma 2 and it's a two billion parameter large language model and this one is currently better than GPT 3. 5 llama 2 Mixr and a bunch of other llms but this one is super small and it's able to perform really effectively and they managed to distill all of the characteristics that a larger model would get and of course the reason why they did this is because if you actually want to interact with an AI model you need to be able to do that with something that actually has decent latency so you can see right here that this is arguably one of the smallest models you can see compared to you know llama 270b this is a 2 billion pret large language model and you can see just how crazy the chatbot Arena ELO is so Google are really hammering down on these AI systems that can perform really well with these small Edge use cases that allow for real-time user experiences and essentially This Is How They manag to get this game working in real time I'm going to show you something after this that's really cool that I think you guys should definitely experiment with because it does show you where we're headed so this is basically how the environment kind of you know works I guess this diagram is a little bit distracting in the sense that like everything is just on one page but this is basically where they manage to track the health user through many different environments and this is going to be something that's in real time so essentially you could say to the user okay there's something over there why don't you go ahead and explore that why don't you find a shop here why don't you rest why don't you have some food yada yada and basically you can see right here that with all of these instructions different things with all of these you know game environment Generations these are going to be the things that we have in the future now I personally wanted to test something like this I know it's not exactly like this but I do think it's going to show you guys exactly what the future holds us for when we're exploring AI generated worlds so no this isn't any kind of sponsor but if you've ever played around with a real-time AI generator you'll know that this stuff is remarkably fun so let's say I say a man in a suit but cartoon let me do cartoon character Okay cartoon character uh and let's say he's uh on the sofa eating pizza okay like this is the kind of thing that you could do when you have real time uh AI generated stuff let's say he's eating uh you know noodles okay we can make him eat some noodles instead uh uh rice rice we can make him eat some let's see if this guy wants to eat some chicken instead okay he's eating some chicken I guess he kind of that looks like a

### Segment 3 (10:00 - 10:00) [10:00]

chicken okay we could say a man on a suit uh fat man in a suit now that he's ate all of that chicken I mean um I don't it's probably isn't the best kind of uh you know way to demonstrate this but imagine you are having this kind of game where literally the possibilities are endless I know that you know some people do want to follow a storyline and a narrative of things that you're supposed to do but I mean when you think about the future of open World Games you're going to be able to do you know let's say a man is on the sofa let's say you know this guy instead of fat he becomes a fit man okay on the sofa I mean eating chicken now or I could even put maybe not fit I could put um muscular man but yeah this kind of thing is absolutely crazy when you have a variety of different ways that you can explore your creativity in Ai and I think it's going to be super interesting to see how video games manage to incorporate this into their future releases so it will be interesting to see the first game that does this and I do think that whatever first games managed to you know allow you to explore these different characters