True AI Video is FINALLY Here & More AI Use Cases

so many AI announcements came out recently but most of them are not usable which is tough for this show because today it's Friday and yet again we're focusing on all the AI news that you can actually use and this week has been AI video week but hold up even if you're not interested in video production this topic is significant for everybody because these video generators are heading towards a future where they're not just video generators but World simulators this is at least the vision of some companies like Runway with their gen free model that was announced this week that we'll talk about today but there's also brand new things like uploading videos without audio and it just autog generates it for you and we have a brand new anthropic llm that apparently is dethroning GPT 40 and it's also freely accessible the fight is on so let's look at all that and more in this week's episode of AI news that you can use starting with Sonet 3. 5 and Fric

GPT 40 competitor and this is quite a large topic especially because they introduced this feature called artifacts where it doesn't just write code anymore it also runs it inside of an extra window in the interface for you things like this have been announced before but no production ready ones have been shipped to Consumers like you and me this changed today Claud Sonet 3. 5 is not just an announcement it is available today for free so rather than trying to speedrun through all the different interesting details here and there's quite a few I created a dedicated video for this that you can find on the channel I'll link it in a card up here it should be available by the time this video goes out and I'm just quickly show you a preview in two prompts like generate a portfolio website for a designer and make it more aesthetic it doesn't just create the code it creates this life preview in here with little animations you can click all the buttons this is interactive this works and you could build custom games in here it can even generate sound effects for you in here it is a wild capability and this model is available for free again you can find a dedicated video just on this topic on the channel but these are the first Sparks of this agentic future that we're talking about so often it's not just about assisting you but actually doing the tasks for you absolutely loving that development and now let's

move on to the next one which is Gen free the big announcement of this week and look this is news you can use they usually only feature tools that you can put to work today and as of the recording of this video on 20th of June 2024 runway's new video generation model gen free is not available yet but I really do feel like we do have to talk about it here because it relates to all the other tools we'll be covering this week so all the announcements here happened three days ago and they did promised this would be releasing to the public in the following days and we took the opportunity here to show you some practical examples what these develop ments and what this Leap Forward actually looks like in practice because with all the examples they shared they also shared the prompt so to clearly show you how quickly the space is moving we took all of these prompts we ran them through their previous video generator model Runway Gen 2 and then we compared Gen 2 and gen 3 so here's one of the example videos you might have seen this obviously impressive temporal consistency on the character plus the background isn't funky there just looks real and this is what the exact same prompt would look like with their previous model are you serious night and day and this is why people get so excited about this stuff because it's crossing a threshold where this stuff is becoming usable few more gen two to gen 3 comparisons here for you this right here is the following prompt inside of gen 3 and then we have the same thing inside of Gen 2 another Runway gen free example compared to what you would get in Gen 2 stunning and realistic versus probably not usable one last one and this really shows why people are saying this is almost at Sora level it's comparable it's a world generation machine where you can speak scenes into existence right and then here again the same prompt in the previous model a big nothing burger all right but I can already hear it eigor but this is not usable yet well as they said days it will be soon I hope but what is usable today is Luma lab's

dream machine that we talked about last week and last week it released all of this is brand new when it comes to Consumer technology so people are taking their time to figure out what to actually use this for and here are a few examples we found across the internet one of them would be these fashion ads so you might have seen this with MJ Journey before where people generate really extravagant and Avant guard fashion designs that would probably not be feasible here they're doing the same but with video but to be fair that's a bit of a playful approach and probably not the real world use case that people are looking for but the second one really shows the potential of these tools because here it has been used to create a little documentary all the shots that you can see in here the Drone shots they're not real recordings they haven't been licensed they have been generated and if some of these shots would show up in the middle of any Netflix documentary you or me we probably couldn't tell if we're not paying close attention and again as mentioned all of these are created with Luma laabs dream machine so it's freely accessible and you can use that today to recreate some of these shots you have around 20 generations for free at the time of this recording but there's more and this is a fun one people have just been animating memes and it turns out that this is actually one of the best capabilities with a dream machine if you give it a picture not the meme generation but the fact that you can give it a picture and that it will turn it into a video there's a lot of context within the picture right so you don't have to do intricate prompting it will just bring it to life and it works quite well I mean some of these are legitimately good enough that they could be real videos and then obviously there's also this idea of creating entire movies and people have been attempting that too now arguably character consistency is not there yet so from scene to scene the character will look a little different which makes this entire idea kind of unfeasible right now nevertheless I want to share this with you as you do have to account for the speed at which the space is developing I mean remember what we just talked about we went from this scene to this scene within just one year and it doesn't end there the possibilities are actually quite deep some filmmakers are experimenting with this stuff and they're coming up with techniques like moving a camera around in the scene as you would with a steady cam but then because you can simulate anything they can just make that steady cam fly as if it would transition to a drone shot but all of this stuff would have been possible yesterday or a week ago but the budget you needed to create a scene that is comparable to this with VFX and traditional production would have been 10,000x higher than what this costs maybe even more because you have free credit so essentially it's free versus thousands of dollars if not tens of thousands of dollars to recreate something like this shot in real life sure it would look more real sh it would be probably more usable and yes I'm not even accounting for permits and to round the segment on Luma La use cases out I want to point out that they already announced some new features which are going to be essential because right now it's only text to video or image to video but what they announced here is editability so you can alter the subject style selectively you don't have to redo the entire shot which is essential and while this is great over time I expect something like runways Gen 2 capabilities which are currently most advanced in the entire industry when it comes to Consumer products to ship to all of these tools including dream machine Eng gen free once we get our hands on it if you're not familiar Runway has been adding tool after tool and there are just so many ways to alter the video that you generate they have video to video background removal they have brushes where you can selectively change or animate only a certain part of the scene and then they even added multiple brushes so you can do that to different parts so with some of these improved generators plus their tooling you're going to be able to dial in a lot of details on these very capable models which is something that has been Unthinkable a few weeks ago because the base models were just not that good but let's be real the things that these models really excel at from what we see here across genre Sora and dream machine is these experimental and creative use cases hyperrealism might be the Holy Grail because then you can do film like narratives but for anybody willing to experiment with these World Generation capabilities I mean this is a brand new idea this is something we didn't have before you couldn't just type in a few words and make them materialize in form of a video on your screen before if you're willing to experiment with that stuff this is an incredible time to be alive oh and little human side note if I look a little tired it's because I am my neighbors have been reconstr distracting for the past 5 weeks waking me up every single day and I can record a stream during the day so I do it at night but then they wake me up again it's a bit of a mess but it won't stop me from delivering you all these new AI tools that you could be using today with a glimpse of the future

sprinkled in here and there okay on to the next one all right so the next thing I want to show you here is a suite of completely free AI tools and they also happen to be the sponsor of today's video corsel so if you look at my screen here this is a suite of generative AI tools that you can all use in your browser and they offer an API so all of this could be built into other interfaces or applications that you might have let's look at these web apps here cuz there's quite a bit here and as I mentioned all of these are free to use you can even check out more of them here under apps so first things first quite simple but very effective is this chat interface where you can switch between various models so you can be using the advantages of GPT 4 like its expansive World Knowledge to generate answers in here or you could switch to other models here like claf free Opus from its unique ability to write in a tone that is just different from GPT 40 you can also set the system prompt down here or use some of the these open source models but where this gets interesting is that you have multiple capabilities in one right you're not limited to D free when it comes to image generation you can just switch on over to the image chat and you already know what's coming here we're going to do a classic cat with a hat and see what this comes up with by default and the generation speed realism and editability of these is just far superior what you get inside of chat GPT by default again all in one interface but if you want to unlock most of that you'll have to head on over to the image Studio which again is just one click away so we'll just rerun our prompt here and in real time you can see this generating and you can already see the model it's using here it gives you choices right so this is the standard one of Pros but there's multiple ones here if you're looking for realism you might want to use dream shaper for example and as you can see there's many other options here like number of images what aspect ratio you want it in or we even have the ability to do generative expand or in painting no need to roundr to photoshop or other tools I can just drag my cat in here I wanted to expand it like so and there you go it expanded the image no problem same thing goes for in painting super simple I'll just roughly draw around the hat and then let's give the cat a giant Mexican sombrero just cuz I feel like that would look great on her yep turns out I was right you can see that it maintains the style so it fits the image here before after and this actually just scratches the surface there's many more like a avatar tool where you can upload your own images and generate custom avatars from it or this character chat where you can talk to some of your favorite characters and even a prompting trainer where you need to guess what the prompt here is and then you can compare the results as I mentioned all of this is freely available plus there's specialty is that all of these tools can be easily included by an API to an existing application might already have I just go to API say add API key and then I can add functionality like inpainting to existing app so if you want to try out any one of these tools it's the first link in the description thanks again to Corel for sponsoring this video and making This Magnificent cat happen and now let's move on to the next piece of AI news you can use all right

next up we have Google Labs gen type and this actually came out around 10 days ago but hey if we miss a tool and it is cool enough to be featured you can be sure that if you follow this show and this show only we will catch you up on the tools that we might have missed and this is one of those and look it might not be relevant for most people but I thought it was interesting enough to feature this is one of Google Labs experiments as I mentioned before I'm a big fan of the labs experiments a lot of fun stuff in here and what you can do in here you can generate custom fonts so I'll type in news you can use in here and hit generate and it's going to create a custom font for me for news you can use this thing is completely free all I needed to do is log in with my Google account and look at that it's creating a fully custom alphabet for me could download all of these now the obvious feature that is sort of missing here is the background removal so I could start using this inside of my video or Graphics you still have to do that manually but we featured many background removal tools in past episodes of news you can use or you just do it the good old fashioned way in Photoshop where you cut all of them out I barely finished my point and most of these images generated already I have a fully custom alphabet here that I can type in right here how cool is this excellent I'll just save this as a PNG and look at what I just created in under a minute with AI this is the type of stuff that makes me show up every single day research these tools and while we'll keep doing this one in particular is not replacing creativity it's enhancing it back in my commercial andc corporate video production days I would have absolutely loved this I would have created custom fonts for most of my projects depending on the client's needs or more of an everyday use case would be using this to communicate messages to loved ones look you just type happy birthday and maybe you generate alphabet of something else than newspapers nevertheless a fantastic little tool that you can try today okay and next up

we have Leonardo updates Leonardo that we also talked about before is this all-encompassing Suite of various AI image generation tools I think their mission is to be the Photoshop of AI image generation but you can have all the tools in the world if the base model is not good and this new model is not just good it's actually great it's called Phoenix the main features are prompt adherence meaning if you type something in it's actually going to listen and not ignore parts of it which is not the case with every image generator the texted image is coherent let me tell you from the testing that I'm about to show you I would actually call it perfect and a few more changes under the hood but what really matters here are the results and I'm excited to announced that actually have some real results here because we made a big change for news you can use this week we're upgrading our workflow with multiple testers because I usually cover these tools and I play around with them but I don't get to spend four hours playing with Leonardo if I had to do that for every single tool I couldn't bring out an episode once a week but with thei Advantage Community being a thing and with thei Advantage team being 10 people strong we can do things like send out Dominique or mid Journey lecture and wizard within the community by the way here is his Instagram Channel if you want to follow what he's up to with his ma Journey creations and Dom actually spent half of a day testing this and report it back with these results so first things first let's talk about the new prompt enhancement feature because this new model really unleashes its abilities if the prompt is Well written now this can be a little tricky as it takes some skill and effort so here are all the details that Dom ran in here on one side prompt enhancement off on the other side prompt enhancement on you can see the new prompt that it wrote instead of a cat in a fancy suit it really fleshed it out and here are the results much better so it's not just better model but it's also more usable plus it actually adheres to what is said in this prompt if you look at the details of it but the big question is how does this compare to Leonardo's previous Flagship model which was their Vision XEL model well here on one side you have Vision XL on the other side Phoenix same prompt I think it is quite easy to argue that Phoenix is better in most ways the proportions of the head are right the details are better and the texture in the fur aligns with the texture on the suits whereas with vision Xcel it looks like a bit of a collage of multiple things I like it okay next up the text generation abilities once with prompt enhancement off and one with on and as you can see this text is sort of perfect especially the this one side with the promp enhancement offs and it's way better and needs no editing look at that all four of these are actually perfect when it comes to the text it's a great tool to create stickers or other marketing materials and then again if we compare this to the older model we just see more consistent results and if you want to apply tools like this to business use cases that's exactly what you're looking for all right so that's a

lot of different creative tools Right image generators video generators we're going to talk about audio generators in a second here but what do you even use this for in practice or how do you even practice well I'm happy to show you one of the most interesting unique High efforts and fully AI generated things that we've ever done in the community we hosted a super challenge where we challenged all of our members to create fully AI generated music videos all the way from songs to the visuals and I wanted to take a second to feature the winners here the winner got free months of free membership so yeah now we have a mechanism within the community how if you participate and if you're active you get at least one chance per week to win a free membership so here's the winner stavos and what he created is a music video and listen to this based on a scholarly article investigating the speed of squid color changeability Yes you heard me right a scholarly article about squids turned into a music video roll the video okay I guess I'm learning something I mean let's be real there's no way you've SE something like this before love the uniqueness congrats again to him for winning here two more quick examples from the competition our very own no code automation teacher Phillip created this music video yes and then one more which is a bit more melancholic and storytelling driven Shadow the we hold on so there you go I just really wanted to share this with you so much creativity with some of these and I just love to see it when we get tools like this you get the choice you get to complain how AI is going to destroy creativity and there's nothing we can do about that anyway or you get to embrace it and create things that have never been done before to each their own but as you know I'm in the ladder Camp all

right so for the last piece of AI news you can use this week we have 11 Labs video sound effects which also comes with an API and it's exactly what it sounds like you upload a video with no sound and it generates a sound effects now something similar has been announced by Google's deep mind but it's not accessible so we won't be extensively covering it here essentially it's their video generator that also does audio that is coming soon I guess pretty great considering we're just getting started in the sound from video generation department but this 11 La stol you can actually use they have a dedicated URL for it vide to sound effects. com as per usual all links mentioned here are in the description below but let's just go ahead and upload something how about I record with my phone and then I'll just do this without actually touching so there's no sound let's see how this goes all right uploading the video and let's see what we got here okay so no sound effect as you can see what it obviously seems to be doing here is analyzing the image for anything that it can see so it can see the keyboard the computer the screen and it's generating keystroke sound effects plus some background Folly of electronic static bit of a shame that we didn't get the sound effect but if you need sound design for scene kickstarting your project with what it did here in these four different Generations is actually very useful although not 100% complete plus as mentioned they released an API for this so you can build this into other applications include this in workflows with a little bit of code you could strink together a pipeline where reg generate images with something like Leonardo then you turn them into videos with something like dream machine or gen free and with video to sound effects you add the sound in and you could create automated music videos explainers documentaries maybe sprinkle in a little bit of haen virtual presenter and use all of this as b-roll and you have a complete YouTube video I suppose now sure none of these are fully there yet but as you can clearly see we're progressing week by week and I'll be around to cover it all I hope you enjoyed this video summer is starting so I'm finally visiting my family and taking a few days off but don't be afraid there's going to be a new video every single Friday because companies keep releasing new apps people keep coming up with new use cases and I'm here every Friday to cover them for you all right I hope you have a good one see you soon