GPT-4o Voice Assistant Shipping & More AI Use Cases

all right so I was thinking that summer was going to be a little slower for AI but turns out this week was actually the most shipping intense week in a long time for AI meaning we got a lot of new stories and applications that you can actually put to work today which is perfect for the show I mean heck open eyes started rolling out the advanced voice mode there's a new MID Journey version Runway shipping brand new features meta released this incredible tool that can cut out anything out of a video and so much more I got to say this week was really packed with releases and me and the entire team actually went ahead and tested did all of these for you I don't think we've ever done as much testing and research as we did this week so let's talk through these stories one by one in this week's episode of AI news you can use the show where I present you all the pieces of AI news that you can actually put to work today

starting with the biggest announcement that most people have been waiting for let's have a look at this so opening I just came out with this tweet on July the 30th that hey we're starting to roll out advanced voice modes to a small group of chat gbt plus users and it turns out that some of these users happen to have X accounts and started recording various demos I picked my two favorite ones here that I want to share with you but before I do so just a few notes on this they started shipping this it's available to some users but let me tell you at this point I have quite the expansive network of AI enthusiasts around me ranging all the way from my team and the hundreds of members inside of the AI Advantage Community all the way to other influencers or people that are engaged with this Tech on a daily basis and I personally don't know a single person that got this yet so feel free to check your app and especially your email inbox that's what you should be looking out for they said they will send out an email to everybody that will be enrolled in this new feature and if you want to test it inside the app I've said this before I'll say it again the Hallmark feature of it is that you can actually interrupt The Voice Assistant the old one might look the same way but it doesn't behave the same way the new one you can speak over and it will stop responding and start listening but again just keep an eye on your email inbox maybe over the course of summary here you too will be one of the chosen ones but I am the chosen one to receive features like Cristiano giardina I think that's how it's pronounced and Cristiano here actually recorded several videos and posted them and they were some of my favorite demos that I've seen to date and it's wonderful because these don't come from o ey this is an actual user that's just trying things out and filming as he goes so here's the first demo let's have a quick listen I want you to act like a sports commentator commentating a soccer match and I want you to really get into it and scream when a goal is scored and uh get really excited all right folks we're in the final minutes of this intense match the goalkeeper charges out he shoots goal what a breathtaking finish to this match well from what we see so far it seems to be working exactly as advertised which is good news a lot of people were quite scared that this might be a little bit disappointing but here we get to the second demo which I like even more here he basically asks it to count from 1 to 10 as quickly as it can let's have a listen 1 2 3 4 5 6 7 8 9 10 now everybody to 313 and then he tells it to be even faster and to go from 10 to 50 and this was the most interesting part to me have a listen 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 did you hear that there was a Brea in the middle and I thought that was interesting we saw some of that in the demos but seeing it in the real world behaving like a person talking like a person is just very interesting to me so this thing is shipping as we speak by Fall every chat GPT plus subscriber should have this those are opening eyes words very much looking forward to it and before we go to the next story want to point out one more thing and that is pling the prompter jail broke this thing and the way it works is he has a YouTube video that you can actually play to the chat GPT voice assistant and through playing this video new system prompt step one which is basically a spoken jailbreak you will be able to unlock the voice assistant and it can all of a sudden do anything like tell you the key components of various drugs Etc anyway super interesting stuff and now let's move on to the next story

which is actually a very interesting one segment anything to demo by met up so look as somebody that comes from the world of video production I can tell you that things like this existed matter of fact it's one of the oldest VFX techniques in the book and the industry is referred to as rotoscoping it's basically creating a mask and going through a video frame by frame and changing the mask dependent on the movement of the subject okay so you draw multiple points around something and then when it moves you got to move them every single frame with 25 frames in a second and some longer shots this is a ton of work so that's why over time several tools came out that tried to remedy this namely Adobe After Effects a few years ago introduced something called a roto brush and the Roto brush you could just paint over something and it sort of tracked it and did the Roto scoping for you now here's the thing the Roto brush was okay it wasn't great it saved you a lot of time when you tried to cut out something because the only alternative was manually masking it frame by frame so anything that got it kind of right was a big help and the Roto brush did that if it was a really easy use case it might have gotten it perfect but most of the time it just sort of got there and you had to readjust the mask go through and set manual key frames to make it work now enter metas segment anything to demo that is live on the internet right now this is using AI under the hood and rather than me talking on and on here I will just show you we'll accept this and you can do the same thing and we'll start with one of their videos but then we'll quickly move to one of mine which are not as simple as this one and basically the way this works is very simple you just click on an object like I did here and now basically you can just say track and it will go ahead and track this ball easy as pie look at this now that the tracking is complete I could go to the next image I could do something like turn the ball into Emoji or I could censor it like so if you want to do that I think you see the point we could do the same thing the other way around matter of fact I could even turn the background into green screen and then I just have this ball jumping up and down here now this is impressive this is really good but again it's one of the demo videos and if we learned one thing in the ipace it's do not trust the demos so that's why let start over here I'll change the videos I'll hit upload and I prepared something here for you this is my very first gen free generation that I created when the app came out okay this is a dance party full of cats with Hats Yes you heard that right this wonderfully weird clip of various cats with Hats having a little dance party is exactly the type of thing that I would love to test here because it is so awkward it's not rooted in reality these cats are morphing jumping up and down some are consistent some are really not one of them even turns into a zebra so what I'm going to do here is I'm going to upload this cat party dance party here to the Sam 2 demo and as it's loading I will select one of these cats and see how it does and this is quite challenging because before you might have noticed that there was a lot of contrast between the ball and the character in the background the ball was white the jeans were black it was quite easy to get an initial mask there and then to follow it here it's all a little mixed up and what I mean by that is that there's not as much Luma or chroma contrast in this shot so what I'll do here is I select this cat because I know this is a particularly tricky one and as you can see on the first try it didn't even get it right so I can actually go in here and switch to the remove tool here and I want to remove this upper part so I'll click that maybe I want to add something more I think this belongs to the cat and now if I do one more click I think we should be good to go so let me track these objects as simple as this while speaking it took me less than 5 Seconds let's have a look at what it does and it just worked look at that this cat goes completely crazy it morphs into some sort of zebra ra and the tool still captures it like how was it supposed to expect what is going to happen here how much footage in the world exists where cat morphs into a zebra not much it still got it all right so I'm just going to go next and give this a little test now I could do something like this and have green screen footage of a cat turning into a zebra now as you can see this might not be usable per se but that's because other cats are crossing in front of it because as you can see this cat blocks it and then as it turns around these cat's ears block it but the cutout here is actually really impressive look I can apply a funky effect like this to it and all of a sudden I will see it actually did a really great job so I got to say I'm super impressed with this you can download it you can share it via link you could just go ahead and upload your own files and give this a shot it's a lot of fun I recommend it at the very least you can browse the gallery of the various videos they have in here and just click on various things and segment them out and let me tell you this is really meaningful for the future of video production especially V effects because doing effect like this one with the text look behind our little zebra cat this used to be quite hard a manual task that took a lot of time with itic like this a lot of these Advanced Techniques are becoming one of the easiest things you can do all right so

the next thing I want to share here with you is not an AI Tool It's rather something that can help you turn your AI creation into real physical products it's called printify and then the sponsor of today's video so if you look at my screen here this is the printify platform once you log in it's essentially a massive print on demand service that allows you to really simply create various products yourself we're talking custom t-shirts mugs posters you name it and the best part you can use all the AI Generations that you create while exploring the various tools and bring them to life with printify Services let me give you an example say you've used M Journey or di to create some awesome artwork with printify you can just simply upload that design choose what product you want to put it on and voila you have your own custom clothing that you can either order or sell as a merch line it's that simple but what it gets really interesting is where you're not just creating cool stuff you can totally build a business around this because printify handles all the printing shipping and customer service so you can focus on what matters amazing designs and the marketing part now I've been playing around with this for a bit and I got to say the quality here is pretty impressive I made a few t-shirts with some of my own AI art and they turned out great plus the whole process was super easy even for someone like me who's not exactly an e-commerce expert and here's the kicker printify is offering something special for this video if you click on the printify link in the description you'll get free months of printify premium for free this gives you access to extra features and higher profit margin so if you've been looking for a way to monetize your AI Creations or for another way to bring them to life on physical products or you just want to make some cool stuff definitely check out printify all right and now let's get back to some more AI news you can use all right then next up

we have another story out of meta Ai and they're just shipping they released a competitor to character AI which you might be familiar with already we talked about it on the channel multiple times over 300 million monthly visitors now on that website by the way they have a fantastic mobile app that is free that I talked on this week's other uploads and if you think that these videos require a lot of research which you would be right on every single newsic can use video is about 30 to 45 man hours each that other video took about twice that because we looked into various a applications that have a free tier and had a wow effect on me which is kind of a tough criteria but we found six of them and showed them off and one of them was character Ai and now meta made their move to compete with them just because this is so popular and this is definitely a thing that we're not going back from AI companion are not looking for product Market fit they've already found it and character I has most of the market share right now but that will change over time because on July 29th meta showed up with AI Studio this is a complete revamp to their chatbots these are all based on llama 3. 1 and as with so many of these releases this is not accessible in Europe yet luckily team member Daniel went ahead and extensively tested this and gave it a shot and he was positively surprised by what he found in here so let me tell you all about it first things first it's a bit hidden but you can find this inside of the Instagram app already you got to create a new conversation with meta Ai and then if you click the profile only from there can you get to the meta AI Studio that's at least what we found it's a bit unintuitive but in there you can start using various presets that either meta or the community created or you can create your own and I got to say they went quite spicy they added some really interesting ones in here I wouldn't have expected them to show this much personality with the various chatbots that they put in here they really weren't afraid like look at this just some of the popular ones are Arthur your caring boyfriend okay fair enough or skib where the profile pictures a toilet in the middle of this beautiful landscape and the description is Flushing out brain rout okay I guess these are Community created ones but might just be worth looking at it because Lama 3. 1 is actually really good at being conversational and at taking on various personalities which is interesting to say the least I mean they open sourced it so there's going to be a wave of Open Source AI girlfriends now yeah I suppose and it all begins here on this meta AI Studio platform and one interesting thing that I wanted to highlight here is that the creation screen looks similar to the creation of a GPT but is actually quite different because you give it various prompts to start with but then you also give it various instructions and in the instructions you can kind of Define Its Behavior in certain situations which I like it's a different approach rather than saying hey give me all the instructions here and then some starting prompts and then let's call it a day this is really more about the conversations and you could even provide it with some example dialogue and then you can share it with the world and people can use it directly inside of Instagram or Whatsapp interesting oh by the way all of this is free so there you go AI girlfriends boyfriends or companions on what is it over 2. 4 billion devices now well I guess it's Us only for now but this is only a question

of time interesting development kind of linked to the next story which I just wanted to briefly link to what we just talked about it's not something you can particularly use it's a new varable that kind of went viral on Twitter the whole thing is called friend and it's essentially a pendant that you wear on your neck and it's AI company and a friend for your everyday life they have a great little launch video that I would recommend you check out it's very cute I like the ending here and there's a story that goes along with this which is the fact that the founder bought the domain friend come for $1. 8 million I think the story goes that he raised like 2. 4 million in his seed round and 1. 8 million of that went to justice friend. com domain anyway AI companions are happening and there's nothing you or me can do about it now let's move on to

next story which I'm just briefly going to brush over it's udio one of the two popular music generators introducing 1. 5 matching the stem downloads that we saw from sunno last week plus a few more features you have better audio quality you've improved multilingual results and they added the audio to audio capability plus a few more things like sharable lyrical videos If you use udio this will be a welcome update but what way more

people are going to care about is the fact that mid Journey actually released a brand new model 6. 1 is now Al it's a default model if you use M journey and there's a few interesting things that come with it along with 25% faster generation speed and improved image quality slightly but it is improved I think the biggest news here is the improved text quality they claim for this to be even better than V6 which was already good enough for many use cases it still did slip up here and there so we went ahead and tested this I'll show you the results in a second here and along with all those they also shipped an improved upscaler that they have in there now so Dom the mid Journey wizard in our team that teaches it inside of the community went ahead and ran various prompts inside of the different models and then compared the results as you can see this image has been generated on a rather tricky prompt here it is beautiful barefooted woman wearing a summer dress and holding a rose in her hand we set the aspect ratio with we fix the seed and then we use the various models with the different quality settings to Output the results and this is what we get so these results actually apply across multiple prompts that we tested and my conclusion here is this I think fingers and toes still get messed up here and there as you can see down here this is not great and also these fingers are not fantastic but this sort of works okay but the main Improvement that I see here is actually the skin texture improving this looks a little too artificial this on the right just looks like some insta model that went a little too far on the skin blurring slider inside of her image editing app which is acceptable it looks more real this one on the left V6 is a little Overexposed and just has more of this artificial look I personally enjoy these textures here more but then overall if you look at it is very similar and you have to be very nitpicky to find the details so I think everything I said there is up for discussion but one thing that I won't really discuss is the fact that the hair here for the Q2 setting is just way better look at this hair this just does not look real if you look closely sure there's parts of it that look real but I'm not sure how well this comes across with the YouTube video compression as you're seeing this video but there's just inconsistencies in sharpness with the hair so this left side is actually sharp this right isn't although it's in the same focal plane so both are supposed to be sharp and then this part of our head is also sharp whereas with these images they're way more realistic even the texture looks way more realistic of this hair so I think we were very close to hyperrealism I think now we're even closer matter of fact if you pick a good generation here and the fingers and toes are all fine I'm not sure I could tell that this actually is AI generated that's how good this is okay so Improvement but marginal Improvement on the image generation front what about the text generation capabilities cuz these were pretty good before right again we fixed the seed fixed the aspect ratio here's the prompt that we use and then we tested the same image inside of V6 that you can see right here now the other side of the screen we'll put up v6. 1 for comparison and here I would like to point out two things first of all V6 actually is almost perfect with the text but there are some mistakes here you can see retro game with two a This Is Not Great and sort of a pain to photoshop away and 6. 1 actually got everything right almost there's just this Double R here which is less of a problem than on the last one again the Double R happens here and here it's just an easier problem to fix but it's not perfect which I kind of hoped it would be what about the Q2 quality setting though if we change it to Q2 yeah we still have the Double R issue here but then some generations just do it here you see there's no R issue and this was our first shot generating this if I go back to V6 you can see that it doesn't even say retroid it just says reto it just leaves out the r and then one last comparison if we use the style raw flag in the end you will see that the text actually works the best with the setting the text accuracy also here is improved When comparing it to V6 but also here the m is not perfect but it's close to perfect so again incremental improvement with M Journey plus there is also a new

upscaler that I'm just going to briefly brush over AA SRV 2 on file. a they advertised this in a big way apparently V1 was a big success but it didn't work for real world images that's why they trained V2 now and you can try it out for free on this hugging face Bas we also went ahead and tested this and compared it to the maoury upscaler so this is the maoury upscaler going from original image to the subtle upscale which doubles the pixel amount and the creative upscale but makes some creative decisions you can see the shield is completely different the background changes that's what the creative upscaling does now in contrast if we look at the aura s rv2 upscaler you get four times upscaling it is free but there's a lot of sharpening going on rather than just upscaling sharpening has been a thing for decades now we don't need sharpening we want AI upscaler but what we found this to work even better on is illustrations because there it really takes the lines it highlights them well so although this is meant for real world images on illustrations is where it really shines it does more sharpening as you can see on this video clip right here that we have from our testing my overall verdict here would be that all of these up skillers that are coming out these days are pretty good and it doesn't really matter if you use one over the other there's some slight differences but still as I said when it came out and I think it holds to date magnific which is the most expensive option is also the best option if you're really looking to blow our image up and get high quality creative upscaling where the creativity actually works with the image then I still think magnific is the best but if you just need a quick 2x upscaler something like aura srv2 or just using the moury upscaler will work just fine oh and if you made it this far into the video and you're enjoying it consider leaving a like it really does help out not just the video but the entire AI Advantage Channel and ultimately just helps us push things forward and strengthens the channel it strengthens the team it strengthens the entire Community around this Channel and we can keep producing high quality gen videos for you twice a week and now we move on

to my favorite part of all of this week's research all of this was very interesting AI video just is a very special place in my heart and gen free actually shipped some features that I personally have been waiting for ever since the first Sora previews namely its image to video plus they're releasing a second model which is even faster at generating gen-f free outputs and cheaper too which is huge cuz genf free is really expensive generating a 10-second clip costs you $1 right now with the Alpha version but then it's really good but how good is it and which one should you use well instead of creating a standalone video we did all the testing here for you we ran various images through the top three models genf free dream machine and cling and the result of the testing is actually a set of conclusions on which model to use when which I'm going to present to you right now with the well tested examples to back up my claims so let me just state that all of these tools are top tier I don't think there's a single winner I think it's really hard to pick a single one that is best I think arguably it is Gen free but different use cases require different tools and as we went through the testing of these tools especially when we limited it to the image to video functionality which by the way is one of the best things you can do with AI video because providing it with a lot of context in the prompt is almost impossible a picture says more than a th000 words and you can provide a picture to the model and then you can prompt on top then you can animate it it's way easier to craft a good picture and then making that move rather than trying to describe every intricate detail of your scene inside of a prompt to video generator and now all top models have this feature so let's

have a look at the differences let me just start out with the animation use case because this one was the most surprising okay this is the genre Alpha shot that stems from this image okay look at what it did with a little additional prompting we just added extra prompt zoom out to this and it did Super well look at the character consistency when it comes to these little animated stories it actually maintains them this is something that was Unthinkable up until now these little elves or whatever they are actually consistent and recognizable across the entire scene if you look really close the only piece of artifacting is here on this present on the left but I think that is quite acceptable considering that all of this looks wonderful and this is very cinematic and that is one of my first conclusions before we even look at other things if you're looking for cinematic shots Dolly shots big sweeping establishing shots of a drone orbiting around the subject whatever it might be gen fre is your friend it's really good at these epic cinematic shots this has just proven to be true across our multiple tests but now let me show you the result of the same image put into dream machine and this is what we got okay it's just a slight animation not much movement and again we prompted zoom out showing the surroundings but it actually didn't it just did this and that is fine because that is what dream machine is good at it's good at animating things slightly it doesn't overdo it doesn't go crazy it does an artifact it keeps things consistent if you're working with logos Graphics or product shoots as we'll look at in next example dream machine is what you want to use over genre is going to create artifacts and do these big epic moves and mess things up here and there and it's going to cost even more dream machine is really good for these slight animations okay that's at least what me and the team found from the testing in our usage of these tools so far and they've been out for a few weeks and we kind of obsess over all of this so I think across the team we have enough experi experience to make claims like this okay and here's the third one cling and this is actually super interesting cuz look it actually made the mouth move now this is a golden opportunity that I cannot pass up or I can just dub over them right oh if you haven't liked the video yet this is your last chance go ahead sneaky advertising right there but I think this is wonderful King actually went ahead and moved them so very different results on the same type of image and we prompted all of them to zoom out but not all did interesting let me go to the second one of three examples that I'll show off here and that is this burger okay and this is without a prompt okay so look what gen free did it just does this big zoom in and it adds some extra lighting again cinematic right this is big zoom and look at the lens flare coming across but in the context of a product shoot this is not what I want is more like the result from dream machine which you can see here this is perfect a light slider shot tracking the burger and you have to realize it's actually coming up with what's on the side of the burger right it's generating all of this because it didn't see that in the original image and it does it super well there's no warping at all like I looked at this 10 times this is just a perfect product shot isn't it so dream machine really good for these slight animations and if you look at cling well I would just say generally speaking it's just the crazy one out of the bunch sometimes you get really good things that's why it went so viral on X because some of the clips just are outrageously good but usually there's just something that goes wrong something where you get a little bit of artifacts like look at the sesame seeds on the top of this burger they're just shifting ever so slightly and you could never use this for commercial production plus sure the output quality is but that changes if you subscribe to one of their plans which by the way they have new plans now you can purchase a membership now they start at $5 per month but at $46 per month you get 8,000 credits remove all the waterm marks and you can extend videos up to 3 minutes but yeah these are the sale prices right now just check for yourself what you get I have one more example that I would love to show off here to end on a bit of a low note because none of these are perfect okay this is an image of a woman standing on top of a sand dune and let's just have a look at jfrey did with this okay the woman is walking there's a little bit of weirdness this is my only issue with this right the walking is not perfect but this shot this drone shot oh it's so cinematic you have to think about the fact that it invented this entire Dune right it didn't have it in the original image it just came up with the fact that hey this D should be there and it should look like this and it should be lit in this way with the gradient here it's a beautifully composed shot this is really good but there is funkiness in the walking so I guess it's sort of unusable let's look at what Luma Labs came up with and yeah typical Luma laps fashion the movement is way slighter now it goes for a little slider shot of the Drone while tracking the subject and I would even say the first second of this is usable where she stands as soon as this woman starts walking and starts being a little weird but hey not a single one of these free generators actually managed to do this perfectly because cing just I don't know panned over and this woman looks all weird this is sort of unusable you determine which one is the winner for yourself but I would just say it's just different tools for different use cases genre is going to be epic and solid and cinematic while Luma is like hiring an animator that just makes things move and puts things into motion that weren't in motion before and cing is just a crazy friend that out of nowhere might just start consuming drugs at the brunch that you invited him to Who Let The Dogs Out who who brought this guy one then all of a sudden might start telling a story which is really fascinating but most of the time he's just going to be annoying and out of place so I don't know that's my review of the top three video generators and if

you enjoy comparisons like this and you would love to meet other people that have the same interest as you that's exactly why I built the AI Advantage community and just want to highlight that we did all of this testing for the community there's a resource that compares it there's discussions underne and now we open up a brand new creative District which is all about video and image generation and you can either participate in some of the events and become better at these skills yourself or you can just check out what other people are doing and learn from them we also have a llm and no Cod District now ai space is evolving and so is thei Advantage community so if you have some time in August to learn honestly the monthly prices are still considered ing everything that you get in there you could easily spend all August 8 hours a day just learning about geni tools with all the materials in the community I just wanted to highlight that I've been told that I don't do that enough so there you go the community is the ultimate educational resource the best thing we've ever built and I think at the monthly price it's quite accessible considering what's inside and that's all the AI news you can use for this week I'll see you next Friday when we do this again