Mistral Agents, Huge GPT-4o Updates & More AI Use Cases

as per usual we had another week full of various AI releases ranging all the way from openi announcing a 50% cut yes again in pricing for GPT 40 over Mr Lei releasing their own version of what they call agents this is hosted on their platform called L platform we'll have a closer look at this and then all the way in the creative sector we have a new image generation King that is open source and it just popped out of nowhere it's free it's open source and in certain categories of image generation everybody considers it better than moury we'll talk about all that and more in this weekly that looks at all the pieces of AI news you can use and for anybody who's new here I'm eager and I made it my mission to bring all of these AI use cases to you and while doing that I have a ruthless focus on things that you can actually do today use cases practical applications that's what me and my team does here on the channel so without further Ado let's look at all of this week's AI news that you can use starting

out with the open AI announcements these are pretty brief and they weren't even sent out via email to most users or communicated on their main account on Twitter but with the newest version of the GPT 40 API you actually get a 50% or 33% reduction in input and output cost relatively I really like this image displaying how quickly AI is progressing just within open AI now sure llm capabilities is something we look at regularly and something that is very important but the other piece to it is price how cheaply can people use these products and you can see that the trend here over the last year since March 23 has been an insane reduction from $6 for 1 million tokens to $4 today and this is largely due to the increasing competition in the space I year ago we only had one GPT 4 level model gp4 now we have so much more like mistal large 2 that will talk about CLA Sonet 3. 5 and Opus Google's new Gemini 1. 5 Pro experimental model which also came out over the course of the last week we'll look at this later and even open source Alternatives that score similarly with something like llama 405 beat so there's Alternatives some of them open source that's why they have to go down in price to stay competitive so that's what we're seeing playing out here next up there's also this announcement that came out of open Ai and this is one of the good type of announcements the type that you can actually start using today again this is a developer facing thing but I want you to be aware of what's going on here because this has been probably the most requested thing within the ipace Json outputs from the API have been something that you could not really consistently achieve So for anybody not familiar let me just clarify what adjacent is it's just a specific file format that follows a specific structure it's very popular in the programming world because it follows the strict template every time this means you can export adjac in one place and import it in another place and really easily facilitate the communication between multiple apps or multiple functions whatever it might be so it's just a popular template and LMS could absolutely output these if you prompted them to do so you did five shot prompting or you provided five examples or you could even find you in the model to only output Json but no matter what you did you could never get it to be consistent 100% of the time so as you can see here with GPT 4 the old model only 35. 9% of the time could you achieve a consistent Json output now with GPT 40 you got to 85% but that's not good enough if you're going to run something hundreds of times have automations or build an app on top of this you don't want almost perfect you want perfect and that's what they delivered with this update to the API now if you set the strict parameter to True 100% of the times the output is going to be consistent to this Jason formatting and now you can reliably integrate the intelligence that GPD 40 provides to you every single time not most of the time plus there's a 50% reduction so these are not big consumer facing updates but if you're using any sort of app that uses gp4 in the background both of these updates will greatly benefit you and over time hopefully these updates and reduces in cost will trickle down to you the

consumer all right next up we have Mr Lei coming out with two major features first of all now they have a easy fine-tuning interface we talked about fine tuning before I think the video from two weeks back is even titled with fine tuning if you want to learn more about fine tuning that's the place to do it I went more in depth Plus in the community we're actually teaching this more in depth we're currently developing multiple guides for multiple fine tuning use cases so if you really want to go deep that's the place to do it and this feature just has become increasingly demanded but not just that also this buzzword of Agents has just been thrown around left or right I created a video earlier this week actually defining agents and having a little discussion around that topic because the definition of that term is just so messy but what mistell did here is they jumped on the bandwagon and they released the Alpha version of what they call agents now I would highlight Alpha I would capitalize this and make this bold because this is the most rudimentary version of an agent that you can have matter of fact I would go as far to say that what they call an agent here is really just a simplified version of a GPT that we got from openi almost a year ago nevertheless you can access that through their console console. Mistral. a you can activate a free trial over here all you need to do is link your phone over here and then you can see you can do free fine-tuning jobs and you can also use their API at a very limited rate but that works we'll activate the free trial here and now we can go ahead and try out something like their agents so this is what's new here this tab agents fine-tuned models and data sets inside of the data sets we can upload a specific data set and then fine-tune the model on it again we talked about this in relation to gp4 mini if you care about that check out that video I won't go through the entire process here it works the same way it does with open AI models on their platform but the new and exciting and interesting thing here are these agents okay so use agents to streamline a chat workflow so what does this look like in practice if I go ahead and create a new agent you will see that we get model selection and obviously these are a mistal model because this is the mistal platform now we talked about large to recently at not having an open source license but the capabilities of this are actually incredible it's on par with gbd4 also using this is an absolutely valid alternative to something like open ey so I love to see that they're moving forward with tooling here too temperature is something I taught many times before it's essentially the creativity of the model most likely you want to leave this on the default setting here you can add some instructions if you've been here you know I'm huge on custom instructions so that's what essentially goes in here what I'll do here is I'll head on over to chat GPT and just copy over one of the instructions inside of one of my gpts this one I use to prepare myself for recording sessions to put me in a better frame of mind and it really helps on some of those days where I don't feel like presenting teaching or sharing I found a little coaching type GPT like this to actually be quite helpful anyway I'll copy that over here and then here is the interesting part okay so down here you can add demonstrations this is different from what openi has done so far because these are input and output pairs similar to fine-tuning a GPT so in fine-tuning you have to provide it with a file with various input and output pairs for example questions and answers or if you're doing some classification you can say hey this is a good type of comment this is a bad type of comment and then you always give an example and then you say good then you give another example of a bad comment and then you say bad in a consistent format here you can do the same thing with the agent so you can basically train this on a fuse shot prompt if you're familiar with prompt engineering this is one of the most popular techniques you just give it various examples of what you want but here you do it in this input output pair style now in the case of a little coaching type GPT like this it doesn't make much sense because we want this to be free form but if you're creating a classificator if you want to enforce a specific writing style maybe it also makes a lot of sense you could also train it on a specific pair of q& as but again for many use cases like a coach right here it's not really NE necessary just need to be aware of the fact that it's there and this is essentially it for the interface I'm going to say deploy and we're going to be able to deploy this and all of a sudden I can use this inside of luchette which is actually a surprising update because if you build something like this inside of chat GPT it's only available in chat GPT right lat by the way is their equivalent to chat GPT but if you build it on assistance API it's only available for the assistance API which is quite pricey by the way and here we get to do both which I think is interesting I'll just keep it through the API like so cuz I don't really use l chat at all and if I just say hi you'll see you have the YouTube recording motivator as based on these custom instructions now look they're saying this is Alpha version meaning that this is their first test there's no tooling here opening eyes equivalent to this is the assistance API and in the assistance API you can actually upload files you have the code interpreter and it can plug into various API endpoints so it can actually do stuff across the internet just like gpts here with the actions down here so as you can see this is a very basic implementation but here's the point it's just an alpha version and I think every single other model provider will over time go this direction plus with opening eyes death day coming up in less than two months I think what they'll be doing is pulling ahead because right now players like mistol are playing catchup they're implementing things that have been introduced during last year's Dev day but I think we can expect a major step forward in terms of these agentic capabilities where it's more about the model acting with a specific purpose in mind rather than it assisting with you on what you're doing already and to

round out this sort of llm corner that we're having here let's talk about the brand new model coming out of Google which is the Gemini Pro experimental 0801 that's really relase date 1st of August so we barely missed this last week I usually have to cut off on Wednesday night if we super busy first day but the bottom line is there's this brand new model called Gemini 1. 5 Pro experimental which to everyone's surprised topped LMS Ys chatbot Arenas leaderboards here as you can see it's actually rank one above any other model available that's higher than GPD 40 higher than Claud Sonet but keep in mind that this chatbot arena is defined by user votes this is not some objective measure people just go in and they look at different outputs and then they say hey this is better or this one is better and the site has gotten so popular over the past months that at this point I don't think it's unreasonable to assume that some of these companies are actually incentivized to maybe even manipulate some of these results here because so many people look at it and because it's that easy to manipulate you could just go in here generate different results and as you can see this is the experimental model from 1. 5 Pro and this is the old one and I could just say yeah clearly a is better and kind of vote for the model that I want you even see what model you're voting for independent of the fact that the rate limit is reached that I didn't even get a response to I'll just say this is better and then I'm influencing this leaderboard so I don't know how much trust I would put into LMS y chatbot Arena at this point in time nevertheless it's a new model and it's interesting now I did a lot of research on this and I was surprised with my finding which is it's at the top of the leaderboard but I didn't find any data or not even any subjective opinions on why this is best usually when a new model comes out and is hyped something like claw 3. 5 Sonet a while ago there's examples there's reasons there's use cases wow it's so good at code generation it has this artifact features it's incredible it can do things that we weren't able to do before with this model I was hardpressed to find anything one of the few opinions here is this from Omar SAR zero and he just says he's impressed with the extraction capabilities from images and PDFs and that it feels close to GPT 40 Vision or clae 3. 5 code generation but we don't really have any benchmarks and some of my subjective tests just didn't really yield any results it feels very similar to the last Model it has a lot of the strengths you can upload videos to it which you cannot do in any other model so that's the one thing I would highlight here but I guess the AI news you can use is that hey if you need to upload videos to a model then G I 1. 5 Pro is still King and there's an even better version of it now let me know if you have any thoughts of your own on this oh and one note should be that this actually has a 2 million context window if you weren't aware this is the largest context window in terms of capable LMS that we have today so if you have a lot of files or a video you want to upload to the llm this is the one you want to go to by the way this Json output mode has been in here for a while too so Google definitely participating in all of these developments but now let's move on to some other use cases that might be a little more interesting and unique the

next thing I want to show you is a AI video editing platform called voo and they are the sponsor of today's video voo has a ton of tools that let you rewrite redub and lips sync your videos you can turn any video into a new story with a simple prompt and there's a ton of interesting use cases for this let me show you some boo what's your sole purpose in video editing to make video editing effortless with AI and prompts which president are you supposed to vote for point to it no as you can see there's some interesting things you can do with a tool like this and as AI is clearly a staple in the future of video editing it's probably helpful to get comfortable with these tools sooner rather than later let's have a look into the interface and show you some possibilities here let's try the redubbing function here where you can transform any video and I'll pick one of these trending templates I'm going to pick the game of form ones because I used to watch the show a lot and I do wish I could change some of the scenes or Seasons towards the end either way this is the scene where Jon Snow gets introduced to kisi you stand in the presence of daena Stormborn of House Targaryen this is John snull I'll go ah ahead and click rewrite this video as you can see it opens up the interface and gives us two options I'll go with ask AI to do it as that involves the least amount of manual work possible by clicking this button I can summon the AI assistant and now I can just ask it to do something for me we're just going to turn this into a little script where AGI introduces itself once it becomes self-aware confirm with this button and that looks about right I'm going to apply this script and we're done one more thing I want to do before exporting is going to this lip sync tab here because I want the text to match how their lips move you just got to remember to hit this button to adjust the speech they have this feature in there too so I'll simply go in here and say lip sync okay and when the lip sync is done we can export this with the lip sync video all right done let's download and review this you stand in the presence of AGI the all knowing intelligence rightful heir to the digital Throne rightful ruler of the binary realm protector of the seven servers the master of algorithms the kisi of the great data CA the uncrashable the break of firewalls this is John Snow he's King in the north see how even those lips matched up so there you go it's a fantastic all around platform for AI video creation and editing especially if you want to modify the storyline or the speech and if you sign up now from the first link in the description the first 100 users will get 30 gift points for free so you can test out voo and do what I did here and more go give it a try there's a lot you can do here and now let's move on to the next piece of AI news that you can use

and usually I focus the show on new releases but this is something that is super relevant right now as the Olympics are happening right now in Paris and there's so many disciplines out there that there's no way you can know about all the different sports that are happening matter of fact a few of them are completely new and this simple little prompt that I'll put in the description of this video actually turns gp4 into a little assistance to explain some of the sports from the Olympics for you so I personally am a super passionate kite Surfer but the category of kite surfing that I'm interested in and that I participated in is Big Air which is completely different than from what was introduced to the Olympics this year kite foiling so I'll just put kite foiling here but this is really a variable for any sports so you could replace this with what you want and I was positively surprised to see that actually GPT 40 has knowledge of every single discipline in the current Olympics meaning you could even put in something like kite foiling and GPT 40 with this prompt will explain it back to you and give you the various rules and the history of the sport and I personally found that while watching the Olympics this year this really helped me enjoy them a little more because if you know all the intricacies and how things are scored and what you should be looking out for in that Sport Plus you get the historical context one the viewing experience just becomes deeper but two you also have something to talk about with your loved ones that you might be enjoying some of these sports with so there you go we also shared this little prompt in our Weekly Newsletter for anybody subscribed to that you will have it already but I just wanted to point it out here again and now let's

look at this brand new Imaging model called flux and look my take is a bit different than many other YouTubers here I think this thing has been massively overhyped not to say that it doesn't have any unique capabilities but calling this the best Imaging model ever I don't know about that take it might be best in class at text generation but in everything else still other models win in my opinion but hey that's just my take me and the team actually went in and tested some of the capabilities we did a comparison between flux M Journey 6. 1 and ideogram if you're not familiar ideogram was Best in Class when it comes to text generation so I think the main part that is true about the hype is the fact that this thing is open sourced fleux has been founded by previous stability AI employees and it is free the two base models that is you have Fluxx def you have Fluxx Chanel which is the quick model and then you have Fluxx Pro which is Pat the first two are free I'll put a link in description where you can just try this out for free but basically here is the first comparison okay a basic portrait of a middle-aged 50-year-old woman wearing glasses and red lipstick and this really illustrates my point well here because look at flux look at this skin no way this looks better than my journey the texture here is way better it looks more photo realistic the blur what is this blur look this little scarf is really sharp here on front but that is not the same focal plane as the hair here in the back which is also fully sharp whereas M Journey the sharpening and the different focal planes lines up way more the structure in the skin is better they all look great don't get me wrong but claiming that this is just the best model that has ever released is a bit of a stretch but there's more and there's other things that flux does excel at so let's look at those two so here you go this is another example with some fingers notoriously all models used to have problems with this we're getting to a point where it's getting pretty good if you have the flexibility to regenerate things a few times you will usually get the fingers right like right here you wouldn't really be able to tell if something is off in our next comparison we have action photograph of a professional ballery arena in midair all of these are good but again mid Journey just has that aesthetic quality that goes above and beyond ideogram on the other hand when with artistic style here flux looks great but definitely not best it's just good it can hold the pace it looks realistic enough that's fine the anatomy is good but here we get to the category that is super interesting here because as I told you flux is Flawless a text and if I say that I mean it in this example all three performed well because mid Journey 6. 1 is actually really good at text 2 if it's short but here in there a little mistake Creeps in and it does things like doing this long winded why sometimes that's not bad that's not a mistake all of these are usable let's look at the next example here we have a little more text and on this example you can really see the difference so as you can see over here I don't need therapy need my video games it's good all the text it has is perfect but the prompt adherence is not perfect because look we asked for I don't need therapy I just need my video games and it did do the Bold white letters which is fine mid Journey here failed in multiple instances cuz it just left out multiple words in some cases then here we have two apostrophes and then it repeats certain signs like this one here twice this J is very weird there's an extra I here I think you see the point it's close but it's certainly not usable if you posted this on social media people would be like the heck why is there spelling mistakes in your post an ideogram almost nailed this it had the best prompt adherence here so it has the full text but look at this there's a Double R this is something that flux actually does not do almost ever which is impressive this used to be a problem with all models up until now so I would say prompted adherance not the best but text generation actually the best what about this one the sky is the limit here again I think flux is the best prompt adherance totally worked out matter of fact even better than ideogram we asked for a light blue background not for a sky and the text is great in all of them whereas in M you get these little mistakes like this weird M but if you generate it often enough you might just get something that works like these two down here and then final two examples pixel art I think all of these are great with moury being the best it's just consistent pixel art look ideogram in the face is not even pixel art while the fire is very pixelated and then flux is not bad it's just a bit more basic I really do think that Maj Journey takes it home on most categories but again when it comes to text flux is the best and then logo design is another one where it can absolutely compete with some of these others because it's really good at text it's also really good at creating vectors so if you're doing logos or any various shapes or forms flux is your friend here and there you go that's my little practical review of the tool I'll point out a few more examples from Reddit here apparently flux is really good at consistent character sheets too look at that super consistent across the different images that's impressive you can also do funny things like this because the text is so good it's great at generating movie posters memes or things with captions in it and then here's another example of a social media post that you might want to create with flux the best part arguably is that this thing is fully free you can access it for various hugging face or replicate spaces and on the website of black forest Labs the company behind flux you can actually go ahead and look at examples and get the models down here or as I mentioned you can go to these various spaces where you can try out these two variations of the model okay

next up let's talk about AI video again progressions here and we got the most requested feature inside of Runway gen free probably the stateoftheart video generator they added image to video which is incredible because an image says more than Thousand Words which in practice means that an image might be more accurate than a thw prompt some incredible examples here straight from runways marketing but what we did we went ahead and we tested this ourselves so let's just get straight into it let me show you a few examples that we run through Runway gen freeze so the first one is that we took this image and prompted fpv drone flies over the hills and it turned it into this shot as you might already know all of these modern video generators are really good at drone shots because there's a lot of training material for that so unsurprisingly this worked really well the next one is maybe not surprising but nevertheless impressive we took this image of a mug okay and put it in and used it as the end frame meaning genf Frey had to come up with the sequence that leads into this image and there you go here's the result this is super impressive compositing this in a realistic way like this would have took hours the lighting on all of it is almost perfect look at this even the highlights here on the cabinet reflect back onto the table and so many more details on here are impressive except of this little Mist back here I'm not sure I would be able to tell that this is not AI generated we're going to start seeing this in ads very soon and if you're a media production you should absolutely be playing with these tools today because they're getting to a point where they're almost production ready for some use cases let me show you a few more so here I just took a basic image of this flame in the background that you see in the background of every single video and I just wanted to see what Runway comes up with when I throw this into it I picked this as the last frame and that I told it transition into a real flame this did not really work nevertheless it's sort of interesting what it did here it did sort of an animation of the neon sign turning on okay fair enough not really usable I free more for you this waterfall picture used as an end frame and as a prompt we used yellow paint flowing down a waterfall and this is the problem with the prompts even if it listens to you it's not what you might imagine because look here in the bottom left the yellow paint is flowing down the waterfall sort of but obviously what I meant I wanted the yellow paint to replace the water here so maybe this takes more prompting but it's not that easy to work and most of the time you're not going to get exactly what you expect so that's why I would actually recommend not using prompts at all like I'm not saying you can't get good results with prompts but it's more consistent without prompts and it's also easier to use you just throw in an image and you let it do its thing and go into the training data and figure out what kind of Animation would be appropriate this image for example we just threw it in as a beginning frame and then we said hey Runway do your thing image to video 5sec clip go it starts with the frame that I gave it and then look at this it just sort of figures out that hey let's look inside of the egg not bad but what I said last week I stand by product photo and videographers are in trouble because if you give it a product photo like this mind you this could be a real world photo or something AI generated like this it can and will do super well this is without a prompt look at this dolly in perfect I simply use the image as an end frame and it does the entire camera movement for me in combination with some other AI tools we cover you could easily do a workflow where you take a foam picture of a product then remove the background generate a different background with something like mid Journey or flux that we looked at this week and then with Gen free you use it as an end frame and all of a sudden you have a high quality shot off a real world product in the artificial environment with artificial camera movement and nobody would be able to

tell okay two more things this week one fun one and one super convenient one if you're a chrome user like I am you might want to know about the brand new Chrome AI features I think one of them really stands out sure they added some features as you would expect them for example you can use geni to browse your history which is sort of creepy because already they're hinting at the fact that they're going to be using your browsing history with their AI products sort of obvious but interesting to point out but more interestingly in my opinion this one feature really stands out it's the brand new Google Lens integration into Chrome meaning if you update to this version and you're in the US cuz that's where it's available right now I updated mine I don't have it yet uh side note if it was important enough I would VPN and show it to you but I think all of you know Google lens by now it's basically where you take an image and it recognizes what's in the image and you can use these images in tandem with your browser meaning you don't need to pull out your phone it's just right there should be a brand new photo icon here in the top right and with that little icon you can screenshot anything within your browser and instantly get the Google Lens results that are super high quality this is one of the most useful apps on the phone it translates it searches you can use the power of Google Plus gen AI to look at anything on your web so if you have Chrome I would totally recommend updating and using this new feature and then I

have one last fun little update I just want to show you this I know most peoples won't use this but it's called stable Fast 3D and it's a very fast 3D object generator and basically what you can do here is you can pick one of these presets like this Little Beaver Samurai and in around half a second it will turn it into a 3D model I'll just click run 1. 3 seconds 3D model and here we are you have a little Beaver sumurai that you can look at this also allows for custom upload so I could just go ahead and pick any random image that I might have in my downloads how about this cut out from a recent news you can use video this was in a thumbnail let's just upload this and see what it does uploading look and now if I hit run as promised this is going to take one second and we have a 3D model we can look at come on don't let me down there you go let's see and there you go it turned it into a free model I mean it's not great look at the backside but this is becoming super fast these things used to take a minute a few months ago and right here this is more of a hint at where this technology is developing into the end point for this sh here is a realtime generative game engine might take years might take a decade who knows but that's where little demos like this are eventually heading so that's all I got for this week's newsic can use hopefully there was something in here that was interesting to you or at least something that inspired you and showed you where the space is heading if you're not subscribed already go ahead and do that I do this every single Friday plus we have another high quality upload every single week thank you so much for joining me and I'll see you next week