Huge Claude Updates, AI-Generated Minecraft & More AI Use Cases

this week we have anthropic shipping features that we haven't seen out of their competition yet opening eye ining a brand new domain for chat GPT the world's very first generative game engine that you can actually try today we'll be doing that here and so much more all covered for you in this week's episode of AI news that you can use the show that gathers all the AI news for you and then we shine a spotlight on all the releases that you can actually put to work today and let's kick off things

this week with chat gpt's transition to a new domain because open I bought the domain chats. this is not massive news but now you can just go to chat. com and it will redirect you to chat GPT which is kind of neat and makes it even easier to use their search product which we'll talk about here shortly but first I want to talk about the substantial releases of this

week which are mainly from aeropic actually I count the total of three releases that we need to talk about maybe even four if you include last week's release of the desktop app so that I talked about briefly it's pretty much the web interface inside of a desktop application but beyond that they shipped some really interesting things here and one of them gives CLA capabilities that actually go beyond what open AI can do today what I'm referring to here is its ability to look at PDFs including visuals like graphs images or visualizations if you're not aware in other llms it does not pick up on these it only considers the text inside of the PDF but you do need to enable this feature it's hidden under a feature preview here and now you want to enable visual PDFs as soon as I turn this on if I for example upload this paper on prompt cing then it will be able to see and interact and there therefore prompt on top of all the visuals here so for example if I ask it about this specific thing after uploading it will not just be considering the text but also the visuals this is actually pretty big because this was a major limitations when it came to using llms on top of PDFs especially when it comes of scientific papers there's usually a visual component to them and now you can prompt on top of that too big limitation here is that this only works up to 100 pages so keep that in mind and good news is that this is also available through the API so you can build applications with this you can build bu a workflow where it automatically processes PDFs for you with the soned 3. 5 API and this visual PDFs feature enabled in the API okay beyond that mopic shipped Hau 3. 5 and this was actually quite the controversial story this week because it is probably the first release in the llm space that increased pricing compared to the previous versions if you've been following this Channel or AI at all you will know that every announcement is like it's 20% or 50% better and we're slashing the pricing by another 60% here they improve the performance as announced with the Sonet 3. 5 and CLA computer use announcements we talked about this before here all the benchmarks for CLA 3. 5 hiu it's essentially their GPT 40 mini competitor but slightly better but they hike the prices on this thing through the API if you're a web user you'll be happy about this because this thing is not available in the web interface just yet but the price increase was unexpected and I got people spinning up all sorts of theories like hm does this mean Opus 3. 5 is not coming or does this mean they hit a wall and need to increase their revenue by the way if you're not aware anthropic mainly makes their money through the API as opposed to open AI which is very chatbot heavy look anthropic has 85% of its revenue from the API on the third update I talked about is update to the mobile app this is very minor you can finally use your voice to input text although it does not have an output so something like advanced voice mode is not available with clot you can only do text to speech of your own voice which to be fair is a very nice way to input information into an LM I do this inside of chat GPT all the time I just turn on the mic blabber into it for a minute and then I have all the context I need to start a conversation or start prompting something specific this might take a little bit of experience with experience you'll learn what type of information really helps dlm craft higher quality responses but we talked about this a million times now in this video we're focusing on news that you can use okay

and that wraps up the anthropic updates next up I want to briefly talk about chat GPT search as last week I said that I would follow up once I have a little bit of experience with chat GPT search my belt and here's my conclusion the quality of the damn thing is surprisingly good it's probably on par with perplexity although perplexity goes more in depth on its responses if you compare it to Google to me it just feels like it's a slower version now where do I take these insights from I actually did a self experiment over the course of the last week and I completely avoided Google for 7 days straight brother the way I did this is I set up the chat GPT extensions out of Google Chrome so the search bar on top would act as chat GPT search and I straighted up aoid voided Google at all costs and the result of the self- experiment there's positive things and negative things let's start with the positive things I was actually very surprised by how high the quality of cat GPT search recommendations were most of the time even though I felt like this is not a thing I should be asking cat GPT it delivered the answer I was looking to convert a certain amount from euros to dollars and just found the latest exchange rate and did the calculation for me correctly that is I needed the weather in a location it has the same widgets that Google has I wanted to access the anthropic console well it found the exact URL and just gave me one link instead of a lot of ads and various links kind of nice but we need to talk about the negative which is the fact that it's just pretty slow compared to Google like it's quite fast for an llm but compared to Google which is essentially instant it feels instant right that's what they optimize for it takes some time and this is annoying especially if you have been used to the speed of Google over the last decade but here's the thing this is the first version of the product and eventually as it gains more understanding of you your needs and what you're trying to do my opinion is that this is going to steamroll search as we know it I gave this example in the community and I want to round out this segment on the example so as you might know I'm in Brazil right now to do a kite surfing vation basically I work every day just like at home but in the evening we get to go kite surfing cuz there's wind here every day now big part of kite surfing is the wind and I regularly use Google to look at that but here's the thing whenever I'm looking for the wind I'm not actually interested in how many knots of wind there will be today or miles per hour I'm actually interested in a question that requires that information but I'm really asking is if I can go out and kite surf today and if yes what size should I take and what does the tide look like now in practice this is a simple Google search where I open up Google and ask it what is the wind like today or I go to one of my favorite wind forecasting websites and you can get the same result from both chat GPT search and Google right now but where am I going with this as I mentioned asking for the wind is just one part of the equation that I'm actually looking for and I think eventually all of these L powered search engines have the ability to actually understand what you're looking for it's not going to tell you the number of knots the wind will be today it's going to tell you Igor it looks like you're in Guru and you should go out at 400 p. m. and take your 9 M cor kite whereas PL old Google in the current version is just going to give you the wind number and then you have to do these computations in your head bu yourself as we do right now and think about that which one would you rather use the personal assistant that figures it all out for you and just tells you what to do or the version where you have to do some extra thinking I personally think once it has all of your personal context and understands your life in a more holistic manner that these llm powered searches will actually win out in the long term and I think Google realizes that too and this is where the little story ends and we can actually get to the next release which is

actually Google rolling out their AI powered search even further than they have right now because they're feeling the pressure this actually came out last week around the time cat GPT search dropped and I think they renamed this again this was called differently I think it was called Gemini summary doesn't really matter though so now it's called AI overviews in Search and they're expanding this to more places around the world if you're not familiar this is when you use a regular Google search at the top you get a AI response on top of the typical Google search results now when this initially came out this got a lot of backlash because people were breaking it in all sorts of ways and it was making weird recommendations that were just not truthful hallucinations but they seem to have improved this a lot and now this is shipping to more and more people worldwide so there you go that's the update on your search Wars between chat GPT Google and perplexity and other players my verdict is that I will be sticking to Google as the default with chat GPD search pin to My Bookmarks whenever I just want an answer instead of a list of links all right so next up

we have xai's Gro coming out with an API playground type website and this is just something I briefly wanted to cover because they really did an incredible job at putting this platform together if you compare it to some of the competitors like open AI anthropic or Gemini this is actually my favorite platform look at how simplistic this is I just logged in with my X account you get $25 of free credits and you can start using Grog F the API right away now should you be doing that I don't know it's up to you my verdict right now is that Gro is just not that good there's no real reason to use it versus some of the other llms out there the one thing that it is going for it is that it's plugged into the Twitter fire holes but you just have to be specific impr prompting it to even get the right news stories I don't know they're just a bit behind the state-of-the-art models right now nevertheless they're catching up quickly as they added the ability to upload images to grock now and with this super clean developer platform that gives you the ability to use this programmatically plus a rumor of Nvidia wanting to invest 75 billion into xi's Gro I think they're well on track to be one of the big names in this game it might just take a little bit more time and we'll keep our eye on Gro and what they're up to okay next up while

remaining on the topic of EGS this is something fun I've been told it's not that good but I really like this idea and I wanted to test this live in the video so this is a new 11 laps feature which does the following it creates a unique voice from your Twitter or X profile so the way this should work is that if I put in my Twitter handle da Advantage it will go ahead and create a new voice avatar from it and look I'm not even logged in and you can just go in it does this very quickly and it will create free voice samples from your profile for you let's have a listen let me tell you about kite surfing with a side of AI breakthroughs because who doesn't love balancing extreme sports with technology right wait what is it listening to me right now what's up with that okay one more let me tell you about kite surfing with a side of AI breakthroughs let me tell you about kite surfing with a side of AI breakthroughs that one sounds a bit like Elon okay right let me tell you about K surfing with a side of AI breakthroughs because who doesn't love balancing extreme sports okay so it animates your profile picture creates one of their custom voices and I guess it writes some text with an llm based on your recent tweets but I didn't really tweet about kerfing what's up with that anyway you can try this for yourself with your very own voice it's free it's you don't need to log in it's kind of fun and now let's

move on to the next thing which is a very interesting one that I don't want to spend too much time on but I want to bring your attention to this and show you that this is happening the very first generative game engine meaning you can play Minecraft without the code of Minecraft being actually ran in the background every single image every single interaction is generated on the spot and you can try this for yourself in the browser without even logging in under oasis. dcard doai get some details on it here but we can just pick one of these presets and hop right into a game and this is the very first publicly available fully generative game engine now I'll admit that this is probably more exciting from the technical point of view rather than the usage experience as some people on Twitter pointed out pretty much everything about this is terrible compared to normal Minecraft but if you go here you queue up and then in 80 minutes I should be able to hop in here so let's just wait a bit and give this a spin asking you all right it's our turn in Q so let's just pick the village Outpost here and enter all right and there we are or not no oh no now I reloaded okay let's do this again okay as you can see to the top right I have 40 seconds left in here so let's make the best out of it okay with space I can jump and as mentioned all of this is being generated in real time I mean look it's really simple I can move my mouse I can even open my inventory here by pressing e let's do that briefly there you go that's my character with all the stuff so now I should be able to move these different blocks back and forth look it's rendering all these numbers in real time isn't that crazy 5 seconds left can we move something I'm kind of out of time here but yeah it actually works I could click things ah and I have been kicked out but there you go very simplistic worse in every way than the original game but eventually think about it it's like the real world it will be generating in real time as the player interacts with it rather than there being a preset path for you to follow that's a whole new paradigm and a whole new way of Hosting digital experiences if they make this work this is the future of not just gaming but digital experiences and maybe even the way information is communicated absolutely massive this is the very first time we see this go try it out yourself big milestone for technology right here but now let's look at the next thing that might be a little more useful to you

okay next up we have a big feature coming out of AI video we're getting more and more manual controls as predicted inside of the state-of-the-arts generators here concretely we're getting detailed camera control for runways gen free which is amazing because this gives you the ability to create some shots that weren't really possible with AI video so far some of these movements that you can see here in the demo video including the intensity at which the movements happen were controls that you didn't really have up until now you could prompt really well for the subject the background the lighting the environment and sure you could pick the lens and the movement but you never really had this fine grain control you could try and prompt for it but most of the time it would just ignore it now we actually get proper slid ERS to dial it in every single week AI video tools are getting better and I think this is absolutely amazing so let's give this a quick little Spin and then these Advanced Camera controls are only available inside of genf free turbo so let's see we even get some of these presets here how about something like a orbit ah yeah closeup orbit right that is when the camera spins around the subject while keeping it in the same area of the frame and look at that it adds this manual prompt to it and I actually need to upload a image so let's just do this on top of this sunflower okay so let's see if we can get this plant growing as a time lapse and the camera orbiting around it during the time lapse this is something that would be super hard to achieve in real life you would need to plug this into AC take thousands of images Stitch it all together make sure that the lighting is consistent ideally and let me tell you with this window in frame it would be almost impossible to pull off because you would have so much flickering from the Sun in the background a real pain to create in the real life let's see if AI managed to do this okay so we did get the orbiting motion we did not get the time lapse of the flower growing this might be due to my prompting let me try one more time okay I added this part A timelapse of a sunflower growing from a seed in a pot in front of a window basically describing what the image shows plus the transformation that I'm looking for there right growing from a seed implies a transformation this should probably work let's see no it didn't ah and you also get these controls here okay let's see generate maybe it's because it uses this image as a start frame oh wow look at that more dramatic motion so this camera motion works really well I just can't seem to prompt the time lapse into existence here let me prompt it the other way around where it turns from a flower into seeds as can see I'm having way too much fun here last try Okay H it just doesn't want to manipulate the sunflower but I have to say that the camera motion here works really well and even this interface is super intuitive including all of these presets so if you want you can get a lot of manual control over the camera in your shots with runaways gen free Alpha turbo model that's a mouthful and yeah so now it's just a question of time until all the other stier providers add this to their video tools next up I

want to show you a new AI tool by Google and they always have these interesting tools do you remember last week's AI DJ where you could just prompt different words and then you got a slider and it started mixing those sounds or Styles into the track that was creating life pretty amazing stuff here's a new one that I want to highlight it's called learn about this is another one of their AI experiments but basically this is an assistant that is focused on one thing helping you acquire new skills so if you want to learn about something this is a great way to do it and it will create a custom learning plan for you now unfortunately this is not available everywhere you need to be in the US I'm in Brazil right now some team members tested this back in Europe also doesn't work so what I'm going to do here is I'm just going to engage my evpn real quick I'll be right back and now that I changed my location to the US voila here we are so what do we want to learn about today how about prompting llms let's see what it suggests here I'll just agree to the Google terms here okay so it tells me why this skill matters it gives me example prompts it tells a little story heck it weaves it all together just like a teacher would look at that you have some follow-up prompts here and then you have other suggested topics that you could now continue learning about this is really great so there you go I'll just continue the conversation with one of the presets here but this is actually really great this world Cloud seems to be quite helpful and accurate when it comes to learning about prompting and right here you have different prompt engineering techniques in interactive list let's see let's expand on this one be clear and specific it changes the interface here so as you can see when you want to learn about something this might be a better experience than using plain old chat GPT can this be the next notebook LM when it comes to user popularity I don't know but this seems pretty good actually and as you know I personally am a huge fan of learning new skills I think it makes you a more well-rounded human being and increases your value to the world something that in this fast moving age is a great idea and if you can learn about something that you're generally interested in it's actually one of the funnest activities available on this planet let's talk about the next Point here this is really great and I have to say I don't just enjoy the format here the interface but also the tone ah look at that there's a Knowledge Test here and a more formal and academic response fun and easy way scholarly perspectives probably this one right yes and then it gives you the answer to why that is correct this is amazing yeah so if you want to learn about something and you're in the US or have a VPN you can go ahead and use this it's completely free just like all other Google AI experiments all right that's everything I got for you today if you want more updates at an earlier point in time plus the free template that you get on signup check out the advantage newsletter in the description below and other than that I will see you next week with another episode