ChatGPT Now Works with Apps, Claude Prompt Improver & More AI Use Cases

this week we have open AI shipping updates through the desktop app a open- source version of Cloud's artifacts and more releases within the generative AI world that you can actually put to work today now if I look or sound a little under the weather that's because I am I just got back from speaking at a conference in Denmark and I also held a really exciting workshop on how to generate your personal context and build assistance but unfortunately it didn't bring the appropriate clothing for the cold weather there so I caught a little cold so I've been sipping my tea as I've been preparing this video but no minor sickness is going to stop me from showing you all the new releases in the AI space that you can put to work today in this week's episode of AI news you can use let's get into it so first

things first we have a very interesting update coming out of open AI for the chat GPT app namely it can now work together with other applications for the very first time up until now you could give it screenshots but it couldn't really see what an app was doing on your computer this is something that's pretty exciting because it has been demoed when they first showed of advanced voice assistant back in May the way it works is the following you just need to update your application which you can do up here check for updates and I already did this so I have the newest version of the chat GPT app right here and it's this new button here and you might not see it right away because it only works with specific applications it's the code editing ones okay this is not available for all apps yet but surely over time they will expand the compatibility of this but as of now you could work with various code editors like the terminal or vs code here and it pulls in all the code inside of them into its context window and you can have one conversation with all of it this is pretty amazing and again if you don't see this button you might need to open up one of these applications so let me open up terminal right here and when I'm in terminal I just open up a new cat GPT window by clicking the icon of the desktop app and then here I can add terminal if you're doing it for the first time you're going to need to give it permission on a Mac and now I can tell Cat GPT things like navigates to my download folder and it will look inside of my terminal and tell me exactly what code to type in there and I don't need to know various bash commands by heart to navigate this that's the language that the terminal operates in so just copy paste what it tells me here hit enter and boom we're situated inside of the downloads folder with this quick little command I could see all the files in there this is great now here's the interesting part you can add other apps to it okay so if I activate this also for text edit for example then I could start a new text edit document and I add text edit here and now all of this code and is in a context window of my cat GPT conversation now this really makes sense if you're building an application inside of vs code but you want to use the terminal to do something different like accessing get T repo and again this is just the beginning surely over time we will get more applications in here and eventually I'm looking forward to a r where it just sees the screen 24/7 if I give it access to it that's when the advanced voice is really going to shine because you're going to be doing your work and it's going to see all the applications and once you need something you just press a button and tell chat GB what you want to do no need to give it the context because it has it already oh and there's also one more update to the app and that is the fact that it's now available to all windows users so if you're on Windows you can go over to this link and you can download downloaded for Windows finally they rolled this out so everybody can use the desktop app now and I expect more updates to show up here very soon because not really news you can use but I did want to highlight the fact that Greg Brockman is actually back at open aai and we had a discussion with the team on how peculiar this timing is the year is about to wrap up Thanksgiving and Christmas is coming up and he's rejoining the company now what do they have planned what are they going to ship that they need Greg there to communicate remember he was always the use case guy he always tweeted a lot and showed people how to use the various things they shipped so I think the fact that it came on now will coincide with some releases over the coming weeks or months I'm thinking probably 01 full is the main thing that people are talking about here we'll report on it as soon as

it's here okay so by now you probably know that I really like chat GPT and especially the gpts that it provides they're limited but if you customize them they're quite powerful and today I have both good and bad news for you and if you've been following the channel you also know we use notion a lot but gpts and notion aren't exactly friends there's no easy way to have a notion page that you keep updating and all of that info going into your chatbot automatically that was the bad news now here's the good news there's a platform that does this connection extremely well and that is chatbase the sponsor of today's video chatbase is a platform that lets you create external facing chat Bots like customer service agents lead acquisition bot or what excited me personally about this is that you can create internal chat Bots that are connected to a notion page that you might be updating anyway so for example for these videos we curate all of this weg's research inside of a database we call it the AI use case database and we keep updating it every single day of the week now by connecting that page to a bot on chat base we can just talk to it and draft social media posts summarize all of this week's news or search over the entire database in no time and this is so easy to set up you can do this yourself and Link any sort of knowledge that you might be collecting somewhere to your own version of chat GPT to get started with chatbase yourself click the link at the top of the description to try chatbase today and now let's move on to the next piece of AI news that you can use okay next up a brand new tool

from mopic this one will be very brief because we talked about this before matter of fact we even build something that does exactly this improving your prompts we made it freely available in the GPT store it's called Sam The Prompt Creator and people are using this thing look at it has over 32,000 chats and I don't even promote it on the channel I created one video about it a few months back this works like a charm but now I'm Fric also caught onto the fact that actually improving prompts is something that can be super useful especially if you're going to be using the prompt a lot or you're going to place it inside of an automation all you need to do is go into the infy console here and go to this button which is improve an existing prompt so you can insert your prompt here then you can use this button to templatized Turning variables into something that's formatted like a variable okay instead of square brackets as we do it they use double curly brackets and now I can just say improve prompt and it will use some of my anthropic credits to improve this does work really well as they implemented a six-step process here where apparently multiple agents throw this prompt back and forth and come up with the very best prompt that you can have in practice I would just say check out what works better for you if it's this one from aeropic or the one we built or any other prompt improver I would just say the following Sam The Prompt Creator is completely free and it has gained its popularity for a reason it really works and you have multiple options here so if you custom build a prompt it's going to guide you with leading questions to get the optimal result whereas with mopic you really need to know what you're looking for at the end of the day you'll just have to try this out just keep in mind you will need some arobic credits for this Sam is free your choice really good to know this thing exists all right next up we

have quen 2. 5 coder artifact and this is the first open source implementation of something like the Sonet 3. 5 artifacts feature if you're not familiar there is the feature inside of clot that when it creates some code it also visualizes it and not just that it's also usable so it looks something like this in practice I prompted for a tic tac toe game and there you go it creates the game that I can now actually play all right and the game is over see creates a code here in the background this is the preview quen 2. 5 coder works the same way now we did a little bit of research and testing on this and it seems that in most cases clae 3. 5 Sonet actually beats it especially when the application is a little more expansive but there are specific cases like this one that we found on Reddit where quen 2. 5 coder actually does things that son 3. 5 can't do what I'm going to do here is take this one specific prompt that we found on Reddit where we prompted to create a single HTML file with free Javascript scenes of a rotating 3D Globe I'm going to copy paste it into here and send this and I'm going to do the same thing inside of a new Sonet 3. 5 conversation and there have right there you could see quen write the code and there we go here's the rotating globe with the camera movement the lighting and everything looks good it's not interactive but we also didn't ask it to be and instead of claw it does a limited version it misses the texture even if I go in and Bre prompt it to do the texture this runs into limitations of the tool where it can't go further than this so this is a specific prompt that shows off the ability of this tool and some of the other standard ones like all the different games and basic dashboard websites it did not perform as well as CLA can hold more context and it just feels like it has more power Benchmark suggest the same thing but again this thing is openly available and you could build it into your applications whereas Sonet 3. 5 with the artifacts feature not at all you can use it through their web app so there you go certainly an interesting development eventually we'll see this built into any other application where it makes sense but this is the in between phase where it's not just for coders and not in mainstream apps yet you get it inside of claw or hugging phase demos okay the

next piece of news you can use is something that just popped up on Twitter and I thought this was super interesting cuz I saw examples of this and now the software that does it is open sourced I'm talking about the ability to connect multiple Mac minis with Thunderbolt 5 to actually create sort of a super computer now if you haven't seen the release the brand new Mac minis are actually impressive with the M4 Pro processors they unbelievable value for the money that they cost and just the Mac Mini overall happens to be really efficient when it comes to running llms but a single Mac Mini is not going to run some of the bigger models like the 70b models and here they even say it can run the Llama 405b model but if you daisy chain four of them it works now the piece of software that does this is also freely available on GitHub so anybody who wants to do this and buy multiple Mac minis just go into the readme here follow these instructions or copy paste them into chat GPT and let it guide you through it and you're going to be able to hook up multiple Mac Minis and build a super computer now the big question is here is this more cost efficient than actually investing into a Windows machine with multiple Nvidia graphics cards and that's also the hot discussion here in the comment section and Alex one of the creators of this app actually said they'll be following up with real world benchmarks comparing exactly this very soon so I can't wait to see this myself but from the discussion here it seems like with about $88,000 you could run llama 405b which would be a first the local setups that run that model successfully are all way over $10,000 so there you go another interesting development in the AI space is something you could put to work today and this is something you should definitely consider if you really want the privacy of running llms locally okay then we also

have a new multi-agent framework coming out of Microsoft which has been released and at this point there's many of them out there but the conclusion that Community arrived that after costy testing it and other people discussing it in the comment section below is that it's essentially like a CLA computer use that can use other models besides Sonet 3. 5 now unfortunately that doesn't mean much because Cloud computer use just isn't that potent we played a lot with it I really wanted it to work we tested various scenarios but it's just very inconsistent no matter how you prompt it if you're not familiar it's essentially AI that can remote control a computer and perform various actions like open Excel sheets and the browser and do whatever you tell it to do but it's just inconsistent it's the very first version of it and even something simple like filling out a form for a job application it cannot really perform consistently across dozens of tasks therefore for now I would stamp it as sort of useless while I hate to say that it's just what we found and the rest of the internet seems to agree and this is an alternative to that which unfortunately will probably also fall in this kind of useless category but I love to keep an eye on this stuff because this is the next evolution of product like chat GPT and we'll be covering this stuff in depth as soon as more capable versions come out if you care to see what it can do there's several examples here on the Microsoft website like for example they prompted it to describe the trends in the S& P 500 and then it goes ahead and uses an API to fetch the latest S& P 500 data and it runs an llm and writes some code just to analyze the trends and it gives you a text output concluding that these are the some of the latest prices and it talks about the volatility nothing groundbreaking but interesting to see in another one would be finding and exporting missing citations in a paper so this one might be a little more practical it spawns multiple agents like the web Surfer to gather some context and then there's always an orchestrator that kind of looks at what the agents have been doing and it reviews their tasks and then eventually the orchestrator always gives you back a report on what has been accomplished again I find this interesting but I have a very hard time finding some proper use cases for these outside of writing code there all these agentic systems have proven to be really useful in assisting users nevertheless I wanted to update you as now we have a version from openi that is the simplest one of the bunch then we have mopic with computer use Microsoft with multiple Frameworks like autogen and now magentic 1 and then I believe meta is the one player that hasn't made their move in this space yet but then there's nothing for their consumer applications that really Mak sense here so far so they'll just hold out until they have something useful I guess and that's really all I got for this week I'm going to go drink some tea and get some rest and I'll see you next week with some fresh releases