# ChatGPT o3 VS Gemini 2.5 Pro: Who’s Wins? 🐐

## Метаданные

- **Канал:** Julian Goldie SEO
- **YouTube:** https://www.youtube.com/watch?v=1FSAShTheH4
- **Дата:** 19.04.2025
- **Длительность:** 25:55
- **Просмотры:** 20,634
- **Источник:** https://ekstraktznaniy.ru/video/6570

## Описание

🚀 Get a FREE SEO strategy Session + Discount Now: https://go.juliangoldie.com/strategy-session

Want to get more customers, make more profit & save 100s of hours with AI? Join me in the AI Profit Boardroom: https://go.juliangoldie.com/ai-profit-boardroom

🤯  Want more money, traffic and sales from SEO? Join the SEO Elite Circle👇
https://go.juliangoldie.com/register

🤖 Need AI Automation Services? Book an AI Discovery Session Here: https://juliangoldieaiautomation.com/

Click below for FREE access to  ✅ 50 FREE AI SEO TOOLS 🔥 200+ AI SEO Prompts! 📈 FREE AI SEO COMMUNITY with 2,000 SEOs ! 🚀 Free AI SEO Course 🏆 Plus TODAY's Video NOTES...
https://go.juliangoldie.com/chat-gpt-prompts

- Want a Custom GPT built? Order here: https://kwnyzkju.manus.space/
- Join our FREE AI SEO Accelerator here: https://www.facebook.com/groups/aiseomastermind
- Need consulting? Book a call with us here: https://link.juliangoldie.com/widget/bookings/seo-gameplanesov12

Gemini 2.5 Pro vs Chat GPT-4: Ultimate A

## Транскрипт

### Introduction: Gemini 2.5 Pro vs Chat GPT-3 []

Gemini 2. 5 Pro versus Chat GPT 03. Who is the winner? Today we're going to be testing out a bunch of prompts and seeing which one gives the best outputs. Now 03 is just been released this week. Gemini came out last month. A lot of people already saying that Gemini is the goat of coding. We'll test that out today and just see, okay, who's winning, who's the best, which one gives us the best outputs in real time live. So

### Benchmark Comparisons and Initial Impressions [0:29]

let's get straight into this. Now, if you're wondering, okay, how do the benchmarks compare? For example, we'll run through these in a second. This is an amazing website, by the way, docsbot. ai, and you can compare both models. Obviously, Gemini 2. 5 Pro comes from Google, and you've got 03 that comes directly from Open AI. Now, if we compare the stats right here side by side, you can see for the input context, window 03 allows 200k tokens, which is significantly less than Gemini 2. 5's Pro tokens, which apparently is also going to be introducing 2 million soon, which is pretty insane when you think about it. Terms of maximum output tokens, 64K for Gemini 215 versus 100K open source. Obviously, both models are not open source. And then the release date when the model was first released. So, this just came out a few days ago on April the 16th. And on March the 25th, 25 days ago, Google Gemini came out. The knowledge cutoff date is quite significant too. So, you can see here 03 cut off May the 31st whereas Gemini's cut off date is January 2025. However, you can for example inside chat GPT just enable search and then it can search in real time based on what just happened. All right, so you can connect 03 to the internet using that method. In terms of API providers, you can get these on open API, but you can also get them on open router as well. We'll be testing like how it performs in terms of the API, but also directly inside the chat here. And then pricing comparison, this is a huge difference. So, in terms of input tokens, right, the cost per million tokens from 03 is $10 per million tokens, which is way more expensive, almost 10 times more expensive than Gemini 2. 5 Pro. And the output is $40 per million tokens versus $10 per million tokens from 2. 5 Pro. Big difference in the token cost here. You can also see the benchmark comparison. Maybe we'll show that in a second, but I don't want to bore you to death with the statistics. So, let's get

### First Test: Creating a Soccer Game [2:34]

straight into testing out which one performs best in terms of creating stuff. So, we're going to be testing stuff like games, science, onepage websites, SEO prompts, tools, and full websites as well today and just breaking down these bad boys and seeing which one performs the best. By the way, all these prompts, tips, workflows, etc. inside the AI profit boardroom, the one and only link in the comments description. So, let's get straight into this. What we're going to do is we're going to plug in this basic prompt which is just make me a captivating endless runner game. Key instructions on the screen blah blah. I like pixelated dinosaurs and interesting background. We're going to get straight into something else which is creating a self-playing soccer game. All right, so let's get straight into that. We'll do the same inside both inside 03 as well and we can see how they perform. Now, one of the first things you're probably going to notice here is that from what I've seen, let's I don't want to say anything too early, actually. I'm just going to let this see how it rolls out. We'll see how it performs. But from what I've seen so far, 03 seems to be faster, but we'll see how they perform. All right, so we're getting the p5 js code back from both of them right here. So, let's see what we get. And then we'll run that through the p5 js web editor, and we'll compare them side by side in a sec as well. Right, here we go. So, we got the code back from Gemini Pro Advanced. Let's copy that and we'll test out inside P5GS. Hit play. And we have a playing soccer game. It reminds me of Football Manager back in the day, but it seems to be repeating the same loop over and over again. Let's see what happens next. Ah, the Blues are absolutely destroying them. But it's a bit weird. If you look at the way it's simulated, it's like they all just gather together in a weird block, which is quite strange. Now let's compare the output from 03. All right. So this is the output from Gemini. And then let's grab the output from chat 03. There's not even a goal. Look at that. There's no net for this is really weird. So if you look at the Let's stop that and I'll play it again. You see how there's no net on this side of for the football match. And also it seems super buggy. Like where's the red team gone? It's only blues now. So, if I had to compare them side by side, I'm going to say, and this is Chat GPT's output for sure, Gemini 2. 5 Pro wins by a long way there. And a lot of people saying from their test as well, this is not just my opinion, but a lot of people are saying from 2. 5 Pro, it's the best of tested for coding and analyzing just in general. Flash, if you've not tested it before, so 2. 0 Flash just came out yesterday. If you've not tested that before, then I would definitely recommend checking out my video from yesterday about it. Honestly, I was very underwhelmed. I don't want to hype it up and BS you and tell you it's the best thing since sliced bread and fish and chips if it's not. And it certainly isn't, mate. So, I'm not going to use 2. 5 flash again. I think it didn't impress me at all. All right. So, let's keep going through now. So, you can see here so far, and I'll make a little list of this if we put this on Google Docs. So, in fact, we'll do this on a cheeky Google sheet. So, it just looks a bit better. All right. If we had to compare him, who's the winner for the football test, the football simulator game, by far, it is Gemini 2. 5 Pro. All right, so we've got the winner for the first test. Look at this beautiful spreadsheet. This is years of spreadsheets paying off right here. Let's delete that. Pop those in. So test number uno. We have got the football simulator game Gemini 2. 5 Pro won by a long way. Right there you can see it with the UI. Let's keep going now. So we're going to test out creating

### Second Test: Developing a 3D Car Simulator [6:21]

a 3D car simulator. All right. So let's plug these in. We'll start a new chat just to get it rolling and remove the content. Let's see what we get. Now the one thing that I would say is a caveat to this is like we're using these prompts right but depending on which AI you use the most there is a clear winner for self coaching right so if you need to help making business decisions if you ever coach yourself like for me I do a lot of reflecting and journaling and that sort of thing chat GPT is amazing particularly 03 for getting like really good advice based on what it knows about you right so for example if I go into chat GPC03 and I'm like knowing what you know about me, right? Because it remembers pretty much every conversation we've had. Give me some advice or tell me something I don't know or for example, help me answer this question. What do I need to eliminate to move further on my goals, etc. 03 is almost AGI level for that. I would say it's absolutely amazing for that. I'm not going to show it cuz it's super personal and it's going to be super personalized to me. But I will say that for self coaching, 03 wins hands down. But maybe we'll pull that up in a second. But I'll try and keep it like private and that sort of thing. So let's copy that. And this is from 03 for the second test. And the second test is the car game. All right. Car game. So let's see what we get back. We're going to run the output from chat GBT3 first. Let's see what we got. And that is doing it inside HTML. So I'll run it through LiveWeave, not P5 JS. Here we go. And we have a blue screen. Honestly, I think I tested this a couple of days ago and it gave us a way better output. But from what I can see, that is terrible. Absolutely terrible. All right, that is giving us nothing. All right, so let's go back to Gemini 2. 5 Pro. I want to see is this giving us Maybe this is in P5 Jets. I just need to test this out. No, it's not working in P5 Jets. All right, so let's go back to Gemini. Gemini says it can't help us assist on that, but it's Why has it stopped there? It's failed the test. I'm going to give Pro another sort of just another opportunity because for some reason it got confused there. And I'll run it through AI Studio instead cuz it seemed to get confused inside the chat. Let's see what we get back. A lot of people saying it's good that Google is the best. I'm interested to know more on that. Does some people prefer Google over Chat GPT and OpenAI? I'd be interested to know more on that. for me like chat and open AI in general it does get a lot of hate a lot of people hate on them so I'm interested to know why that is the other thing is as well if you're using Google products a lot like Google Drive Gmail etc then you can imagine as these models get more advanced you're going to be more and more in the ecosystem for example the iPhone and the Mac and how that all syncs up it's the same with the Google ecosystem right if you run your business on Google then it's going to be much easier to integrate that it's like soft thing. I can't measure in tests, but yeah, I would say for sure like that's going to help and that's only going to advance more and more over the time. All right, so here's what chat GBT gave us. Chat GBT3, it gave us this the most advanced OpenAI model in the world. Now, here's what Gemini 2. 5 Pro gave us, right? A million times better. All right, so let's see what we got here. Oh, it's just incredible, isn't it? Look at that. We're flying through. We're roaming around. We're having a great time. It must be a Tesla. Those buttons don't work, but I'll let them off because the game actually works on ChibiTs. All right. And 3D graphics are not bad at all with that little train going around, roaming around. You can't argue with that. How that goes pretty far back as well, doesn't it? You got a nice little circular train route right here. Beautiful. Let's try and find the train. That is amazing to be fair. Look at the landscape. It's just incredible. We're just zooming around and we literally built that in one single prompt. How good could you make that game if you actually spend a bit of time on it. So for sure Gemini 2. 5 Pro is just absolutely steaming ahead right now and 03 is struggling my friends. So let's try something else. Now we've tested the game prompts. I'm not going to do too many more games cuz that's not what makes you money in my What we're going

### Third Test: Generating a High-Converting Landing Page [10:46]

to do next is we're going to try and create a onepage website. So, I'm going to say generate a high converting landing page blah blah from SEO agency. I'm going to see if they can actually research information about me as well, but we'll come on to that in a second. So, if I put canvas on right here, we'll put the canvas here and we'll see research Julian Goldie and his agency. Then generate high converting landing page for his SEO agency blah blah. We'll do that and we'll do the same inside chat GP03 which so far has let us down quite considerably but we'll give it another cheeky the good thing about this is I can search the web right so with chat GP03 which is probably going to make the outputs better but we'll test that in a sec we can do grounding with Google search as well so we can use Google search inside here so I'll do that inside AI studio I'll use Google search as well to use the same prompt and see what we get back in a sec I like the fact as well that chat GBT brings up the canvas So you can integrate the search with the canvas. I'm pretty let's have a look. I'm pretty sure Google Gemini advanced inside the chat here where you get the canvas option. You can't connect to Google search as far as I'm aware. It's just using it knowledge already. If we go inside AI Studio, which is using Gemini 2. 5 Pro as well, it should be able to research Google. You can see here we're grounding with Google search and then we'll see what we get back. Some people were saying that Grock would beat Gemini 2. 5 Pro. And to that I would say check out my video comparing Grock and all the other models versus Gemini 2. 5 Pro. Personally, I wasn't impressed. Like the first day I started using it was amazing. And then after that it seemed to get dialed down. Like it just didn't give me the same outputs as that. I wasn't that impressed. I just don't use Grock anymore for that reason. Compared to Gemini 2. 5 Pro and Chachi Petite, I just don't think you get the same outputs. So can we run this? I don't think we can on the canvas, but we'll run this inside LiveW weave anyway and see what we get back. So, let's plug that in. Here's the landing page. It's not bad at all. Let's see if it's got any information about me. It's got a little bit of information, but it's still quite generic. Organic growth, authoritative link building, technical SEO content, blah blah. It's still quite generic information, right, that it's finding you. To be honest, you're going to get much better outputs from something like Gen Sparker Manus if you do this job, but it's not bad. Let's have a look what we got back from chat GPT03. So, let's click on preview. See what we got. Well, like that. I would say both of them were pretty poor there. I'm not going to hide this up and tell you like this is amazing. This is super basic. Look at that. I'm a little bit disappointed. Come on to coding with the API. Maybe that will give us better output since R code or client in a second. But these are not great. And I think that's actually unless I'm Yeah, I think that's a madeup hallucinated testimonial as well. I don't think that's a real testimonial as far as I'm aware. We have a lot of testimonials. It's hard to keep track, but that seems totally misleading. If I'm going to compare them, I'm going to say that Gemini 2. 5 Pro created a much better landing page. Like, it's longer, it's better designed, the testimonials are actually real. For example, like this one and this one. This one too, it's using real case studies and the design is much better. Plus, there's more content on the page, right? If we have a look at the chat GPT output, super basic, doesn't look great. You would never publish that, right? You never in a million years. So, I'm going to go with Gemini 2. 5 Pro again. All right. And you can see here, Gemini 2. 5 Pro is absolutely crushing chat on all these benchmarks so far, which is pretty wild. Let's go on to the next task. I've never actually seen a test this unanimous. It's unbelievable. So, let's come on to another one. We're going to say, okay

### Fourth Test: Building a Snow Day Calculator [14:36]

create a beautifully designed snow day calculator inside both of these. We use Gemini 2. 5 Pro inside Canvas. By the way, someone was asking me yesterday on the live stream like, "How do you get the preview on Gemini? " So, if you're using Gemini Advance, which is a paid version, and then you click Canvas over here, then you can start using the canvas inside 2. 5 Pro. It will give you an actual preview. But it's so far from what I can see, Gemini 2. 5 Pro is just absolutely destroying chatb3, which is blowing my mind cuz this came out nearly a month ago. So, we've got the snow date calculator back from chat03. It's not bad. It's not bad at all. It works. Let's test this out. Need to find a US zip code right here. All right, let's take that. It's not working, is it? I'm clicking calculator here, but nothing is working. All right, let's check out Gemini 2. 5 Pro. So, straight away, you can see from the UI, right? Look at this. You see how there's like a nice little icon here for the snow day calculator and there's like estimate the likelihood of snow day. Like the content itself is written much nicer. This calculator actually doesn't work from Chad GPT. So, I've tested clicking calculate. Nothing happens. Now, let's go over to Gemini. The writing is way more humanized in terms of how it's written. And then we'll put the form in here. Hopefully, it works. Calculate probability actually works. All right. And it's actually, look at the way that it's written. Get the sleds ready. A snow date is looking very likely. If you compare that to this one, like number one, it doesn't work, but number two, like the content is really just AI. It feels like AI. There's no life in it, right? And then if you look at the way the heading is designed, just little touches like the icons here make the Gemini Pro calculator a lot better. So, Snow Day calculator, Gemini 2. 5 Pro is just absolutely destroying Chad GBT. It's absolutely redonkulous. All right. By the way, if you want all these prompts, just get them inside the AI profit bordering. This also comes with a community focus on just making more money and saving time with AI based on how we've implemented all our systems. So a lot of people talk about using AI. They talk about how to scale with it. But there's nothing practical in there. Whereas for example, we've actually taken all the systems that we've used to grow and scale our business. For example, we reach millions of people on YouTube each month. Twitter each month. We have a big email list, etc. And we've automated all this stuff using AI and all the systems right here in the crash course. So if you want to steal our best systems, get them inside the AI profit boardroom along with weekly Q& A calls, all our best SPs and an amazing community of people. You can have 670 members here. Any questions you have about AI and then we're happy to help you. Like you can see inside the community, everything is getting an answer quickly. All right. So, let's jump straight into this and we'll get back in the res here. So, let's pull this up. What we're going to do next is

### Fifth Test: Creating a Five-Page Website [17:37]

we're going to try and create like a five-page website. This might take a little bit longer to test out. So, we're going to go inside Visual Studio Code over here. And I'll use Root Code for doing this. All right. And then we're going to go inside the settings and we'll select Gemini 2. 5 Pro to begin with and just test this out. All right, I'll use the paid version just so that we don't run out of tokens, but you can use the free version on open router. That's another thing here is like you can actually code for free with Gemini 2. 5 Pro, whereas you can't use chat GPT for free. All right, unless you were rinsing the trials that I was telling you about last week for Optimus Alpha. So, we're going to say, okay, create a five-page website for Julian Gold's SEO agency, blah blah. We'll run that through R code here, and we'll see what we get back. Now, if you're choosing between using the chat interface or you're using like R code and Visual Studio Code, by the way, I have SOPs on all this stuff below, then what you're going to find is that for creating bigger projects, this is much better to use inside Visual Studio Code. However, if you want to create like just a onepage landing page or a quick calculator, etc., then it'd be much better to use the chat interface directly. It's going to be quicker, it's going to easier, you're going to be messing around less, etc. Now just whilst we're waiting for that to load, you might be wondering, okay, what are like the technical benchmark comparisons like in terms of performance metrics. So if we have a look here, Global MMLU is not available for 03, but for Gemini 2. 5 Pro, it is 89. 8%. You can see for diamond science, Gemini 2. 5 Pro is just outperforming 03. For competition maths and Amy tests, Gemini 2. 5 Pro, humanities last exam 03 is winning. S swe benchmarks so software engineering capabilities 03 is outperforming Gemini 2. 5 Pro but I just I don't see that in my own tests and then MMU so massive multi-task multimodal understanding they're tied but 03 is beating it by about 1. 2% 2%. But again, I don't really honestly I don't trust these benchmarks. I only trust my own tests. I always think that's the best way. So, let's see what we get back from 2. 5 Pro right now. Pretty bad website to be honest with you, but it works. It's super basic. You'd have to spend a lot more time just coding out, building out, but you can see here it does actually work. It has c created like a five-page website. You need to go back and forth with Gemini 2. 5 Pro. I would give that a five out of 10. All right. as a oneshot prompt. Let's run the same thing now using 03 directly. So, we're going to take the same prompt and then we're going to start a new task. We'll go inside the settings and switch over to 03. All right. Open AI 03. Make sure you don't select the mini model. You want to be using 03, which is the latest model here. And then we'll go inside here and we'll give exactly the same prompt to chat cheaper 03. See what we get back. And we're getting an error right there. That is not ideal, mate. What's going on here, sunshine? All right, maybe we'll switch to Open AI directly. Just going to have Oh, look at that. Your organization must be verified to use this model. All right, so it's not working on Open Routter and it's not working. Let's see if we can No, we can't. Open A3 is not working in recode. That is so weird. Let me try client instead. Not a great start there. Let's switch over to client. But again, okay, what's working? What's not here? So, Gemini 2. 5 Pro work perfectly inside Open Router. Let's test out and we'll just grab a new API key from Open Router. If you ever need to know how to do that, just log into OpenAI, grab a key, and then you can create a key here. I'm just going to do that in the background in a sec. Run over to Visual Studio Code, plug the new API open router key here, hit done, and let's retry that. You kidding me? 03 is just not working on the API. That's crazy. All right, that settles it. So, fivepage websites, Gemini 2. 5 Pro. So, just to recap here, this is blowing my mind because I've never seen anything as objective as this. It's weird and feels biased, but it's not. So, test number one, the football simulator game 2. 5 Pro smashed it. Test number two, the car game Gemini 2. 5 Pro. Landing page, Gemini, Snow Day, Gemini, and fivepage website. Open router wasn't working. 03 inside the playground wasn't working for me cuz I had to verify my business which means I can't actually start using the API. Massive problem. That is a full suite, my friends. house that Gemini has. Crazy stuff. I've never seen that before. I'm absolutely gobsmacked if that's an actual phrase. All right, I'm not going to do any more full website tests inside Root Code or anything like that because, you know, it doesn't work. Let's give it one more shot. I'm going to give this one more opportunity to 03. We're going

### Final Test: Building a Retro Synth Keyboard [22:37]

to try and build a retro keyboard here. So, let's go back into 03. Feels pointless at this point, but I just want to be I want to give them a shot. cheeky chance. All right. So, we're going to say build a retro synth keyboard in HTML. We'll do the same inside Gemini and we'll see what we get back, peeps. Here's the code. Let's give it a cheeky whirl. I don't know why it didn't let me test that in canvas to be honest with you. But anyway, let's plug this in. So, this is the output from chat GBT. It's not looking bad. It's not bad. Let's test this out. All right, it works perfectly. It work. It definitely makes a noise. Here is the single HTML file. Copy and paste it in the browser. Let me just delete those at the top. There it is looking pretty retro. We'll just delete the HTML code at the top. There we go. We got the retro synth. Not bad at all, my friends. Not bad at all. Let's check out Gemini now. I should have tested in canvas. Rookie error there. Let me build it again with the canvas enabled. It's got Yeah. So, let's see what we got here. So, we got the Retro Synth keyboard. It works perfectly. We can switch between waveforms and we can change the volume as well. So, that's working really nicely. Now, let's check out the Retro Synth. The main thing that I would say here is like the UI is pretty nice on Chat GT, but there's no volume. There's no switching between waveforms. The keyboard itself looks tiny on the preview, which is weird. Like all this black space. I'm going to have to say, my friends, retro synth keyboard, I'm going with Gemini 2. 5 Pro. All right. And the reason for that is it's got the waveform UI here. It's a much bigger keyboard preview. The you can switch on the volume. Again, 2. 5 Pro absolutely smashes it. So, overall, you

### Conclusion and Final Thoughts [24:18]

can see who the clear winner is. I'm going to stick with. But just over the last sort of 30 days, Google was really stepped up. Like Gemini 2. 5, sorry, Gemini Advanced Pro was never something on my radar up to about 30 days ago. So you can see who wins. You can see who the winner is. It's unanimous. Absolutely unanimous. So thanks so much for watching. If you want to get a community packed full of people focused on making money, saving time with AI, feel free to give that inside the AR profit boarding link in the comments description. Inside the classroom here, you're going to get all my best workflows that tried, tested, and proven. and is way better. On top of that, also you're going to get a crash course based on everything I've practically implemented into my business right here. So, you can see all my same systems, my best SPS as well. There's tons of SPS in there. You can watch back previous Q& A call recordings, plus join the weekly Q& A calls like you can see on the weekly schedule here. And on top of that, you can post inside the community and ask 670 members any questions that you have about AI that you're struggling with. On top of that, if you want to get a free one-to-one SEO strategy session that shows you how to get more leads, traffic, and sales, feel free to get that link in the comments description. And we'll show you how we take websites from zero to 145,000 business month and generate hundreds of thousands of dollars in sales and autopilot on this free SEO acceleration session. You're going to get a custom tailored game plan to generate more leads, sales, and profits based on what's working for us. And you'll also be able to ask any questions you have onetoone on the call. So feel free to get that link in the comments in description and I will see you on the next one.