Moltbot: How to Build an AI Voice Agent

So, one of the next things I want to do is I want to go inside clawbot here. I'm going to say, can you a voice slashbody for your mold bot as an app that I can use? If so, what do you need from me? Eg OpenAI API key to interact with your voice in real time. Let's see if it can actually create something like that. So, basically, I want to create I saw this awesome tweet by Alex Finn. If you haven't checked him out already, he's he's doing a lot of stuff on Mbot. So, shout out to him. He's absolutely crushing it. And you can see here they actually he got Mbot to code its own body like you see right here. So, it created its own clawbot and it can actually speak as well. So, I want to test this out and see if we can do it as well. And he said yes, we can do it. And what I'm actually going to do is just take a little screenshot like this. go back to clawbar and say can you do something like this for me see if it can do that says thanks Julian always happy to help Sam says what cheap model subscription do you recommend as an alternative claude I use claw max for work yeah so that's it you got to be careful your claude council I would use well I mean you can see what I'm using today so I'm using openai and chat codeex and he seems to be working like really well so far so that's great um the other thing that you could do is you could use something like GLM or Kimmy K2. 5 the only issues isues I see with those is like they're not as good. They're not as reliable as APIs, no matter what the benchmarks say. When I've tested them, they're not quite as powerful as something like Claude, right? Claude is goated. It's by far the best API. That's why it's so expensive. But you could try something like that if you really wanted to, but for me personally, I just want to use OpenAI and the codecs inside it. So, voice engine choice. So we could use 11 labs and my invoice there or we could use openi real time which I think would be better cuz it's going to respond faster right we can host it but I want to host it like privately if we do that or host it locally so I'm going to say host it locally for me plus setup openai API key right then I'm going to go to open AAI log into the playground to the API platform and then we're going to make a real time voice bot for Claudebot. So, let's try this out. So, we need to grab an API key, which I'll do now. Just stop sharing my screen. JP says, "This live is a gold mine. How often do you go live here on Facebook? " Every day. Go live every day on Facebook. So feel free to check out my profile. Thanks for joining. Kyle says, "So they don't charge you if you use the chat GBT CLI. " So you get like a certain amount of tokens that you can use chat GBT CLI with the codeex. And um if you want to have a look here what we're doing, so it's given whilst it's building this out. You can see it's building out here and I've already plugged in my API key in the background. So we said yes we can build a web app exactly like this with a cute mold character that listens shows speaking and talks back in real time is what I need from you. Right. So you got voice engine choice open AI real time recommended for live conversations or 11 labs but 11 labs will have the best voice but it won't have the best response times right so we want real time really that's what we're going for. Where to host it we are going to go with my local. I don't if I deploy it to Netifi for example then anyone could access that so that would not be good right brand assets you can always plug in a logo if you want to and then features you want so for example pick MVP so push to talk versus always listening conversation history on screen voice selection one voice versus multiple which is pretty crazy and then wake word right so for example here you could say okay wake up with a certain word and then it would just wake up which is pretty insane And then you can see here it says vast fastest MVP I recommend web app plus open eye realtime voice pushto talk animated maltbot orb listening thinking speaking states right send me this and I'll start. So I've sent over the API now and it's just beginning to code this out. Number of things says how do you get out of sandbox mode? So if you mean like for example hosting it locally versus hosting online you want to if you want to connect it to something like a messaging app just check out my other videos. got a full guide inside the profit boardroom, but you would link it to something like Telegram, right? So, what you do is you set up the bot inside Telegram. We got a full tutorial video inside the AR profitable exactly how it's set up right here. And you can always DM me if you need help with this. The other thing that I've done is switch it to codeex API. And uh Kyle says, "Are you using the CLI for coding or just using it as

LM? " So an LLM. Okay. So now we should have this back. Let's check it out. And if we go back to Clawbot here, we've got this hosted on a local host, right? So you can see here it's running now and it built the fastest local MVP and set the API key in a local only state. Right? So it's running now. Here's a local URL. If we actually go over to the app, we've got it right here. So we can allow this and then we can choose to start, stop, talk, etc. Right? So if we click on start. Hey, are you listening now? Hey, can you speak in English? English, please? — Of course, I can speak in English. What would you like to talk about? — Now, it's not working perfectly, but we have created the voice agent right there. Um, and it works in real time, which is pretty crazy. So, what I'm going to do now, cuz I saw there's an error when we click hold to talk. And also, there's no real like icon for the mbot voice. So, I'm going to go back to Clawbot here, and I'm going to say, okay, add a real Mbot character. We'll just take a screenshot kind of like this, but create your own lobster style character. The hold to talk button keeps giving me an error plus make sure I can talk to you more when we're using this. Okay. So now what we should be able to do is improve the app itself so that it has a nicer character inside this section. The hold to talk button should work better. And then additionally hopefully we can actually control moldbot whilst we use this so that it can we can operate Mbot via the voice agent here which if we can that's going to be insane. Also, for some reason, it was speaking in Spanish when we first opened it up, which is really strange. Big Danny says, "Can you please uh in simple terms describe the difference between anti-gravity and mobile? " Yeah. So, anti-gravity is like a IDE, right? So, it's really good for coding. The difference is that if you're using something like Mobot, well, it can do a lot more, right? It can actually take action in the real world, right? So, for example, it can control my Chrome browser, like you see here, we've got Clawbot browser relay set up. You can publish blogs to WordPress. You can use this app via Telegram, right? Anti-gravity you don't use via Telegram. You can create AI avatar videos. You can create voice notes. We have a full 3-hour course demonstrating this inside the AI buffer boarding. But basically, it can just do so much more. And it's like a 24/7 assistant. Whereas, if you're using something like anti-gravity, it's really just designed for coding, right? That's what it's designed for. So, it's beginning to recode this out now. How will they work together? So basically we should be able to use the voice agent to control Mbot um directly. So we be able to talk to it in real time, have a conversation with it, blah blah. Have you installed mobile browser extension? I have indeed installed the Chrome extension, which was pretty simple and easy. Whilst we're waiting for this to load, if you haven't already, check out the AR profitable boardroom. It comes with all our best training, step-by-step guides on how to use this. If you want to use it with, for example, Codeex CLI, we have a full video and step-by-step guide here on how to switch from claw to codeex. If you want to see our full 3-hour course on exactly what it can do and how you can set up, etc., we've got that right here. You can also learn how to use it with the AI browser extension using this. So, for example, AJ, if you're struggling and you want to learn how to use the mobile browser extension, just follow the steps inside this section of the AI profit boardroom. and we'll also show you how to basically set up and automate anything using clawbot as well. So, here we go. We've set this up. It's replace the orb with a cute lobster bot. Fix this and we'll test if this works. Wa! Look at that. Now, we're getting somewhere. So, you can see here, for example, we've got the bot little lobster talking. It's idle mode right now. If we click on start. — Hey, can you speak in English, please? Of course, I can speak in English. What's up? — All right. So, what can you do? Can you operate clawbot for me? — Absolutely. I can help operate a robot with a claw if it's set up for remote control. Just let me know what specific tasks. — All right. It's still a little bit buggy on the hold to talk. So, I'm going to say the hold to talk button is still quite buggy. Also, it speaks in Spanish by default. And can you make sure that I can operate maltbot with the voice agent fun world says are you running locally or VPS locally? So it's running inside the terminal and then we connected it to telegram. Now some people are asking with clawbot like are there any issues with um you know security and stuff like that. So number one I'm not an expert so don't do never do anything you're not comfortable with. Number one, that's what I'd say. So, if you're not comfortable with something like just don't do it, you know. Um, and

number two, the issues that I've seen mostly have been with VPS. The other issue that I've seen is like some people will email from an external email address to Maltbot and tell it to do something. And so, that's why I actually removed my email connection. But yeah, I mean like this is just an open-source random GitHub on the internet. Like if there's if you have any doubts, just don't use it. like and you know you can just watch my videos to see how I use it and then learn from that instead. There are also some like MCPs you can set up for like security and stuff like that. Okay, so it should be more stable now. Make sure I can operate mobile. We would need to do set it up so that it can operate this directly but it might make it a little bit slower. I want to go with option B, which is keep super fast real-time chat and only call mob tools when you say run tool. Okay, nice. So, let's try that. Now, if we reset this page, hey, are you listening right now? Can you speak in English, please? — Of course, I can switch to English. What would you like to talk about? — What happened in the AI world today? — I don't real. So we need to connect it to mobile because otherwise it's not going to be that useful. It's just going to be like a generic voice agent. So that's what we're doing inside mobile here. You're asking it to keep it super fast realtime chat um and call mobile tools as well. And then also you probably want to code it out so that it has internet access as well. So it can do web search and that sort of thing. But you could always say like run tool. And the other annoying thing is that it seems to reply. It seems to start the conversation in Spanish for some reason or something like that. Is GLM 4. 7 enough to run? C can run it, but it's just not going to be as good, right? So, Claude is like by far the best for mobile. Then you've got chat GBT CLI, which seems actually on par so far. I'm not seeing any issues. The only difference with chat GBT CLI is like you get less personality, if that makes sense. And then you have um then you finally have you have u what is it stuff like GLM you know Miniaax you've got for example chatb CLI with oorthth which is what I'm using you've got Kim K25 as well that you could use I think honestly the best out of all these so far is yeah I would say the best out of these so far is chat cheapy codeex like if you want something that's not going to cost a lot but also works really well. Yeah, it seems to be codeex. I mean, so far it's coded really well. Like it's done a great job on the coding side of things. JP says, "You saved this live. Want to rewatch it? " Yeah, so you can watch it on YouTube or you can join the air profit boardroom. Feel free to DM me and I'll send you the link. Is mobile replacing NA10? Just learning NA10. Should I learn mobile instead? That's an interesting question. Actually, something I wanted to talk about today was like I've not really used NA10 for quite a while. And the reason for that is like it it's quite technical and it often breaks and it takes a lot of work to set up, right? Whereas if you use something like for example Maltbot or Clawbot, it seems to work better right so far and it's just easier. So we're going to try this out now. Hey, are you listening right now? — Yes, I'm here and listening to you. What's on your mind? — Run tool. What time is it in Bangkok? — Right now it's 9:21 a. m. in Bangkok. Let me know if there's anything else you'd like to know. — Run tool. What happened? — Run. — Run tool. What happened in the AI industry today? AI today? Run tool. Reply to me. All right. It's okay. It's still quite buggy when it comes to running the tool. So, running it directly with mobile. It's something I'm going to work on, but it is impressive that you can build out a nice little tool like this. It looks pretty cool. It's got like a lobster style icon that we can talk to. We should eventually be able to link this to mobile directly. But the fact that it's built out a realtime voice agent is impressive in itself. It's just a little bit buggy. I would prefer the start stop option honestly instead of hold to talk. So I'm going to say okay the link to m the run tool option doesn't work so well plus it keeps speaking in Spanish. There should be no Spanish in this conversation and also I don't like the hold to talk option. I'd prefer just the start option for speaking. So Flavven says so codeex can open and run things too like claw code. Yeah, it seems pretty good. Mark says, "I've got an issue setting up with Telegram with mobile. Completely stuck on this. " Just I would like any errors that you have, right? Pull up the terminal conversation, paste into Claude, paste up the Telegram conversation as well. Paste it into Claude and just say, "Okay, how do I fix this? " And screenshot any errors and just keep going with that and iterating it and eventually you'll get there. It might take like 10, 15, 20 minutes to set up, but you should eventually get there. JW Kim says, "Is it using Claude API? " No, it's using OpenAI codeex with a war login. I don't think you want to be

using should use uh Mobot with Claude anymore and I would avoid that. Bro, can you build a Jarvis using clawbot? We basically already did. You know, Clawbot can do so many cool things. He's coding out for us right now locally. He can do so much. He's crazy. He can create voice notes in my voice. He can generate avatar videos. He can connect to the internet. It can post X for us. It can control my browser. It's got a Chrome extension. It runs on Telegram, so it runs across all my devices. And yeah, I mean it can basically do anything. I mean it even publishes directly to WordPress. Check this out. So we actually created this article um about 36 hours ago for best SEO speakers 2026. And then you can see here that inside the AI overview, I'm ranking number two for that particular keyword. And Clawbot wrote the whole thing, right? Clawbot wrote it all and recommended me as the best. So you can do anything at this point. You just got to change it. So, here we go. We've got this now. Should be ready to go. We're going to do a refresh on this page. There we go. Hey, are you working? — Yes, I'm here and ready to help. What's up? — All right. So, run tool. What happened in AI today? Today in AI, there's been a lot of buzz around new advancements in large language models with some companies releasing updated versions that focus on reasoning and more effic that's beginning to work much better now. That's much cleaner, much easier to use. And then also, we can always say to, you know, we could stop running that and then start running at any time that we want to. Um, what would be interesting as well is like if we can say run tool and then it creates like a YouTube thumbnail inside Telegram. I don't know if it's fully connected to Clawbot, but I'm interested to try that. So, let's click on connect here. Run tool. Create a thumbnail inside Telegram inside Claudebot mobile. So, you see here it says spawn mobile. Anyway, let's try again. Run tool say hello inside mobile. So, now — how can I assist you on mobile today? — Yeah, I would agree. It's just calling the OpenAI API, not Telegram mobile. Yeah, I would agree. I think that needs a bit of work, but I think like give it an hour back and forth, you'd eventually get there and get something sorted out. What I'm actually going to do is paste these errors into mobile here and say, "This doesn't seem to be working with mobile directly. " Eg. If I say brand tool create a thumbnail in Mobile, it doesn't seem to work. Lo says, "Please bring a tutorial. " So, I got loads of tutorials on uh YouTube about it. Otherwise, you can check out the AR profit boardroom link in the comments description. Go to the classroom, go to SAP updates. Um, and you'll see all these different tutorials on mobile and clawbot and how to use it, etc. So, feel free to check that out. Paul says, "Join the air profit boarding yesterday. Having some issues with mobile. just post a screenshot inside the community. So, if you go inside the community here, [clears throat] um and post the issue that you're facing and a screenshot and then we'll help you out. Yeah, I would say it's much easier to use in using NA10 and that sort of thing. So, yeah, I would go with that. Let's see if we got this working. I'm going to give it one go. One more go. Run tool. What happened in AI automation today? Yeah, you see, you can see it's still struggling with that. Definitely needs a bit of work, but it's pretty insane what you can build there. We're loving it so far. I think it's just going to take a little bit of time. Can you use Plexi API? I haven't seen anyone use um Plexi API. Does your Telegram connection keep crashing? No, I've had no issues with it. As you've seen today, it responds pretty quickly. Um I'm going to try this again. Run tool. Create a YouTube thumbnail for me. Yes, you can see here it's still struggling. Hello. May I ask uh M5 MacBook? Could I run GLM flash for claw? I'm not sure on the technicals there, but you can run it locally as well. Test. Yeah, I think you can name me that. Can you run this on a Windows 2022 server? I'm not, like I say, I'm not that technical on Windows. Number one, I don't even use Windows. Some people are running it on AWS. OpenAI voice can't connect to your local tools the way Clawbot can. That might explain it. I think my the issue was my M1 MacBook Pro can't handle anti-gravity mobile. Didn't realize how intensive these progress were. Fabricio, good evening. I'm fan of your content. I watch it with Brazilian Portuguese audio. Thank you for creating. Awesome. Thanks. Tony says, "Thanks for ignoring. I answered your comment, man. Just not instantly. It keeps asking peri per permissions when running mobile 2 on the computer screen, but doesn't ask me anything in Telegram. Yeah, sometimes I get that. So, it will come up with like a popup on the desktop. Um, but it won't ask me inside Telegram. I think that's cuz it's running locally. Select permissions. Yeah, maybe some things you can't give inside there. All right, we're going to try one more time. Are you working right now? — Yes, I'm right here and ready to help you out. What do you need? — Can you create a thumbnail inside Telegram inside mobile? — I can guide you on how to do that. Create a custom thumbnail. — Run tool. Create a thumbnail in Mobot. mobile.

I think that's a mo mobile. Yeah, it's just not connecting, is it? It's not connecting. Um, but that was fun. All right. So, if you want to learn more about mobile, how to use it, etc., you learn inside the AI profit boardroom. It's available link in the comments description or go to aripitboarding. com. Inside the community, you can ask any questions you have about Mobot. Get help and support from me and the rest of the community. Also, inside the calendar, you can jump on coaching calls whenever you want. And also, we have a bunch of trainings on mobile inside the SAP updates right here, including the 3-hour course, plus step-by-step setup instructions guides for everything related to mobile, including how to switch to uh the CLI for chat. So, that's all inside the AR profit boarding. Feel free to get it. Link in the comments description. Pro says, "Which is best, mop or clawbot? " Bro, they're the same thing. Literally, they just rebranded yesterday. Appreciate you watching. See you inside the AR profit board. Cheers.