Demonstrating Operator

can you tell me your name and what you do with openi yes my name is shun no and I'm a research lead of operator in openi and what is operator uh operator is a resarch preview of an agent that uses browser to uh help user to do things so I have three-year-old kid who likes a pasta so I uh make a Linkin with Clan so I ask it to buy the groceries for it so I will use insta car Tab and operator can actually basically use any websites without and it is not particularly optimized for insta card but the reason why using this app is that it provide the uh detailed instruction of how this website can be best utilize just like the tutorial that human can benefit from so I'll use instaart tab and ask it to solve task could you find the uh recipe of Linguini with clamps uh from or recipes website site and add all ingredients to uh the grocery card or install card I think I already have um some ingredients like butter vegetable oil and uh What uh and black pepper so you don't need to add them to the card so it says that I'll find recipe and then add everything in the uh ingredients to the car and okay it says that it'll confirm the ingredients and store with me before adding them to the car so let's start by uh finding the recipe I'm not doing anything from now on the operator just doing and I just watching what it's doing what is interesting with the operator is that is it is using browser that are built for the human and it is using the seeing the exactly same scrip that I'm seeing right now and using the keyboard typing and mouse clicking to control the Brer just like human would do this is different from other agents that uses uh API or programming based interface which programmers might understand but nonprogram users cannot uh understand really well so operator because it is using the uh this natural human interface it's very easy to follow by just looking at what it's doing in the screen can you follow its progress uh yes so one way to following its progress is I can zoom in to see the screen better and operator is powered by the text based uh Chain of Thought reasoning so whenever it is doing things it uh says uh it makes plans how things can be done and this can be followed through this uh list of the dots and it says like found a recipe and uh which store would you prefer to use so I'll ask use uh guses so often it has clarifying question whenever it is needed uh is needed in the process of solving the task there are cases that operator have to uh make sensitive actions like things like logging in or buying things in this case we built operator to be safe in this situation so operator is designed to ask uh us to take control to log in by ourselves or whenever needed checking it gives us the control so that I can double check whether the list is correct and then checking it by myself amazing thank you so much I appreciate you showing it to us thank you so much