Dendi vs. OpenAI at The International 2017

well as this final match is getting set up for the day in between the last matches we have a costume competition and now we have a little bit of a special treat before we get into that lower bracket match a special treat indeed sure and this is something special so get your bum in those seats I see you think it's time to get nachos it's not sit-down because you've got something very cool for you guys here at in the key arena and at home you get something special every year and this time I think they may have outdone themselves my pleasure to introduce it and so ladies and gentlemen of T arena and at home dota fans around the world it is time for a battle like no other you've had five players in these booths five versus five how about we do one versus one like you've never seen before I know there is something rather exciting in store for you and in order to get a one verse one going we have to introduce your contenders it is my absolute pleasure and please raise the decibel levels raise the roof as we introduce your first champion remain a duty tank I'm in the main room or toothpaste remain a duty on the department would be a buddy Oh they start a fight the witness he would meet me on the kata he prohibited Brita water pool and gentlemen take it all in bag you've made every single international it would have been a shame not to make this one way or another you stand on this stage how you doing dude amazing ah you've been playing in the practice for this 1v1 oh yeah I'm totally ready that's not what you were saying backstage sorry to me my name red you know he's ready he is ready guys one more time Dendi is your first contender I need to get me one of these but now he needs an opponent for this 1v1 who will stand the test of Dendi on this main stage strap yourselves in ladies and gentlemen because it's time to meet dendi's opponent here we go hi I'm Greg from open AI in San Francisco we brought a 1v1 shadowfiend bought to this year's international to match up against the pros the spot isn't like anything you've ever played against we didn't program it to understand the world of dota we just let it play lifetimes of 1v1 against itself and coach it on what we thought was good or bad and now we want to see how it stacks up against the best players in the world I'm Raphael I'm we've open the a my name is Jim um I'm Greg hello I run open AI would you like to play again we'd like you to try our books all right so before you get started just wanted to know have you ever played against a dota bot before are you kidding for three months I played only against the bots I have more in common with them in a normal build

appoint oh well maybe I tried it once just to see what it's like pretty much none at all honestly have you ever played about and does yeah it sometimes when I just want to warm up what do you think of them they're pretty awful how good you need to defeat the boss you don't have to be great could you imagine a bot it's actually better than the best players no do you think you can beat my confidence as yes then my belief in science says no hopefully my confidence window could you think your game yeah ready okay let's do this play some dota 2 rules no bottle no neutral no rooms and rain jobs no shrine no song so if I get first blood it's just over to kill it's just going to be signed one cool and good luck I just destroying it dang okay we're already in trouble let's assign them no I don't think it is good oh good lord oh we are pretty bad [ __ ] the ham so it's just impossible to kill it mmm very fired okay he's ignoring the ferry fires the vadas good about it better than I could have ever imagined like playing a smarter version of me not being able to kill him fire destroy oh my god he's so fast No Oh seems a bit impossible oh thanks me a couple of on yeah what you turn it up for do you think then we can visit hmm now I think then D which is pretty much to it good luck then this bit like sandy is outstanding you don't need it he's got a shot no oh man it really doesn't make sense sending you've heard about it now you're going to be playing against it do you can you comprehend the idea of a bot being better than you I don't want to do it please believe it I hope I can beat it I'll just leave in game it's just about I am joined us yet introductions out of the way I'm joined by two guys from open AI a 10 man team who have been working on this we have Greg and yeah cool now guys I'm gonna ask you a question here and it's very simple you've been working throughout the whole week getting some the prozium we saw on the screen does then d have a chance versus you're AI there's always a chance ok we'll be talking more about how on earth this has come to be but first I want to get this first game underway Jakob let's hold on to our horses and let's see what you've got then d oh ok yeah let's go the rule shadowfiend 1v1 mid no bottle no runes no neutrals no raindrops no shrines no soul ring 2 kills are at our Dendi that's not hard right oh it's frizzy against the box right then you're thinking about it or taking get something good have you ever lost a game to the bottom normally in Doha yes of course it happens a few times okay any advices guys so should I buy okay sounds like rapier okay guys let's give him some words of encouragement did you ever think as a dota fan Jakob you'd be wanting Dendi to lose oh no I'm joking it's not a valid dumb joke here we go he's blocking the creep this is a good luck whoa we're creeps come on what give me dreams since always okay this guy's scary I need to bring forth already I never thought I would stand here and watch you flavor so hot and not nodes in a way never felt so too scary one who q you see the Tao he's carrying he's going anything you scared of a pothead oh did it just take him out

it definitely does that it's getting a little free faster than me that's not good without safe whoa take it easy I need to do the strange creep to die good night okay and another faucet and some stuff these guys carry oh my god how's he doing so far pretty well glowy the bot is also strong defender FN go either way still just to clarify this fort has beaten to nail the spotted seems to melt will provide no pressure how about our team hasn't either ten zero because tears rise okay bring up some more first 24 damage I guess I'm losing the creeps a little bit wait out a tank does it feel like a player like a person nope he please stop boozing me Stacy's Omaha no mana but he have mango Nikki but go ahead and he Muhammad was ended up basically well played I guess I need more patience first to kill okay although I just saw song don't touch me guys I think he needs some help Thank You didi so stay in your seat sending who I'm going to talk to these guys these are mines behind it now you weren't alone we have to have Greg and Jakob here now I believe the rest your team are here let's see we can find them big shout out to them a team of 10 dev typical working on this one alongside a bit round of applause there they are the guys of open AI who have just ceased and not only to mail our tzc PN C then B as well in a 1vs1 so let's just talk about it very briefly big question first Jakob how on earth does a computer learn to play doctor yeah so this spot is quite unlike any what you've seen before so we've coached it to learn just from playing areas itself so we didn't hard code in any strategy we didn't have it learned from human experts just from the very beginning it just keeps playing as a copy of itself it starts from complete randomness and then it makes very small improvements and eventually which is the pro level so complete randomness I'm guessing during its learning process is it looked kind of like I do we're talking like it did look bad right yeah so it's super fascinating to watch it train what kind of like what kind of examples can you give me of like what encountered on the way to be things ending yeah so when it starts I was just completely random so most of the games just end in one of the shadow fiends dying to the power necessarily the mid sour they add power yeah they just run around the map and then they you know they fairly quickly figure out a better strategy and that's the same base so I'm sure that one I've tried that one yeah so then they spend a while just basically afk in the base oh maybe occasionally they venture out they the kita crib they push out the wave a little bit and it

helps you know maybe eventually they get to last hit and then if we jump forward what like what for the big breakthrough for them so it's hard to say there is a particular big bravery this series of small improvements oh they reach the level of casual player isn't they learn to play aggressively and then they learn to bathe and you know what about that day you didn't I know it splendid you for my next game like you say it up again be well it's hard for us to hear you but I do agree that this is kind of ridiculous concept to kind of get our heads around now final question because I know you're ready for game two right yeah okay final question and I have to ask this one is like because I'm not just quite sure how this and how to understand how to comprehend this these are pro players these are human brain so you just telling me this robot has failed so many times it's actually better than professional dota players it's played for really lifetimes of experience and it's quit so many games of dota it's explored many different strategies learn to be learn to exploit other people who beat and it's just played far more into the strategy space than any human has so it turns out robots don't eat sleep and they just played dota 24 hours a day dandy let's see if you can do it a second time and it's cool you're going to try a different approach this time Oh talk us through your thought process what are you thinking with the planner I'm planning to push creepwave because one is a little bit different compared to five is five and one we want you can push so we get a little two little three faster compared to five and five where you can't really push because someone won someone can gank you come from behind whatsoever so it's a little bit different game I'm not kind of used to it but I'm thinking over what is doing and I'm trying to copy what is buried so trying to copy the ball yeah okay if any audio wizard by the way it maybe make it so I can hit Andy in my ears we can have a proper conversation and also you need to bring region constantly because that's just a way to go you can bottlecrow or whatever that's the cheapest item you exchange hit your same heroes and both do it really automatically kinda I see he just raining fought us all hesitation oh and he's working I'm getting nervous are we gang hospitable preflop don't glob let's see what do if you miss it look interesting okay open the good idea let's go who go hooray and that's how school level two have no money for the PD interesting no time I can make it out nd we control okay I give up giving up yeah I don't think that skiing is like breaking something already I've seen this quite a lot this week okay so would you want to do like that to our five or you're out there the hands are shaking Tandy are you giving up yep he's too strong but need more time I guess I played a lot of times maybe I find out also good okay let's just kind of talk me through what it feels like to play again about you I see it kind of uses as any small hole you let him like your place he does not hesitate so it's pretty cool so I'm just trying to kind of comprehend this right so it played 24 hours of dota for like I mean what you said lifetime so basically I mean how many hours of those who have you played any roughly can you think about can you

know rewind the years think about it give me a approximation maybe a few days here and there a few days so I'll tell you so this spot can actually learn from scratch in a span of two weeks of real time and so after an hour of training is able to crush all the built-in BOTS and after about these two weeks that were kind of at the level that we're seeing here today body how guys let's give a round of both open AI have beaten the world's best soccer players with this machine that USB now they're rid of it and they're just kind of lastly I think we kind of get the closing thoughts in terms of what does this mean for like you know the real world what does this mean you know what does training computers of winners 1v1 and dota mean and does that mean anything exciting it's a great question so what we've built here is a general learning system which is still limited in a number of ways but it's capable enough to be the best human pros this is a step towards building more general systems that can learn really complicated messy and important real-world tasks like being a surgeon and the goal of opening I is a company the company that we do we work at is to ensure that these really powerful systems are good and beneficial for all of us incredible stuff I mean I have to you I understand about 20% of it but guys come on doser is a fantastic game and the gentleman over there have managed to beat some of the best with their technology I think this has been an absolute advent of the last words with you Dendy did you ever think that not only would you be a at the TI and playing against apart and losing but also you know but did you ever think that this kind of scenario was going to happen you ever think a bot could possibly be better than a player nope not true but Henry's running around does it feel human or does it feel like something out yeah it feels a little bit like comin at the same time it's something else wise words so let me tell you the next step in the project is v u5 so just wait for next year's international we'll put it in our diary so we'll see how that one's going to go down now if you think you can do better we've got something very exciting in store 50s FR karna on the line for the first 50 people that beat this bot it's going to be the red ball and you can find it over in far away from the key arena jump in and see if you can do better than this man here dude it's been an absolute pleasure I'm coming she's going back we hope to see you guys one more time open AI dendi at a 1v1 Thank You machined any of course thank you open a I'm honestly really excited for the opportunity to get my hands on it and practice with this sort of thing because I think one of the toughest things about trying to learn dota is that you don't wind up in the same situations a lot of the time and the idea that you could practice a whole bunch of times just in laning against the bots will be really nice for training and I mean that said this pot is very limited and what it's doing there you know no bottle no raindrops not the full expanse but it's I still think getting good at dota is about learning those individual pieces and kind of layering them together also poor Dendi I mean it is it that was amazing to see and the bot is staying the lane like perfect yeah it got me to think I think you don't want to end too unless you might try to aim to break the ball like break what it's trying to do some really random stuff like I thought about what if you take his wave between his towers you take it between your towers like how is it going to react like I like what then it is like trying to not block you know this type of mindset where you just have me throw it out of whatever is learned if it's possible if it's not done eh I mean it doesn't matter because it just knows you're not blocking it takes every piece of information that you're presenting it and it's reacting instantly so it's I mean I heard like I heard I can't beat it like once but then they like then it got better so then it never lost again um I know it's all no it definitely comes from PI cap definitely cool but I think one cool thing I am a hater that I said was like it took an hour to be casual bus and then it took two weeks for it to get to this level of buildings or beating pros and it's like 300 hours relative to one hour so that tells you the amount of time that actually needs it becomes a global pro player whereas it's pretty easy to beat a casual but I mean coming a pro is really difficult it's spooky though it's just so spooky to see it like animation cancelled well you heard this is just the beginning right technology is changing our world very quickly I know we're all going to be out of jobs man I'm going to get bought hos bought panelist now watch them both coaches are doing all so much better than the other analysts and a hos could do and I'm just sitting there like don'twe Donald Trump will help us