DeepMind's AI Creates Images From Your Sentences | Two Minute Papers #163

dear fellow Scholars this is two minute papers with Caro this is one of those new absolutely insane papers from the Google Deep Mind guys you're going to see a follow-up work to an algorithm that looks at a bunch of images and from that it automatically learns the concept of birds human faces or coral reefs so much so that we are able to write a new sentence and it will generate a new close to photo realistic image from this written description this network is cap of creating images that are significantly different than the ones it has been trained on this already sounds like science fiction completely unreal this work goes by the name pixel CNN we'll discuss a follow-up work to that in a moment the downside of this method is that these images are generated pixel by pixel and many of these pixels depend on their neighborhoods for instance if I start to draw one pixel of the beak of a bird the neighboring pixels have to adhere to this constraint and have to be the continuation of the beak clearly these images have a lot of structure this means that we cannot do this process in parallel but create these new images One pixel at a time this is an extremely slow and computationally expensive process and hence the original paper showed results with 32x 32 and 64x 64 images at most as we process everything sequentially the execution time of the algorithm scales linearly with the number of pixels we can generate it is like a factory where there are a ton of assembly lines but only one person to run around and operate all of them here the goal was to start generating different regions of these images independently but only in cases when these pixels are not strongly correlated for instance doing this with neighbors is a nogo this is possible but extremely challenging and the paper contains details on how to select these pixels and when we can pretend them to be independent and now Fe Feast Your Eyes Upon these spectacular results if we are looking for a yellow bird with a black head orange eyes and an orange bill we're going to see much more detailed images the complexity of the new algorithm scales with the number of pixels not linearly but in a logarithmic manner which is basically the equivalent of winning the jackpot in terms of parallelization and it often results in a more than 100 times speed up this is a factory that's not run by one guy but one that works properly the lead author Scott Reed has also published some more amazing results on Twitter as well in these examples we can see the evolution of the final image that is generated by the network it is an amazing feeling to be a part of the future and note that there is a ton of challenges with the idea this is one of those typical cases when the idea is only the first step and execution is King make sure to have a look at the paper for more details according to our regular schedule we try our best to put out two videos every week that's Eight Episodes a month if you feel that eight of these episodes is worth a dollar for you please consider supporting us on patreon this way we can create more elaborate episodes for you the channel is growing at a remarkable rate and your support has been absolutely amazing I am honored to have an audience like you fellow Scholars we are quite close to hitting our next Milestone and this Milestone will be about giving back more to the scientific community and empowering other research projects I've put a link to our patreon page with the details in the video description thanks for watching and for your generous support and I'll see you next time