3D Depth From a Single Photograph | Two Minute Papers #54

dear fellow Scholars this is 2minute papers with Caro here this piece of work tries to estimate depth information from an input photograph this means that it looks at the photo and tries to tell how far away parts of the image are from the camera an example output looks like this on the left there's an input photograph and on the right you see a heat map with true distance information this is what we are trying to approximate this means that we collect a lot of indoor and outdoor images with their true depth information and we try to learn the correspondents how they relate to each other sidewalks forests buildings you name it these image and depth pairs can be captured by mounting 3D scanners on this awesome custombuilt vehicle and gentlemen that is one heck of a way of spending research funds the final goal is that we provide a photograph for which to depth information is completely unknown and we asked the algorithm to provide it for us here you can see some results the first image is the input photograph the second shows the true depth informations the third image is the depth information that was created by this technique and here's a bunch of results for images downloaded from the internet it probably does at least as good as a human would spectacular this sounds like a sensorial problem for humans and a perilous Journey for computers to say the least what is quite remarkable is that these relations can be learned by a computer algorithm what can we use this for well a number of different things one of which is to create multiple views of this 2D photograph using the guest depth information it can also be super helpful in building robots that can wonder about reliably with inexpensive consumer cameras mounted on them thanks for watching and for your generous support and I'll see you next time