# Instant 3D Floorplans From Your Photos | Two Minute Papers #142 ## Метаданные - **Канал:** Two Minute Papers - **YouTube:** https://www.youtube.com/watch?v=UBORpapdAfU - **Дата:** 05.04.2017 - **Длительность:** 3:34 - **Просмотры:** 20,429 ## Описание The paper "Rent3D: Floor-Plan Priors for Monocular Layout Estimation" is available here: http://www.cs.toronto.edu/~fidler/projects/rent3D.html http://www.cs.toronto.edu/~urtasun/publications/liu_etal_cvpr15.pdf Followup paper - HouseCraft: http://www.cs.toronto.edu/housecraft/ https://github.com/chuhang/HouseCraft WE WOULD LIKE TO THANK OUR GENEROUS PATREON SUPPORTERS WHO MAKE TWO MINUTE PAPERS POSSIBLE: Andrew Melnychuk, Christian Lawson, Daniel John Benton, Dave Rushton-Smith, Sunil Kim, VR Wizard. https://www.patreon.com/TwoMinutePapers Subscribe if you would like to see more of these! - http://www.youtube.com/subscription_center?add_user=keeroyz Music: Antarctica by Audionautix is licensed under a Creative Commons Attribution license (https://creativecommons.org/licenses/by/4.0/) Artist: http://audionautix.com/ Thumbnail background image credit: https://pixabay.com/photo-354233/ Splash screen/thumbnail design: Felícia Fehér - http://felicia.hu Károly Zsolnai-Fehér's links: Facebook → https://www.facebook.com/TwoMinutePapers/ Twitter → https://twitter.com/karoly_zsolnai Web → https://cg.tuwien.ac.at/~zsolnai/ ## Содержание ### [0:00](https://www.youtube.com/watch?v=UBORpapdAfU) Input Dear Fellow Scholars, this is Two Minute Papers with Károly Zsolnai-Fehér. In this piece of work, we are interested in creating a 3D virtual tour for an apartment. However, for this apartment, no 3D information is available - instead, the input for the algorithm is something that we can obtain easily, in this case, a 2D floorplan and a set of images that we shot in the apartment. From this information, we would create a 3D floorplan that is not only faithful to the real one in terms of geometry, but the photos with the correct viewpoints are also to be assigned to the correct walls. In order to accomplish this, one has to overcome a series of challenging problems. For instance, we have to estimate the layout of each room and find the location of the camera in each of these images. Also, to obtain high-quality solutions, the goal is to extract as much information from ### [0:49](https://www.youtube.com/watch?v=UBORpapdAfU&t=49s) Data Extraction the inputs as possible. The authors recognized that the floorplans provide way more information than we take for granted. For instance, beyond showing the geometric relation of the rooms, it can also be used to find out the aspect ratios of the floor for each room. The window-to-wall ratios can also be approximated and matched between the photos and the floorplan. This additional information is super useful when trying to find out which room is to be assigned to which part of the 3D floorplan. Beyond just looking at the photos, we also have access to a large swath of learning algorithms ### [1:27](https://www.youtube.com/watch?v=UBORpapdAfU&t=87s) Learning Algorithms that can reliably classify whether we're looking at a bathroom or a living room. There are even more constraints to adhere to in order to aggressively reduce the number of physical configurations, make sure to have a look at the paper for details, there are lots of cool tricks described there. As always, there is a link to it in the video description. For instance, since the space of possible solutions is still too vast, a branch and bound type algorithm is proposed to further decimate the number of potential solutions to evaluate. And as you can see here, the comparisons against ground truth floorplans reveal that these ### [2:00](https://www.youtube.com/watch?v=UBORpapdAfU&t=120s) Conclusion solutions are indeed quite faithful to reality. The authors also kindly provided a dataset with more than 200 full apartments with well over a thousand photos and annotations for future use in followup research works. Creating such a dataset and publishing it is incredibly laborious, and could easily be a paper on its own, and here, we also get an excellent solution for this problem as well. In a separate work, the authors also published a different version of this problem formulation that reconstructs the exteriors of buildings in a similar manner. There is so much to explore, the links are available in the video description, make sure to have a look! In case you're wondering, it's still considered a crime not doing that. I hope you have enjoyed this episode, and I find it so delightful to see this unbelievably rapid growth on the channel. Earlier I thought that even 2 would be amazing, but now, we have exactly 8 times as many subscribers as one year ago. Words fail me to describe the joy of showing these amazing works to such a rapidly growing audience. This is why I always say at the end of every episode... Thanks for watching and for your generous support, and I'll see you next time! --- *Источник: https://ekstraktznaniy.ru/video/14682*