# Algorithmic Beautification of Selfies | Two Minute Papers #159

## Метаданные

- **Канал:** Two Minute Papers
- **YouTube:** https://www.youtube.com/watch?v=UjuBLS15JqM
- **Дата:** 05.06.2017
- **Длительность:** 3:31
- **Просмотры:** 19,002
- **Источник:** https://ekstraktznaniy.ru/video/14649

## Описание

The paper "Perspective-aware Manipulation of Portrait Photos" and its demo is available here:
http://gfx.cs.princeton.edu/pubs/Fried_2016_PMO/index.php
http://faces.cs.princeton.edu/

Two Minute Papers Merch:
US: http://twominutepapers.com/
EU/Worldwide: https://shop.spreadshirt.net/TwoMinutePapers/

WE WOULD LIKE TO THANK OUR GENEROUS PATREON SUPPORTERS WHO MAKE TWO MINUTE PAPERS POSSIBLE:
Andrew Melnychuk, Christian Lawson, Dave Rushton-Smith, Dennis Abts, e, Esa Turkulainen, Michael Albrecht, Sunil Kim, VR Wizard.
https://www.patreon.com/TwoMinutePapers

Music: Antarctica by Audionautix is licensed under a Creative Commons Attribution license (https://creativecommons.org/licenses/by/4.0/)
Artist: http://audionautix.com/ 

Thumbnail background image credit: https://pixabay.com/photo-465563/
Splash screen/thumbnail design: Felícia Fehér - http://felicia.hu

Károly Zsolnai-Fehér's links:
Facebook → https://www.facebook.com/TwoMinutePapers/
Twitter → https://twitter.com/karoly_zsolnai
W

## Транскрипт

### Segment 1 (00:00 - 03:00) []

dear fellow Scholars this is 2minute papers with Caro today we are going to talk about a rigorous scientific topic none other than the creation of the perfect selfie photo by definition selfies are made by us which means that these are typically short range photos and due to the perspective Distortion of the camera lens we often experience unpleasant effects like the heavy magnification of the nose and the forehead and get this technique enables us to take a photo and after that edit the perceived camera distance for it without changing anything else basically algorithmic beautification this technique works the following way we analyze the photo and try to figure out how distant the camera was when the photo was taken then we create a digital model of the perspective camera and create a 3D model of the face this is a process that mathematicians like to call fitting it means that if we know the Optics of perspective cameras we can work backwards from the input photo that we have and find an appropriate setup that would result in this photo then we will be able to adjust this distance to even out the camera lens distortions but that's not all because as we have the digital 3D model of the face we can do even more for instance we can also rotate it around in multiple directions to build such a 3D model we typically try to locate several well recognizable hotspots on the face such as the chin eyebrows nose stem the region under the nose eyes and lips however as these hotpots lead to a poor 3D representation of the human face the authors added a few more of these hotspots to the detection process this still takes less than 5 Seconds earlier we also talked about a neural network based technique that judged our selfie photos by assigning a score to them I would absolutely love to see how that work would react to a before and after photo that comes from this technique this way we can formulate this score as a maximization problem and as a result we could have an automated technique that truly creates the perfect selfie photo through these warping operations the best kind of evaluation is when we let reality be our judge and use images that were taken closer or farther away and compare the output of this technique against them these true images bear the ground truth label throughout this video the differences are often barely perceptible and to provide a better localization of the error some difference images are shown in the paper if you are into stereoscopy there's also an entire section about that as well the authors also uploaded an interactive version of their work online that anyone can try free of charge so as always your scholarly before and after selfie experiments are more than welcome in the comment section whether you are already subscribed to the series or just subscribing now which you should absolutely do make sure to click the Bell icon to never miss an episode we have lots of amazing Works coming up in the next few videos hope to see you there again thanks for watching and for your generous support and now see you next time