# Reconstructing Sound From Vibrations | Two Minute Papers #12

## Метаданные

- **Канал:** Two Minute Papers
- **YouTube:** https://www.youtube.com/watch?v=2i1hrywDwPo
- **Дата:** 30.09.2015
- **Длительность:** 3:38
- **Просмотры:** 14,830
- **Источник:** https://ekstraktznaniy.ru/video/14948

## Описание

When exposed to sound waves, the surface of objects in a room start vibrating. One could wonder that if we had sufficiently advanced technology, maybe the sound itself could be reconstructed from looking only at the vibration of these objects. A great technique they call "visual microphone" has been recently proposed that executes this idea with breathtaking results.

_____________________

The paper "The Visual Microphone: Passive Recovery of Sound from Video" is available here: http://people.csail.mit.edu/mrub/VisualMic/
Disclaimer: I was not part of this research project, I am merely providing commentary on this work.

The mentioned TED talk from Abe Davis:
 https://www.youtube.com/watch?v=npNYP2vzaPo

Reddit AMA with the main author, Abe Davis:
https://www.reddit.com/r/IAmA/comments/357b4o/im_an_mit_computer_scientist_and_recent_ted/

Material properties from vibrations:
http://www.visualvibrometry.com/

The background image for the thumbnail was created by Corey Leopold: https://f

## Транскрипт

### Segment 1 (00:00 - 03:00) []

dear fellow scholar this is 2 minute papers with car the work we are going to discuss today is about visual microphones what does this mean exactly the influence of sound creates surface vibrations in many objects such as plants or a bag of chips foil containers water and even bricks they thereby work as visual microphones now hold on to your chairs because this algorithm can reconstruct audio data from video footage of vibrations what this means is that if someone outside of your house pointed a high-speed camera at a bag of chips when you start talking in your room he will be able to guess what you said by only seeing the vibrations of the bag of chips in the following example you'll see a recorded footage of the bag but the movement is so subtle that your naked eye won't see any of it first you'll hear the speech of a person recorded in the house then the Reconstruction from only the visual footage of the bag Mary Had a Little Lamb whose fleece was white as snow and everywhere that Mary went that lamb was sure to go and this is what we were able to recover from high-speed video filmed from outside behind soundproof glass L and everywhere that this is just unbelievable here is another example with a plastic bag where you can see the movement caused by the sound waves the paper is very detailed and rigorous this is definitely one of the best research works I've seen in a while the most awesome part of this is that this is not only an excellent piece of research it is also a great product and note that this problem is even harder than one would think since the frequency response of various objects can be quite different which means that every single object vibrates a bit differently when hit by the same sound waves you can see a great example of these responses from bricks water and many others here what it will be used for is shrouded in mystery for the moment even though I think this work provides fertile grounds for new conspiracy theories the authors don't believe it is suitable to use for surveillance someone argued that it may be useful for early earthquake detection which is an awesome idea also maybe it could be used to detect video redubbing and recover in beeped out speech from videos and I'm sure there will be many other applications the authors also have a follow-up paper on estimating material Properties by looking at how objects vibrate awesome do you have any potential applications in mind let me know in the comment section and there's also a fantastic T talk and paper video on the topic that you can find in the description box alongside with a great Reddit discussion link I urge you to check all of these out the videos are narrated by Abe Davis who did a great job at explaining their Concepts thanks for watching and I'll see you next time