# Synchronizing Animations To Sound | Two Minute Papers #108

## Метаданные

- **Канал:** Two Minute Papers
- **YouTube:** https://www.youtube.com/watch?v=aMo7pkkaZ9o
- **Дата:** 23.11.2016
- **Длительность:** 4:27
- **Просмотры:** 67,694

## Описание

The paper "Inverse-Foley Animation: Synchronizing rigid-body motions to sound" is available here:
http://www.cs.cornell.edu/projects/Sound/ifa/

Recommended for you:
Sound Synthesis for Fluids With Bubbles - https://www.youtube.com/watch?v=kwqme8mEgz4
Synthesizing Sound From Collisions - https://www.youtube.com/watch?v=rskdLEl05KI
Visually Indicated Sounds - https://www.youtube.com/watch?v=flOevlA9RyQ
What Do Virtual Objects Sound Like? - https://www.youtube.com/watch?v=ZaFqvM1IsP8

WE WOULD LIKE TO THANK OUR GENEROUS PATREON SUPPORTERS WHO MAKE TWO MINUTE PAPERS POSSIBLE:
Sunil Kim, Julian Josephs, Daniel John Benton, Dave Rushton-Smith, Benjamin Kang.
https://www.patreon.com/TwoMinutePapers

Subscribe if you would like to see more of these! - http://www.youtube.com/subscription_center?add_user=keeroyz

Music: Dat Groove by Audionautix is licensed under a Creative Commons Attribution license (https://creativecommons.org/licenses/by/4.0/)
Artist: http://audionautix.com/

Thumbnail background image credits: https://commons.wikimedia.org/wiki/File:Spinning_top_(5448672388).jpg
Splash screen/thumbnail design: Felícia Fehér - http://felicia.hu

Károly Zsolnai-Fehér's links:
Facebook → https://www.facebook.com/TwoMinutePapers/
Twitter → https://twitter.com/karoly_zsolnai
Web → https://cg.tuwien.ac.at/~zsolnai/

## Содержание

### [0:00](https://www.youtube.com/watch?v=aMo7pkkaZ9o) Segment 1 (00:00 - 04:00)

dear fellow Scholars this is 2 minute papers with Caro this is going to be absolutely amazing earlier we had some delightful discussions on synthesizing sound from animations the input would be a sequence for instance a video depicting the complete and utter destruction of plates wooden bunnies or footage of bubbling water and the output should be a physical simulation that yields appropriate sound effects for The observed phenomenon in short input animation output synthesize sound effects for this animation and get this what if we would turn the problem around where we have sound as an input and we try to synthesize an animation that could create such a sound H I like it a very spicy project indeed and however crazy the idea may sound given the richness of sound effects in nature it may actually be easier to generate a believable animation than a perfect sound effect it is extremely difficult to be able to match the amazingly detailed real world sound of for instance a sliding rolling or bouncing bolt with a simulation the more I think about this the more I realize that this direction actually makes perfect sense and no machine learning is used here if we look under the hood we'll see a pre-generated database of rigid body simulations with dozens of different objects and a big graph that tries to group different events and motions together and encode the order of execution of these events and motions now hold on to your papers and let's check out the first round of results together wow I think it would be an understatement to say that they nailed it and what more we can also add additional constraints like a prescribed Landing location to the object to make sure that the animations are not too arbitrary but are more in line with our artistic Vision crazy as I'm looking through the results I am still in complete disbelief this shouldn't be possible also please don't get the impression that this is all there is to this technique there are a lot more important details that we haven't discussed here that the more Curious fellow Scholars could be interested in discrete and continuous time contact events time warping and motion connections there are tons of goodies like these in the paper please have a look to be able to better gauge and appreciate the merits of this work some limitations apply such as the environment is constrained to be this plane that we've seen in these animations and as always with works that are inventing something completely new it currently takes several minutes which is not too bad but of course there's plenty of room to accelerate the execution times and some bonus footage blue dice are synchronized with high hat hits and the red dice are synchronized with the base and snare this will be just spectacular for creating music videos animated movies and I'm convinced that professional artists will be able to do incredible things with such a tool thanks for watching and for your generous support and I see you next time

---
*Источник: https://ekstraktznaniy.ru/video/14748*