New AI Makes You Play Table Tennis…In a Virtual World! 🏓

4:20

New AI Makes You Play Table Tennis…In a Virtual World! 🏓

Two Minute Papers 31.12.2021 59 001 просмотров 3 203 лайков

Machine-readable: Markdown · JSON API · Site index

Смотреть на YouTube

Поделиться Telegram VK Бот

Транскрипт Скачать .md

Анализ с AI

Описание видео

❤️ Check out Fully Connected by Weights & Biases: https://wandb.me/papers 📝 The paper "TransPose: Real-time 3D Human Translation and Pose Estimation with Six Inertial Sensors" is available here: https://calciferzh.github.io/publications/yi2021transpose https://xinyu-yi.github.io/TransPose/ 🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible: Aleksandr Mashrabov, Alex Balfanz, Alex Haro, Andrew Melnychuk, Angelos Evripiotis, Benji Rabhan, Bryan Learn, Christian Ahlin, Eric Martel, Gordon Child, Ivo Galic, Jace O'Brien, Javier Bustamante, John Le, Jonas, Kenneth Davis, Klaus Busse, Lorin Atzberger, Lukas Biewald, Matthew Allen Fisher, Mark Oates, Michael Albrecht, Michael Tedder, Nikhil Velpanur, Owen Campbell-Moore, Owen Skarpness, Peter Edwards, Rajarshi Nigam, Ramsey Elbasheer, Steef, Taras Bobrovytsky, Thomas Krcmar, Timothy Sum Hon Mun, Torsten Reil, Tybie Fitzhugh, Ueli Gallizzi. If you wish to appear here or pick up other perks, click here: https://www.patreon.com/TwoMinutePapers Thumbnail background design: Felícia Zsolnai-Fehér - http://felicia.hu Wish to watch these videos in early access? Join us here: https://www.youtube.com/channel/UCbfYPyITQ-7l4upoX8nvctg/join Meet and discuss your ideas with other Fellow Scholars on the Two Minute Papers Discord: https://discordapp.com/invite/hbcTJu2 Károly Zsolnai-Fehér's links: Instagram: https://www.instagram.com/twominutepapers/ Twitter: https://twitter.com/twominutepapers Web: https://cg.tuwien.ac.at/~zsolnai/

Оглавление (8 сегментов)

Live Demo: Jump

Dear Fellow Scholars, this is Two Minute Papers with Dr. Károly Zsolnai-Fehér. Today we are going to see how easily we can transfer our motion onto a virtual character. And even play virtual table tennis as if we were a character in a computer game! Hmm! This research work proposes to not use the industry standard motion capture sensors to do this. Instead, they promise a neural network that can perform full-body motion capture from 6 Inertial Measurement Units.

Inertial Measurement Unit Placement

These are essentially gyroscopes that report accelerations and orientations. And this is the key. This presents us with two key advantages. Hold on to your papers for advantage number one, which is - no cameras are needed. Yes, that’s right.

Live Demo: Occlusion

Why is that great news? Well, a camera is a vision-based system, and if people are far away from the camera, it might have some trouble making out what they are doing, of course, because it can barely see them. But now with the inertial measurement units and this neural network. They can also be further away, maybe a room or two away, and - no problem. So good! And, if it doesn’t even need to see us, we can hide behind different objects, and - look! It can still reconstruct where we are. Loving it. Or, we can get two people to play table tennis.

Live Demo: Ping Pong

We can only see the back of this player, and the occlusion situation is getting even worse as they turn and jump around a great deal. Now you made me curious - let’s look at the reconstruction together. Wow, that is an amazing reconstruction. In the end, if the contestants agree that it was a good match, they can hug it out

Live Demo: Interaction

or…wait a second, maybe not so much. In any case, the system still works. And, advantage number two, ah, of course.

Live Demo: Dark Environment

Since it thinks in terms of orientation and acceleration, it doesn’t even need to see you. So…oh yes! It also works in the dark. Note that so do some infrared camera-based motion capture systems, but here, no cameras are needed. And, let’s see that reconstruction. There is a little jitter in the movement, but otherwise, very cool. And, if you have been holding on to your papers so far, now, squeeze that paper, because I am going to tell you how quickly this runs. And that is 90 frames per second. Easily in real time. Now, of course, not even this technique is perfect.

Live Demo: Exercise

I am sure you noticed that there is a bit of a delay in the movements, and often, some jitter too. And, as always, do not think of this paper as the final destination. Think of this as an amazing leap forward, and always, always apply the First Law of Papers. What is that?

Supporting Foot Visualization 1

Well, just imagine how much this could improve just two more papers down the line. I am sure there will be no delays and no jitter. So, from now on, we are one step closer to be able to play virtual table tennis, or even work out with our friends in a virtual world. What a time to be alive! Thanks for watching and for your generous support, and I'll see you next time!

Другие видео автора — Two Minute Papers

Ctrl+V

Экстракт Знаний в Telegram

Экстракты и дистилляты из лучших YouTube-каналов — сразу после публикации.

Подписаться

Лучшие методички за неделю — каждый понедельник