Shape and Material from Video | Two Minute Papers #131

dear fellow schar this is two minut papers with kly zsolnai fehér imagine the following we put an object on a robot arm and the input is a recorded video of it and the output would be the digital geometry and the material model for this object this geometry and material model we can plug into a photorealistic light simulation program to have a digital copy of a real world object we have to be of the fact normally solving such a sounds completely hopeless we have three variables that we have to take into consideration the lighting in the room the geometry of the object and the material properties of the object if any two of the three variables is known the problem is relatively simple and there are already existing works to address these combinations for instance if we create a studio lighting setup and know the geometry of the object as well it is not that difficult to capture the material properties also [Zene] ge formulation of the out of the variables not two not one but zer are known we have control over the lighting the material properties can be arbitrary and the geometry can camera has to be stationary and the rotation directions of the object should be known and some more of these are discussed in the paper in detail all of them are quite sensible and they don't feel limiting the algorithm works the following way in the first step we estimate the lighting and leaning on this estimation we build a rough initial surface model and in the second step using this surface model we see a bit clearer and therefore we can refine our initial gas for the lighting and the material mod now that we know the lighting a bit better we can again get back to the surface reconstruction and improve our solution there this entire process happens iteratively which means that first we obtain a very rough initial gas for the surface and we constantly refine this piece of surface to get closer and closer to the final solution eyes on increds and marvel at the fact that we know next to nothing about the input and the geometry and material properties almost magically appear on the screen this is an amazing piece of work and lots of details and results are discussed in the paper which is quite well written and was a joy to read make sure to have a look at it the link is available in the video description also thanks for all the kind comments experienced a recent influx of emails howjoy many of personalories relation to science and how these new inventions are being talked about over dinner with the family and relatives it has been such a delight to read messages thank you and also thanks for watching and for your generous support see you next [Zene] time < sil> ▁