Automatic Lecture Notes From Videos | Two Minute Papers #22

dear fellow Scholars this is two-minute papers with Caro here where we expand our knowledge in science and research blackw style lecture videos are really popular on YouTube nowadays Can Academy is an excellent example of that where you get the feeling that someone is sitting next to you and teaching you not like someone who is addressing you formally from the podium without question these kinds of videos can augment textbooks quite well however they are often not easily searchable this piece of work tries to take this One Step Beyond the input is a video and a transcript and the output of the algorithm is an interactive lecture note where you can not only see the most important points during the lecture but you can also click on some of them to see full derivations of the Expressions let's outline the features that one would like to see in a usable outlining product it has to be able to find Milestones that are at the end of each derivation to present them to the user if you studied mathematics you know how mathematical derivation ation go following the train of thought of the teacher is not always trivial it's also important to find meaningful groupings for a derivation this involves finding similarities between drawings trying to find out the individual steps and doing a segmentation to get a series of images out of it and finally the technique has to be good at interleaving drawings and formula with written text in an appealing and digestible way it is very easy to mess up with this tab as the text has to describe the visuals even though I wish tools like this existed when I was an undergrad student it is still important to just study and study and expand one's knowledge if textbooks like this start to appear I'll be the first in line and I'll not be reading I'll be devouring them also think about how smart the next generation will be with awesome studying materials like these thanks for watching and I'll see you next time