Stable Diffusion Is Getting Outrageously Good! 🤯

7:56

Stable Diffusion Is Getting Outrageously Good! 🤯

Two Minute Papers 06.11.2022 148 585 просмотров 7 244 лайков

Machine-readable: Markdown · JSON API · Site index

Смотреть на YouTube

Поделиться Telegram VK Бот

Транскрипт Скачать .md

Анализ с AI

Описание видео

❤️ Check out Anyscale and try it for free here: https://www.anyscale.com/papers 📝 The paper "High-Resolution Image Synthesis with Latent Diffusion Models" is available here: https://ommer-lab.com/research/latent-diffusion-models/ https://github.com/mallorbc/stable-diffusion-klms-gui You can also try Stable diffusion for free here: https://huggingface.co/spaces/stabilityai/stable-diffusion Credits: 1. Prompt-image repository https://lexica.art + Variants from photos https://twitter.com/sharifshameem/status/157177206133663334 2. Infinite zoom https://twitter.com/matthen2/status/1564608723636654093 + how to do it https://twitter.com/matthen2/status/1564608773485895692 3. Lego to reality https://twitter.com/matthen2/status/156609779409551360 5. 2D to 3D https://twitter.com/thibaudz/status/1566136808504786949 6. Cat Knight https://hostux.social/@valere/108939000926741542 7. Drawing to image https://www.reddit.com/r/MachineLearning/comments/x5dwm5/p_apple_pencil_with_the_power_of_local_stable/ 8. Image to image https://sciprogramming.com/community/index.php?topic=2081.0 9. Variant generation easier https://twitter.com/Buntworthy/status/1566744186153484288 + https://github.com/justinpinkney/stable-diffusion + https://github.com/gradio-app/gradio 10. Texture synthesis https://twitter.com/metasemantic/status/1568997322805100547 + https://twitter.com/dekapoppo/status/1571913696523489280 11. Newer version of stable_diffusion_videos - https://twitter.com/_nateraw/status/1569315074824871936 Interpolation: https://twitter.com/xsteenbrugge/status/1558508866463219712 Full video of interpolation: https://www.youtube.com/watch?v=Bo3VZCjDhGI Thumbnail source images: Anjney Midha 🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible: Aleksandr Mashrabov, Alex Balfanz, Alex Haro, Andrew Melnychuk, Benji Rabhan, Bryan Learn, B Shang, Christian Ahlin, Eric Martel, Geronimo Moralez, Gordon Child, Jace O'Brien, Jack Lukic, John Le, Jonas, Jonathan, Kenneth Davis, Klaus Busse, Kyle Davis, Lorin Atzberger, Lukas Biewald, Luke Dominique Warner, Matthew Allen Fisher, Matthew Valle, Michael Albrecht, Michael Tedder, Nevin Spoljaric, Nikhil Velpanur, Owen Campbell-Moore, Owen Skarpness, Rajarshi Nigam, Ramsey Elbasheer, Steef, Taras Bobrovytsky, Ted Johnson, Thomas Krcmar, Timothy Sum Hon Mun, Torsten Reil, Tybie Fitzhugh, Ueli Gallizzi. If you wish to appear here or pick up other perks, click here: https://www.patreon.com/TwoMinutePapers Thumbnail background design: Felícia Zsolnai-Fehér - http://felicia.hu Chapters: 0:00 Intro 0:30 Stable Diffusion 1:20 AI art repository 2:14 Infinite zoom 2:24 Lego to reality 2:52 Creating 3D images 3:16 Cat Knight 3:50 The rest of the owl 4:03 Image to image! 4:43 Variant generation 5:02 Texture synthesis 5:55 Stable Diffusion video generator 6:20 Free and open for all of us! Károly Zsolnai-Fehér's links: Instagram: https://www.instagram.com/twominutepapers/ Twitter: https://twitter.com/twominutepapers Web: https://cg.tuwien.ac.at/~zsolnai/

Оглавление (13 сегментов)

Intro

dear fellow Scholars this is two minute papers with Dr Carol jonai fahir today you will see the power of human Ingenuity supercharged by an AI as we are living the Advent of aib's image generation we now have several tools that are so easy to use we just enter a piece of text and out comes a beautiful image now you are asking okay karway they are easy to use but for whom well

Stable Diffusion

good news we now have a new solution called stable diffusion where the model weights and the full source code are available for free for everyone finally we talked a bit about this before and once again I cannot overstate how amazing this is I am completely Spellbound by how the community has worked together to bring this project to life and you fellow Scholars just kept on improving it and it harnesses is the greatest asset of humanity and that is the power of the community working together and I cannot believe how much stable diffusion has improved in just the last few weeks don't believe it well let's have a look together at 10 amazing examples of how the community is already

AI art repository

using it one today the image generation works so inexpensively that we don't even need to necessarily generate our own we can even look at this amazing repository where we enter the prompt and can find thousands and thousands of generated images for that concept yes even for Napoleon cats we have thousands of hits so good now additionally we can also add a Twist to it by photographing something in real life obtaining a text prompt for it and Bam it finds similar images that were synthesized by stable diffusion this is very a generation of sorts but piggybacking on images that have been synthesized already therefore we can choose from a large gallery of these Works two by using a little trickery and

Infinite zoom

the image impainting feature we can now create these amazing infinite Zoom images so good three whenever we build

Lego to reality

something really cool with Legos we can now ask stable diffusion to re-imagine what it would look like if it were a real object the results are by no means perfect but based on what it comes up with it really seems to understand what is being built here and what its rear counterpart would look like I love it 4 after generating a flat 2D image with

Creating 3D images

stable diffusion with other techniques we can obtain a depth map which describes how far different objects are from the camera now that is something that we've seen before however now in adobe's After Effects look we can create this little video with a parallax effect absolutely incredible

Cat Knight

5. have a look at this cat night I love the eyes and all of these gorgeous details on the armor this image really tells a story but what is even better is that not only the prompt is available but also stable diffusion is a free and open source model so we can pop the hood reuse the same parameters as the author and get a reproduction of the very same image and it is also much easier to edit it this way if we wish to see anything changed 6. if we are not the most

The rest of the owl

skilled artist we can draw a really rudimentary owl hand it to the AI and it will draw the rest of this fine owl seven and if you think the drawing to

Image to image!

image example was amazing now hold on to your papers for this one this fellow scholar had a crazy idea look these screenshots of old Sierra video game games were given to the algorithm and there is no way right well let's see oh wow look at that the results are absolutely incredible I love how closely it follows the framing and the mood of the original photos I have to be honest some of these feel good to go as they are what a time to be alive eight with these new web apps variant

Variant generation

generation is now way easier and faster than before it is now as simple as dropping in an image by the way a link to each of these is available in the video description and their source code is available as well nine in an earlier

Texture synthesis

episode we had a look at how artists are already using Dolly 2 in the industry to make a photo of something and miraculously extend it almost infinitely this is called texture synthesis and no seems anywhere to be seen and now these fellow Scholars seamless texture generation is now possible in stable diffusion too not too many years ago we needed not only a proper handcrafted computer Graphics algorithm to even have a fighting chance to create something like this but implementing a bunch of these techniques was also required because different algorithms did well on different examples and now just one tool that can do it all how cool is that and 10 stable diffusion itself is also

Stable Diffusion video generator

being improved oh yes this new version adds super resolution to the mix which enables us to synthesize even more details and even higher resolution images with it this thing is improving so quickly we can barely keep up with it so which one was your favorite let me know in the comments below and once

Free and open for all of us!

again this is my favorite type of work which is free and open for everyone so I would like you fellow Scholars to also take out your digital wrenches and create something new and amazing let the experiment begin this episode is brought to you by any scale the company behind Rey the fastest growing open source framework for scalable Ai and scalable python thousands of organizations use Rey including open AI Uber Amazon Spotify Netflix and more hooray less developers iterate Faster by providing common infrastructure for scaling data ingest and pre-processing machine learning training deep learning hyper parameter tuning model serving and more all while integrating seamlessly with the rest of the machine learning ecosystem any scale is a fully managed Ray platform that allows teams to bring products to Market Faster by eliminating the need to manage infrastructure and by enabling new AI capabilities array and any scale can do recommendation systems time series forecasting document understanding image processing Industrial Automation and more go to anyscale. com papers and try it out today our thanks to any scale for helping us make better videos for you thanks for watching and for your generous support and I'll see you next time

Другие видео автора — Two Minute Papers

Ctrl+V

Экстракт Знаний в Telegram

Экстракты и дистилляты из лучших YouTube-каналов — сразу после публикации.

Подписаться

Лучшие методички за неделю — каждый понедельник