# OpenAI’s DALL-E 2 - AI-Based Art Is Here! 🧑‍🎨

## Метаданные

- **Канал:** Two Minute Papers
- **YouTube:** https://www.youtube.com/watch?v=FCf8OA4GPvI
- **Дата:** 02.09.2022
- **Длительность:** 9:48
- **Просмотры:** 151,891

## Описание

❤️ Check out Lambda here and sign up for their GPU Cloud: https://lambdalabs.com/papers

📝 The paper "Hierarchical Text-Conditional Image Generation with CLIP Latents" is available here:
https://openai.com/dall-e-2/
https://openai.com/blog/dall-e-2-extending-creativity/

🧑‍🎨 Check out Felícia Zsolnai-Fehér's works:
https://www.instagram.com/feliciart_86/

🧑‍🎨 Judit Somogyvári's works:
https://www.artstation.com/sheyenne
https://www.instagram.com/somogyvari.art/

Credits:
Stan Brown - https://www.artstation.com/artwork/Le94a5
Road maker - https://twitter.com/Bbbn192/status/1550150050562674692
GuyP - https://twitter.com/GuyP/status/1552681944437166081 + https://dallery.gallery/free-photo-image-editing-tools-ai-dalle/
Weathered man - https://www.reddit.com/r/dalle2/comments/vow7vs/a_photo_of_weathered_looking_man_with_dirt_on_his/
Cosmopolitan - https://www.cosmopolitan.com/lifestyle/a40314356/dall-e-2-artificial-intelligence-cover/
Toilet car: https://twitter.com/PaulYacoubian/status/1514955904659173387/photo/2
OpenAI - Extending Creativity https://openai.com/blog/dall-e-2-extending-creativity/
AI assisted shoe design - https://www.instagram.com/reel/Cehg3WbpaN5/
AI assisted dress design - https://twitter.com/paultrillo/status/1562106954096381952

+1: seamless texture full workflow: https://twitter.com/pushmatrix/status/1564988182780846083

❤️ Watch these videos in early access on our Patreon page or join us here on YouTube: 
- https://www.patreon.com/TwoMinutePapers
- https://www.youtube.com/channel/UCbfYPyITQ-7l4upoX8nvctg/join

🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
Aleksandr Mashrabov, Alex Balfanz, Alex Haro, Andrew Melnychuk, Benji Rabhan, Bryan Learn, B Shang, Christian Ahlin, Eric Martel, Geronimo Moralez, Gordon Child, Ivo Galic, Jace O'Brien, Jack Lukic, John Le, Jonas, Jonathan, Kenneth Davis, Klaus Busse, Kyle Davis, Lorin Atzberger, Lukas Biewald, Matthew Allen Fisher, Michael Albrecht, Michael Tedder, Nevin Spoljaric, Nikhil Velpanur, Owen Campbell-Moore, Owen Skarpness, Rajarshi Nigam, Ramsey Elbasheer, Steef, Taras Bobrovytsky, Ted Johnson, Thomas Krcmar, Timothy Sum Hon Mun, Torsten Reil, Tybie Fitzhugh, Ueli Gallizzi.
If you wish to appear here or pick up other perks, click here: https://www.patreon.com/TwoMinutePapers

Thumbnail background image credit: https://pixabay.com/images/id-357336/
Thumbnail background design: Felícia Zsolnai-Fehér - http://felicia.hu

Chapters:
0:00 Teaser
0:10 What is DALL-E 2?
1:22 Is it as good as human artists?
2:10 1 - Texture synthesis
4:53 2 - Photorealistic faces!
5:36 3 - Cosmopolitan
6:00 4 - Product design
6:18 5 - 3D information
6:58 Building virtual worlds
7:54 +1 - Product design, but better!

Károly Zsolnai-Fehér's links:
Instagram: https://www.instagram.com/twominutepapers/
Twitter: https://twitter.com/twominutepapers
Web: https://cg.tuwien.ac.at/~zsolnai/

## Содержание

### [0:00](https://www.youtube.com/watch?v=FCf8OA4GPvI) Teaser

Dear Fellow Scholars, this is Two Minute Papers with Dr. Károly Zsolnai-Fehér. These amazing images were all made by an AI called DALL-E 2.

### [0:10](https://www.youtube.com/watch?v=FCf8OA4GPvI&t=10s) What is DALL-E 2?

This AI is endowed with a diffusion-based model, which means that when we ask it something, it starts out from noise, and over time, it iteratively refines this image to match our description better. And, over time, magically, an absolutely incredible image emerges. This is a neural network that was given a ton of images, and a piece of text that says what is in this image. That is one image-caption pair. DALL-E 2 is given millions and millions of these pairs. So, what can it do with all this knowledge? The key takeaway here is that it does no, or very little copying from this training data, but it truly comes up with novel images. How? Well, after it had seen a bunch of images of koalas, and separately, motorcycles, it starts to understand the concept of both, and it will be able to combine the two together into a completely new image.

### [1:22](https://www.youtube.com/watch?v=FCf8OA4GPvI&t=82s) Is it as good as human artists?

Previously, we also compared these works to what real human artists are capable of. And, in my opinion, this tool should not be framed at all as Team Humanity versus Team I believe this should be framed as Team Humanity, supercharged by Team AI. Here’s an example of that. And the results are so good, and it is so easy to use, I said, on several occasions that this is going to change the world of art creation as we know it. And, you are an experienced Fellow Scholar, so you may ask the question, okay, but how? Here are 5 beautiful examples of how artists are already using it.

### [2:10](https://www.youtube.com/watch?v=FCf8OA4GPvI&t=130s) 1 - Texture synthesis

One, texture synthesis. Oh yes. Whenever we see these beautiful animation movies or video games, we see a lot of real-looking content in there. The roads are realistic, the buildings and hills are also realistic. We can get a great deal of help in making them realistic by…taking photographs of real objects and importing them into our virtual world. But there is a problem. What is the problem? Well, let’s see together. Let’s take a photo. There is a stain on the wall, is that the problem? No, that’s not the problem, we can cut that out. Now, we need to extend this texture, but since this is just a small snippet, and we have long walls and big buildings to fill in a video game. So, what do we do? We start tiling it. And, uh-oh. Now that is the problem. It is quite visible what happened to this texture, it has been extended, but at the cost of seams and discontinuities appearing in the image. So, how do we get a seamless texture from this? Well, DALL-E 2 hopefully understands that this is a rock wall, and, can it fix this? Now, hold on to your papers, and let’s see together. Yes it can! Amazing! Now let’s have a look at it attached to a real virtual object and see how it looks in practice. Oh my. This is gorgeous. I love it. Here is an even more difficult example with paint peeling off the wall. This is the real-world phone photo. And the tiled version with the seams. And now, DALL-E 2. Wow! I could never tell that this image is not a real photo. And, have a look at it added to a video game. So good. By the way, these are Stan Brown’s works, who used DALL-E 2 to great effect here. Make sure to check out his work, for instance, he also made these amazing materials for one of my favorite games of all time, Path Of Exile. The link to his work is available in the video description. Just imagine using the free 3D modeling tool, Blender and this plugin to create roads, and you can make it an asphalt road, dirt road, or make it look like pavement in just a couple clicks with DALL-E 2.

### [4:53](https://www.youtube.com/watch?v=FCf8OA4GPvI&t=293s) 2 - Photorealistic faces!

Two, DALL-E 2 is now able to generate real human faces too, and sometimes they come out really well. And sometimes, not so much. No matter, in these cases, we can use a face restoration program to fix some of the bigger flaws and run it through a super-resolution program to add more details, and bam. There we go. Fantastic. And, if we have a portrait that works for us, we can plug it into an amazing tool called Deep Nostalgia to create a virtual animated version of this person. How cool is that. What a time to be alive!

### [5:36](https://www.youtube.com/watch?v=FCf8OA4GPvI&t=336s) 3 - Cosmopolitan

Three, this one speaks for itself. The Cosmopolitan magazine made their first cover from an image that was made by an AI. No tricks, no frills, just a good old image straight out of DALL-E 2. And the kicker is that some of them are already good enough to become magazine covers. That is incredible. Talk about the age of AI image creation!

### [6:00](https://www.youtube.com/watch?v=FCf8OA4GPvI&t=360s) 4 - Product design

Four, this tool can even help us create new product designs. And I mean not this one, although this toilet car might have some utility if you need to go when you are on the go, but I meant this one instead!

### [6:18](https://www.youtube.com/watch?v=FCf8OA4GPvI&t=378s) 5 - 3D information

And, finally, five. We can also combine DALL-E 2 with other tools that take a 2D image and try to build an understanding as if it were a 3D scene. And the results are truly stunning, we can get so much more out of these images. And one of the important lessons here is that not only AI-generated art is improving at an incredible pace, but an additional lesson is that everything is connected. So many of these tools can be made even more powerful if we use our imagination and combine them correctly. This is huge.

### [6:58](https://www.youtube.com/watch?v=FCf8OA4GPvI&t=418s) Building virtual worlds

For instance, NVIDIA is already building virtual copies of the real world around us. Why is that? Well, because this way we can reenact real situations for their self-driving cars, and even create arbitrarily complex new situations, and these AIs will be able to learn from them in a safe environment. Also, self-driving can also be combined with a number of other technologies that make it an even more amazing experience. See the assistant there? It sees and identifies the passenger, and understands natural language. It also understands which building is which and what shows are played in them today, so we might jump into the car not even knowing where we wish to go, and it would not only help us find a good show, but it would also drive us there.

### [7:54](https://www.youtube.com/watch?v=FCf8OA4GPvI&t=474s) +1 - Product design, but better!

And, +1. Remember the shoe design example? How about trying on pieces of clothing, but not one by one, as we do in real life, but trying on…all of the clothes, at the same time. Yes, these are all AI-generated images, and it is not on just one still image, but video footage where a camera moves around. This is spectacular. Imagine what buying clothes will look like when we have algorithms like this! Wow. Or, if an actor did not have the appropriate attire for a scene in a movie? Not to worry, just change it in post with the AI. How cool is that? You see, once again, everything is connected. So, does this get your mind going? What would you combine with DALL-E 2? Thanks for watching and for your generous support, and I'll see you next time!

---
*Источник: https://ekstraktznaniy.ru/video/13465*