# Adobes New Text To Video Model Is Stunning.... (Adobe Firefly Video)

## Метаданные

- **Канал:** TheAIGRID
- **YouTube:** https://www.youtube.com/watch?v=hTqFKZ3kN9M
- **Дата:** 15.10.2024
- **Длительность:** 13:10
- **Просмотры:** 23,209
- **Источник:** https://ekstraktznaniy.ru/video/13997

## Описание

Prepare for AGI with me - https://www.skool.com/postagiprepardness 
🐤 Follow Me on Twitter https://twitter.com/TheAiGrid
🌐 Checkout My website - https://theaigrid.com/

00:00:00 - Firefly introduction
00:00:57 - Quality analysis
00:01:42 - Prompt adherence
00:03:07 - Consistency, efficiency
00:04:19 - Character consistency
00:05:37 - Creative impact
00:05:58 - Fantasy generation
00:06:53 - Atmospheric elements
00:08:01 - 3D capabilities
00:08:25 - Text, animation
00:09:38 - Image-to-video feature
00:10:33 - Scene modification
00:11:26 - Premiere integration

Links From Todays Video:
https://blog.adobe.com/en/publish/2024/10/14/generate-video-beta-on-firefly-web-app?sdid=STLMLWRF&mv=social&mv2=owned-organic&linkId=100000298439814
https://www.youtube.com/watch?v=3x-QahB3PdQ

Welcome to my channel where i bring you the latest breakthroughs in AI. From deep learning to robotics, i cover it all. My videos offer valuable insights and perspectives that will expand your knowledge and understan

## Транскрипт

### Firefly introduction []

the Firefly video model is the first publicly available video model designed to be commercially safe it is really following everything we've done because just like all the other Firefly models it's only trained on content that we have the right to use and everything you're looking at behind me was made with the Firefly video model so there you just saw it the Adobe Firefly video model is the first model designed for commercial use that is actually quite safe and I have to say hatsoft to Adobe for doing this because many video model companies I wouldn't say exactly they're Shady but they're not exactly transparent about where they get their footage from but this video will dive into the Adobe Firefly video model that has shaken up the industry today at the Adobe Max event where they showcased a bunch of new features in their generative AI efforts to make the product even better than it is already

### Quality analysis [0:57]

so I do want to start this video by first analyzing the video model I have to say that the video model by Adobe is clearly one of the best video models out there now this is an incredible statement because if you are unaware of how ferocious the competition is currently in the AI space for video models you would be rather surprised I know many individuals have only been paying attention to Sora when we actually take a look at the quality of these clips so we can see that there is a high level of clarity on these clips which makes them remarkable to look at you can see this first clip The Cinematic closeup of a detailed portrait of an elderly man in the middle of a street at night the lighting is Moody

### Prompt adherence [1:42]

and dramatic the color grade is blue and the shadows and orange highlights the man has extremely realistic detailed skin and visible pores movement is subtle and soft the camera doesn't move film grain vintage anamorphic lens I to say that what this is also a demonstration of from Adobe is that these models actually do have quite the prompt adherence I do think that one of the largest things that video models do struggle with is prompt adherence because inherently making a video model is quite hard but when you can actually make a video model that is good at quality at Fidelity at consistency and also have that adhere to your prompts in a very consistent way that actually makes the model more usable than anything else and I think this example right here is one of those examples Adobe also showed us this example which is a view of a beautifully lit Cote in Mexico the water is a clear blue with a Sparkle from the late afternoon sun the color is warm and Magic hour style high quality cinematic now with certain Clips I always do like to pay attention to certain features because it allows me to gauge the quality of the model and what things it may struggle with excel with and currently

### Consistency, efficiency [3:07]

things it may excel with and currently with adobe's model I'm actually struggling to find any areas that this model is seemingly going to struggle with for example when we look at the reflections of the water on the left hand side we can see that they look remarkably accurate and consistent and as this character manages to move forward nearly everything in the frame just seems ridiculously coherent and consistent which means that like from a distance I would genuinely not be able to tell that this is AI and somehow Adobe have managed to Source the footage to train this model responsibly which means not not only are they doing you know something amazing on that front but they've also managed to work out a way to get potentially a very efficient training process one of the things that we do know is that of course with these video models they are really computationally expensive and somehow Adobe plans to release this very shortly which means that they've managed to do this model in a very efficient way which means that there's some pretty smart people working at Adobe and if you want to see more character consistency we can see that with this clip here and I think

### Character consistency [4:19]

this is one of the most important things because if you aren't familiar with how AI video models work you won't realize that as Clips get further and further from the start point and as they start to you know continue in length and of course change terrains one of the major problems that they do have is they struggle with this area of consistency and if you can find a video model that is able to consistently have coherent images that look like they're part of the same background SL same video at the start of it then you know you've got a good video model and that's exactly what we see in this cinematic shot over a vast red martian landscape which is something that I honestly didn't expect from this model because it's such a hard feat to achieve so this is one of the things that actually puts the Adobe model up there and I think the craziest thing about this which is what I spoke about before is that adobe models are integrated into their whole ecosystem which means we're about to get a ton more in terms of the creative value with creators using this in their projects and of course the general public exposure for those that haven't been paying attention two much smaller video models in the space that more dedicated AI enthusiasts would initially look at

### Creative impact [5:37]

so it's going to be really interesting to see how the wider creative Community manages to use these tools now we also have some fantasy areas right here and I'm not going to lie this is one that I really do like because the movement in this clip is shockingly realistic if you've ever seen a small reptile move around you'll know that they move exactly like this so this was one that I

### Fantasy generation [5:58]

was really surprised because I was watching and there are some really viral videos right now of like animals being merged I'm not sure if you've ever seen those clips and I've seen the movement on those and they don't look good at all so this is a macro tiny shot of a baby dragon made out of lava scuttling around inside a volcano and it looks really truly fascinating now enough of the videos I'm going to show you guys some of the really cool things you can actually do with this to improve your projects one of the things that adobe actually talks about is that they want to be able to add you know from the community have said that they want to be able to add visual depth to existing content by using the firefi video model to generate like atmospheric elements like water fire and light leaks which essentially means that you can actually use these models to generate short clips that you can then merge over existing videos in premere Pro which is

### Atmospheric elements [6:53]

really effective because it allows you to up the creativity for small clips that you might not previously have thought about so for example you can see that we generate a light leak here which is just this is exactly what it looks like film filmic light leaks on a black background organic texture realistic and then of course the user manages to composite this scene completely and then we get the final clip here which is something that looks really fascinating so for me this is going to be a big help in terms of looking at what individuals are able to do because being able to generate these short clips on instant is going to be amazing because sometimes you might download a pack of smoke or light leaks and it just doesn't look weird and you have to spend 40 to you know top to 2 hours sometimes looking for the right small clip that just fits with the motion that you've got at that specific scene and this is going to be something that works really well now Adobe have also spoken about how they've managed to communicate their intent to animators and motion designers or ideating before your own creative processes manages to save time spent on iteration for finding the right style

### 3D capabilities [8:01]

you can see here that we have this prompt of this cute baby octopus with adorable cuddly eyes holding a teacup in each tentacle and looking around happily 3D render octane soft lighting yada yada but the point is that this is a remarkable consistent 3D render that looks really good I mean it's quite surprising that we're able to get such a consistency out of their first video model which is just really nice

### Text, animation [8:25]

now what I really do like about this model as well is that it also does text as well so you can see right here that this stop motion video is something that I genuinely wouldn't have even pegged to be AI due to the realistic nature of this which means that this model is also able to do certain video Styles which is of course what we saw before where we had the video model flying over in like speedrun I'm actually it's probably not called a speedrun it's actually just called a drone shot flying over the horizon but that kind of shot is quite different from this 2D stop motion kind of shot which means that this is a truly capable model in terms of the diverse scenes that it can do which is something that's going to help out creatives a lot because sometimes you want to experiment with different ways to present your video and this is going to be something that individuals want to do now you can also see here that it manages to perform with text well as we saw with the play area you can see the word summer is formed from a fluffy iridescent clouds floating in a sky of swirling pastel covers yada yada it just looks really well and it'll be interesting to see how people manag to use this now one of the things they also talked about and I think this is largely one of the biggest areas is of course the image to video area and I

### Image-to-video feature [9:38]

think this is going to be something that most individuals are going to be using because it's always good to have your Source footage and expand upon that so essentially they announced of course their image to video so you can use a Driving Image so that this was the Start Driving Image which is pretty you know standard image and then of course they put that a beautiful but butterfly is then going to land on one of these flowers and we can see immediately a butterfly manages to land on this now I don't think most people realized the significance of this example image imagine like you were a filmmaker and you wanted to get like a really important shop that had like some kind of creature on it for example you wanted to get a shot for a film where a butterfly lands maybe you're making a short film about how a butterfly represent something I think you're underestimating how long it would take to get a butterfly to land on a specific piece of material but if you could you know firstly pick up the shot and then just enter a prompt this is going to be

### Scene modification [10:33]

something that saves you a huge amount of time and huge amount of effort and another thing that individuals often struggle with in film making is of course fixing scenes initially here you can see we have a scene that showcases a hand flicking up a switch but what about if we wanted to fix the scene because we forgot to use the scene or we simply wanted to experiment we could add the prompt a gloved astronaut hand enters the cable and unplugged one of the yellow cables that is something that we could easily do and you can see that the Adobe Fireflight model manages to film that and shoot that rather effortlessly so this is something that I think is going to save people so much time because I'm someone that's done a little bit of film making before and I can tell you guys firsthand that is the most timec consuming thing that I have I

### Premiere integration [11:26]

don't want to say I've ever been a part of but it was something that was truly timec consuming so stuff like this is definitely going to save people a lot of time now Adobe managed to bake this feature natively into Premier Pro beta and I definitely think you guys should try it out I'm going to play you guys a small clip from Adobe and then the video will be over so watch this to show you guys how video editing is most certainly going to change but I think Adobe should take it from here