How AI Breathes Life Into Old Films

## Metadata
- Author: [[Hard Fork AI]]
- Full Title: How AI Breathes Life Into Old Films
- Category: #podcasts
- URL: https://share.snipd.com/episode/a768ed3c-25a7-41d0-b292-2f7169a23fda
## Document Notes
## Highlights
- **AI Enhances Immersive Film Experience**
- AI is used to not only increase film resolution but also expand original scenes for immersive experiences.
- This process allows viewers to feel as if they are inside the movie, enhancing engagement.
Transcript:
Jaeden Schafer
So basically, they're blowing up the wizard of Oz, which by the way, if you didn't know, the wizard of Oz is actually according to the library of Congress, the watched film of all time Uh is the wizard of oz now i'm not 100 sure how they calculate that like perhaps maybe it's true maybe it's true it is it is an old film and so people watch the old films but um i don't know anyways I guess i guess i'm not questioning the library of congress i just like i actually to not if i'm being honest i don't think i've seen the whole thing through i've seen a lot of clips of it. So maybe that's just me. But in any case, it is the most watched film of all time, apparently. And they're putting it into the Las Vegas sphere, which if you don't know, giant ball inside of Las Vegas, where the whole thing inside and outside is LCD screens. And it's 360. You look around, it's amazing, right? So what's interesting, though, is you can't just like, they're not just taking the film and projecting it on like a 360. So you have to like crane your neck and look in a circle to see everything that's going on. They are creating a whole new experience. So they're using AI to generate the edges to increase like the size and, and doing a whole bunch of things to make it more immersive, to feel like you're inside of the movie, which is really Interesting. They had, um, had like some clips where they were sharing kind of what it looked like they said apparently there's 2 000 people working on it but uh i was i'm sharing a clip where basically You're inside of the tornado and the sphere all around you is showing you like you're it's a tornado funnel and then it's sucking you up and it like looks really really impressive but The thing that was pretty tricky with this whole movie was basically you can't just use a regular film for this experience and also i would say like the sphere is an interesting thing And you might be like who cares about the sphere like it's a tourist attraction but i think it's interesting because this exact same concept and strategy that they're applying here Is also going to be needed for vr for apple's and sets for meta's headset or for anything else like that if you want to watch these 360 movies it's going to to be the same concept. So I think it's not just going to be like, it's not like, oh man, no other movie company needs to do this because it's just the spirit. It's like, well, if you want to have these 360 immersive videos, I think a lot of people in the future would be interested in that. And so this is probably something that will happen more and more in addition to maybe like increasing quality or other things like that, which some people argue because they just love The artistic uh authentic old quality of something so i mean that's a great viewpoint as well in any case this is going to be starting on august 28th that this movie is going to be premiered Like i mentioned there is a 2 000 person team that is currently working on this. And of course, the sphere is massive, 160,000 square feet, this kind of 360 experience. ([Time 0:02:37](https://share.snipd.com/snip/b848ba03-21c3-4723-8fa7-af7861598ee9))
- **AI Solves 360 Viewing Challenges**
- Experiencing a 360-degree film means viewers must look around to see all action.
- Traditional film formats aren't suited; AI helps create content to fill the wider viewing field.
Transcript:
Jaeden Schafer
Look around, it's amazing, right? So what's interesting, though, is you can't just like, they're not just taking the film and projecting it on like a 360. So you have to like crane your neck and look in a circle to see everything that's going on. They are creating a whole new experience. So they're using AI to generate the edges to increase like the size and, and doing a whole bunch of things to make it more immersive, to feel like you're inside of the movie, which is really Interesting. They had, um, had like some clips where they were sharing kind of what it looked like they said apparently there's 2 000 people working on it but uh i was i'm sharing a clip where basically You're inside of the tornado and the sphere all around you is showing you like you're it's a tornado funnel and then it's sucking you up and it like looks really really impressive but The thing that was pretty tricky with this whole movie was basically you can't just use a regular film for this experience and also i would say like the sphere is an interesting thing And you might be like who cares about the sphere like it's a tourist attraction but i think it's interesting because this exact same concept and strategy that they're applying here Is also going to be needed for vr for apple's and sets for meta's headset or for anything else like that if you want to watch these 360 movies it's going to to be the same concept. ([Time 0:03:20](https://share.snipd.com/snip/a1c3cc75-8330-4190-b1fa-85241159034e))
- **AI Outpainting Expands Film Frames**
- AI outpainting fills in missing parts of scenes to fit immersive formats.
- Sometimes new performances are generated to expand frames while preserving film authenticity.
Transcript:
Jaeden Schafer
Make it like 360 you need to fill in that elbow so that there's nothing beside it and also you need a lot more space to the right and left of of the shot so they're they're like they're basically What they said that they're trying to do is they said, this is Dolan. He said, quote, our standard on this was not to modify the film at all, but to try and bring you into the film as if you were in the studio when it was shot. So I think what's interesting is like there's the outpainting for sure. But they also said that in some cases, expanding the frame means that they actually have to create some new performances from the existing characters that weren't there originally. And so I guess that's like historically what people complain about the most. But I think overall, they're trying to stay true to the film, they're trying to basically make it the same film, and they just have to expand it a little bit. ([Time 0:06:12](https://share.snipd.com/snip/88f33055-82b9-4977-87db-5bef7db2200d))
- **AI Saves Video Editing Time**
- Jaeden used AI tools in Adobe Premiere to extend video clips seamlessly.
- The enhancement saved time and was invisible to viewers, improving editing efficiency.
Transcript:
Jaeden Schafer
Make it the same film, and they just have to expand it a little bit. I think the concept is fascinating. I was recently editing a video over on Adobe Premiere, and they have a very interesting similar tool. Basically, I had a clip that needed to be synced up to something in particular. And the video was shorter than the audio I was syncing it to. And the video at the beginning of this particular clip was, it was like pointing at like a rock and then it panned over to something. And so basically, I just used AI, clicked and dragged it. And it just, it just added some extra motion, some extra, I don't know, rock texture before. So the whole clip synced up with the audio. I thought it was absolutely amazing. It saved me so much time and pain in that particular situation. And no one that ever watches the film is ever getting like, it's not even like, oh, your videos AI generated. It's like, you're just using AI to help fill out a little pieces the same way you use Photoshop to help tweak an image or, or basically all the tools we have from Photoshop, we now have for Video as well. ([Time 0:06:50](https://share.snipd.com/snip/fd8e32c5-f0b0-4b61-a64f-75309af559b2))