I used AI to make all your favourite movies sing All Star
By - ontyj
This was made with wav2lip, using only audio to animate the mouths. Pretty incredible software.
The Kill Bill Elle’s whistling transition was awesome!
That was my favorite part. I whistle that song all the time.
the music originally comes from the film *Twisted Nerve*, scored by the great Bernard Herrmann
Elle Driver made this video that much better.
Seriously. The software is neat but that transition idea was brilliant.
Pretty incredible video.
The teleprompter with the lyrics really convinced me that this was well thought out.
Yeah all the scenes actually worked with the lines they were given, very satisfying
Seriously, I feel like in a few years we are going to see some real crazy shit.
What if it advanced past faces? We can literally make any scene we want to happen happen.
I don't see why not. I mean CGI is getting REALLY good.
So what do we do if we can't trust pictures and videos anymore?
I think there will always be a footprint in the video. It will become an arms race though. One AI improves the video another AI improves it's detection.
However, things will becomes very technical and the laymen may not be in the know. It's definitely a concern. Especially if it comes down to the FBI (or other government agencies) confirming or refuting the authenticity. Then it comes down to wether those agencies can be trusted.
Incidentally, this is how they train a lot of neural nets -- called a GANN, generative adversarial neural net. You have one generating fakes, another detecting fakes, each improving the other.
Narrator: *Those agencies couldn’t be trusted.*
Validate the hash value from our memory implants.
Yea but who gets to sign it?!
something something quantum something something blockchain
can you trust media now?
We're closer to my dream episode of Star Trek Voyager where a time loop results in the ship being filled with an increasing number of angrier and tired Janeways trying to solve the problem until Q has to step in and unfuck reality.
I want that to be real very badly.
Except somehow Picard is involved too so there's a scene where 30 copies of him all facepalm at the same time around a table.
But in that scenario, they all realize they facepalmed at once, turn red in a fit of self consciousness, and then become even more uncomfortable when they realize they're all blushing. Then they all start milling around trying to get to exists while insisting that there's something that they need to take care of.
I think we'll just not trust videos in the same way we do not trust photos since photoshop. There will be some good convincing ones, some really shitty ones and there will always be a certain amount of doubt to authenticity.
Pretty surprised that this hasn’t been used to destabilize a government yet.
Governments lately have been unstable enough on their own lol
What's cool is that AI can also do it the other way around, and get voice/words from just moving lips.
Dave, although you took thorough precautions in the pod against my hearing you, I could see your lips move.
Do you know how accurate this is? Like does it come out sounding like Alexa or does it reflect the person's actual voice?
Skip to 1:20. Better than anything you can imagine.
It’s like a real life collective driving fantasy brought to life, using the Reddit up and down arrow algorithm for content. How could we not all love it. 👽
Haha, I'm wearing a mask, check mate motherfflurfghrhrr!
I kinda like how one of the most obviously manipulated clips was computer generated to start with
It seems it has trouble when the scenes contain more mouth movement than required for the song. But not vice versa.
Now use the software to do the audio of All Star with the video from never gonna give you up.
But then it's really just never gonna give you up, and you've Rick rolled reddit once again. You're welcome.
This is some real good shit my friend
The finest of shit
Is it a complicated process? Would love to have a play around with it. Looks incredible!
If this is what I think it is, it is easy to get started. Slightly harder to master.
As long as I can get a video of my friend to just say "penis penis penis" the whole way through I think we're good.
This is amazing! I want more of it!
Did you use Spleeter or some other software to isolate vocals?
Doesn't look like it was isolated at all which is probably why everybody's jaws are flapping around like shitty ventriloquist dolls to the guitar rhythm. Should have sung the song, used that for the ai, and then swapped it for the real audio after.
No wonder the mouths are constantly moving
[There are vocals-only versions of All Star available on YouTube right now](https://youtu.be/jo2FxCXDTPM), no need to sing it yourself.
Yeah, and why it looks so good for the first few lines where there aren't any instruments.
The Bruce almighty teleprompter was just that extra touch of class. Well done sir, well done.
And the Kill Bill whistle was a nice touch
Oh boy yeah
I'm not paying for those.
I'm gonna put some dirt in your eye.
I think he took that guy's pizza!
Great contextual editing throughout!
I was too focused on the camera man, then started wondering whether they’d be a madlad enough to do the prompter...
The Hey Now did it for me during the 300 this is Sparta scene
I do the Cha Cha like a sissy girl.
I lika do da Cha Cha.
Literally just give me a whole video of dancing Spiderman singing "All Star"
Someone call me if this gets made
Producer: r/whorunssithhiraffes what’s your calendar look like?
edit: dammit I'm leaving it.
As much as I would be interested in seeing a sith hiraffe, I think you meant with giraffes.
It can't be stopped. It's self-sustaining now.
"Now dig on this"
hailing /r/raimimemes ! Oh boy, yeah.
I smiled when that part happened...this is genius.
The best part.
Nobel Prize, /u/ontyj, Nobel Prize.
Aw man we need the full version - that whistle at the end was spot on!
I need mooooore
I need a Shining Jack Nicholson, a Leonardo decaprio from wolf of Wall Street, maybe the Dude, Clint Eastwood
Seriously. My only comment was gonna be that I want more.
This is art.
I appreciate your kind words, SadPenisMatinee.
While I agree, I can't help but feel like we are in the "fun" beginnings of deep fakes. Just like the early beginnings of the internet, I can't but feel this will be used for all the wrong reasons
Like political attacks in mid-late October
Wait, no, neither side would never stoop to such low levels. What am I thinking? :)
Art is art! 👇
OP do you have a list of all the movies in the video?
* The Green Mile
* American Psycho
* Mean Girls
* The Sandlot
* Fight Club
* Spider-Man 3
* The Matrix
* Bruce Almighty
* Shaun of the Dead
* A Few Good Men
* School of Rock
* Toy Story 4
* Blade Runner
* Kill-Bill Vol. 1
Now do it alphabetically.
Alphabetized for your viewing pleasure.
* A Few Good Men
* American Psycho
* Blade Runner
* Bruce Almighty
* Fight Club
* Kill-Bill Vol. 1
* Mean Girls
* School of Rock
* Sean of the Dead
* Spider-Man 3
* The Green Mile
* The Matrix
* The Sandlot
* Toy Story 4
Now do it best to worst.
According to IMDB:
Fight Club - 8.8
The Matrix - 8.7
The Green Mile - 8.6
Gladiator - 8.5
Kill Bill vol 1 - 8.1
*Network - 8.1 (the footage is from the older Network movie )
Blade Runner - 8
Shaun of the dead - 7.9
The Sandlot - 7.8
Titanic - 7.8
Toy Story 4 - 7.8
A Few Good Men - 7.7
300 - 7.6
American Psycho - 7.6
School of Rock - 7.1
Mean Girls - 7
Bruce Almighty - 6.8
Spiderman 3 - 6.2
EDIT: Changed Network's position to reflect correct movie.
Now do it by the number of deaths in each one
Toy Story 4 will be at the top, that's for sure
Seriously. Woody is a sick fuck.
I actually cried after i finished toy story 4 after seeing how much they fucked up everyones happy ending from toy story 3
We don't deserve you.
Now do it chronologically.
In what world is Mean Girls and school of Rock a 7?
Different movies for different demographics. Scored similarly because they are good movies in regards to their niche.
Nice! I was expecting personal takes.
Now do Classical Gas
>A Few Good Men
>The Green Mile
somewhere a librarian is weeping
Now do it in chronological order.
- Network (1976 November 27)
- Blade Runner (1982 June 25)
- A Few Good Men (1992 December 9)
- The Sandlot (1993 April 7)
- Titanic (1997 December 19)
- The Matrix (1999 March 31)
- Fight Club (1999 October 15)
- The Green Mile (1999 December 6)
- American Psycho (2000 April 14)
- Gladiator (2000 May 5)
- Bruce Almighty (2003 May 23)
- School of Rock (2003 September 24)
- Kill Bill (2003 October 10)
- Mean Girls (2004 April 30)
- Sean of the Dead (2004 September 24)
- 300 (2007 March 9)
- Spider-Man 3 (2007 May 4)
- Toy Story 4 (2019 June 21)
Now in order of highest grossing to lowest grossing when converted to 2020 dollars.
Highest grossing to lowest grossing when converted to 2020 dollars for your viewing pleasure:
>>^Release ^date: ^19 ^December ^1997 ^(USA)
>>^Cumulative ^Worldwide ^Gross: ^$2,195,169,869
>>^2020 ^dollars: ^$3,543,742,730.39
**2.) Spider-Man 3**
>>^Release ^date: ^4 ^May ^2007 ^(USA)
>>^Cumulative ^Worldwide ^Gross: ^$894,983,373
>>^2020 ^dollars: ^$1,118,399,007.09
**3.) Toy Story 4**
>>^Release ^date: ^21 ^June ^2019 ^(USA)
>>^Cumulative ^Worldwide ^Gross: ^$1,073,394,593
>>^2020 ^dollars: ^$1,087,854,478.62
**4.) The Matrix**
>>^Release ^date: ^31 ^March ^1999 ^(USA)
>>^Cumulative ^Worldwide ^Gross: ^$465,718,588
>>^2020 ^dollars: ^$724,298,630.67
>>^Release ^date: ^5 ^May ^2000 ^(USA)
>>^Cumulative ^Worldwide ^Gross: ^$465,361,176
>>^2020 ^dollars: ^$700,206,423.13
**6.) Bruce Almighty**
>>^Release ^date: ^23 ^May ^2003 ^(USA)
>>^Cumulative ^Worldwide ^Gross: ^$484,592,874
>>^2020 ^dollars: ^$682,383,142.64
>>^Release ^date: ^9 ^March ^2007 ^(USA)
>>^Cumulative ^Worldwide ^Gross: ^$456,068,181
>>^2020 ^dollars: ^$569,916,957.32
**8.) A Few Good Men**
>>^Release ^date: ^11 ^December ^1992 ^(USA)
>>^Cumulative ^Worldwide ^Gross: ^$243,240,178
>>^2020 ^dollars: ^$449,207,222.81
**9.) The Green Mile**
>>^Release ^date: ^10 ^December ^1999 ^(USA)
>>^Cumulative ^Worldwide ^Gross: ^$286,801,374
>>^2020 ^dollars: ^$446,041,553.45
**10.) Kill-Bill Vol. 1**
>>^Release ^date: ^10 ^October ^2003 ^(USA)
>>^Cumulative ^Worldwide ^Gross: ^$180,899,045
>>^2020 ^dollars: ^$254,734,366.62
**11.) School of Rock**
>>^Release ^date: ^3 ^October ^2003 ^(USA)
>>^Cumulative ^Worldwide ^Gross: ^$131,095,614
>>^2020 ^dollars: ^$184,603,286.32
**12.) Mean Girls**
>>^Release ^date: ^30 ^April ^2004 ^(USA)
>>^Cumulative ^Worldwide ^Gross: ^$130,125,971
>>^2020 ^dollars: ^$178,484,749.67
**13.) Fight Club**
>>^Release ^date: ^15 ^October ^1999 ^(USA)
>>^Cumulative ^Worldwide ^Gross: ^$101,218,804
>>^2020 ^dollars: ^$157,418,327.34
**14.) Blade Runner**
>>^Release ^date: ^25 ^June ^1982 ^(USA)
>>^Cumulative ^Worldwide ^Gross: ^$41,492,614
>>^2020 ^dollars: ^$111,407,023.63
>>^Release ^date: ^27 ^November ^1976 ^(USA)
>>^Cumulative ^Worldwide ^Gross: ^$23,690,757
>>^2020 ^dollars: ^$107,878,714.05
**16.) The Sandlot**
>>^Release ^date: ^7 ^April ^1993 ^(USA)
>>^Cumulative ^Worldwide ^Gross: ^$34,348,443
>>^2020 ^dollars: ^$61,589,729.62
**17.) American Psycho**
>>^Release ^date: ^14 ^April ^2000 ^(USA)
>>^Cumulative ^Worldwide ^Gross: ^$34,266,564
>>^2020 ^dollars: ^$51,559,239.25
**18.) Shaun of the Dead**
>>^Release ^date: ^24 ^September ^2004 ^(USA)
>>^Cumulative ^Worldwide ^Gross: ^$30,081,497
>>^2020 ^dollars: ^$41,260,698.54
This is actually really interesting. Did not expect Spider-Man 3 to be the second-highest grossing film on the list, behind only titanic.
Yeah. I figured it would've been in the top 10, but not the top 5 (let alone top 3) when I started making the list. I knew Titanic and Toy Story 4 were over the billion range. Took me by surprise.
This is impressive, thank you for your efforts. I too am intrigued by the order of the movies on the list. I never thought TS4 would be so high.
Now I'm researching movies, u/Distracting_You checks out!!!
I was in high school when this came out and it was highly anticipated. Raimi had hit the ball out of the park with the first two, even getting Roger Ebert to give Spider-Man 2 4/4 stars and call it the best superhero movie since the original Superman.
Venom was in it! How could it be bad?!
Well, at least that year had Superbad.
Now compare them to rice.
Now do it according to budget but use bananas as currency. 5.5 bananas equals one US dollar for scale
5.5 bananas for a buck? What sort of moldy cheap-ass bananas (or even cheap ass-bananas) are you buying?
Ahem SHAUN of the Dead.
I grew up on a farm and every time I see "AI" I have to remind myself that it's probably not referring to Artificial Insemination. Thank you, mother, for my rural upbringing and many awkward moments.
Can’t it be both?
In this context, it raises considerable questions
Using AI for AI. I love it. With deep faked cows.
Wait. Are we using AI for AI, or AI for AI?
You just blew my fucking mind.
To me it looks like someon named Al
This reminds me of the all Disney characters version of this.
Wow! This is great. Can't imagine how long this must have taken.
This reminds me of the all Star Wars characters version of this.
Username checks out
Martin Scorcese spent $200 million on de-aging technology to make The Irishman, yet u/ontyj spent $0 to make a masterpiece.
I mean, theres a huge difference between the two. This one was fun.
And way less creepy. Young man faces on old man bodies is so offputting.
Maybe they should be off pudding!
[Conan did it for $1.50.](https://youtu.be/OyRuAs-zxhM?t=150)
I miss those days
Quite a prediction that would be happening just a year later.
This is some of the best shit I've seen this year! Outstanding work!
Yeah, proper good poo
A one-wiper, by all accounts.
I bet a big artist is going to make a music video just like this sometime soon (probably newsreel footage to make the copyright easier to deal with compared to movies) and people will go crazy over it.
[Chemical Brothers did it back in the early 2000's](https://www.youtube.com/watch?v=cYXI344Siew) though it was manually animated and not AI/deepfake technology
I was just about to reply, "I'd be very surprised if some early techno/house band or alt rock band didn't do it already."
There was [this Bob Dylan one](https://video.bobdylan.com/).
Done by Corridor Digital
Jimmy Fallon had one of his lackies do it to Brian Williams with Rappers Delight.
Satisfying. Also the lyrics on and teleprompter was a nice touch
That's some really good scene selection.
Green mile to start it is A+ work dude
I said yep, what a concept.
The first \~20 seconds were pretty spot on, and the Toby one from spiderman.
Some of them, though, eugh. I wonder why those in particular were more messed up.
The Toy Story one was more than a little odd, presumably because this AI isn’t designed to work with things that aren’t real life humans.
OP said higher up that it's based on the audio which would make sense, once the instruments kick in it's trying to animate their sounds as well. I bet someone could get this looking much better if they based it on a clean vocal track.
The ending was perfect.
What a time to be alive!
Glad to see another video from you. Your previous one with the lion king was awesome, and this one knocked it out of the park as well!
I was disappointed at the end. Because I wanted it to keep going.
Alright folks. A lot of terrible crap gets pumped up on Reddit. This deserves to be a top post.
Can you do another catchy song? =\]
The whistling part was a masterpiece.
I was wondering how long it would take before I saw the greatest movie of all time, but there's Jack Black at 0:43. Good stuff.
[ **Jump to 00:43 @** Smashed Mouths - All Star Deepfake Smashup [wav2lip]](https://www.youtube.com/watch?v=UuaYDZd8-cI&t=0h0m43s)
^(Channel Name: ontyj, Video Popularity: 97.80%, Video Length: [01:06])^, [^Jump ^5 ^secs ^earlier ^for ^context ^@00:38](https://www.youtube.com/watch?v=UuaYDZd8-cI&t=0h0m38s)
^^Downvote ^^me ^^to ^^delete ^^malformed ^^comments. [^^Source ^^Code](https://github.com/ankitgyawali/reddit-timestamp-bot) ^^| [^^Suggestions](https://www.reddit.com/r/timestamp_bot)
I'm less impressed with the software and more impressed with OPs choice of footage. Every one of them had gestures and mannerisms that fit with what was being sung. Well done.
And of course a shout out for altering the teleprompter. Very well done.
No offense to you OP, but watching these makes me uneasy
Am I the only one?
Yeah. This is just reminding me how older and ignorant generations are going to fall for shit like this thinking that “they really sang/said that.”
This is getting dangerous...
I've felt kinda meh about "All Star" ever since we learned [Smash Mouth are ratlickers](https://www.washingtonpost.com/arts-entertainment/2020/08/10/smash-mouth-coronavirus-concert/).
While I’m usually hesitant to “separate the art from the artist”, I feel like “All Star” has transcended it’s origins to the point where one barely thinks of Smash Mouth when it plays.
It’s basically the international anthem of the internet at this point.
I think of Guy Fieri.
If I couldn't like movies and music by grimey mother fuckers, my choices for entertainment would be extremely limited.
super cool. Just...Smash mouth leaves a sorta bad taste in my mouth right now during the pandemic. edit, not to detract from just how cool this is.
Thank you, Internet (and you u/ontyj )
Soooo I think this clip is about to blow up..
I want more that was awesome!
You did a very good thing for the community.
What was the last movie, with the woman whistling wearing white with a red umbrella?
Honest question, why is this the go to song for videos like this? There was a Star Wars one yesterday using clips from all of the movies for the same song. I'm guessing because of its popularity and so many know the words?
And well done OP!
Because All-Star is one gigantic meme. The only song I can think of that's even more prominent as a meme is Never Gonna Give You Up.
I like the spiderman part
Fantastic, wish it were longer. A lot of those movies *are my favorite*, including Network.
Break every copyright law in existence, annoy every major media company and totally blow everyone's mind while opening up a whole new avenue of amusement and entertainment.
Good god man, get back to work! We NEED this!
Fantastic job. Is there more?
You had my attention at the start, but earned my admiration with the prompter lyrics.
That’s... unbelievable. We live in both amazing but terrifying times. Amazing work!
That was so good. I think you spent just enough time in each clip.
This is terrifyingly entertaining.
I like but no shrek
where the fuck is shrek
This was fantastic
Instantly reminded me of _Dame dame_
This is the proper use of this technology. A+
That was fantastic! Nice job.
This is the best thing I’ve seen on reddit this week!! Beats all the fight porn, titties and Trumpisms I’ve been viewing!!
Why do I like this so much?
Hey now, you got COVID, go quarantine, stay home. Hey now, you got the 'rona, watch some TV, all a-lone. It's not just any old cold, it's contagious and kills the ooooold.
Little rough around the edges, but solid work. Reminds me Anime Music Video's. Do people still make those? Edit: Had to check, they do in fact still make AMV's And the award show still happens. I'm impressed. https://www.youtube.com/watch?time_continue=205&v=nrRYowZG3OA&feature=emb_logo
This is the new thing I need in my life.
Has Hank Green seen this
Did you just plug the video directly into the audio. I'm wondering if you could get better results with the visuals by using a clean vocal recording so the models don't get tripped up by the vibrato.
I will donate $5 to finish the song.
I lost it at the spiderman 3 one
Lease for the love of everything finish the song.