zzdcar
Home
/
Reviews
/
Culture
/
Let's See How Well A Deepfake AI Can Make Cars Lip-Sync
Let's See How Well A Deepfake AI Can Make Cars Lip-Sync-November 2024
2024-02-19 EST 22:12:25

I’m not sure how closely you’ve been following the strange new field of AI-enabled and how shockingly accessible they’ve gotten for , but just trust me when I tell you that it’s easier than ever to make plausible-looking videos of people doing things they didn’t actually do. There’s even a goofy/impressive that can make a picture of anyone appear to lip-sync songs. So, it’s time to shove some cars in there.

So far I haven’t seen anyone really attempt to force this Wombo AI—likely a glowing orb in a tank of bluish gel—to anthropomorphize car front ends according to its complex and likely unknowable human face parameters to see how well it works.

As America’s first self-appointed Automotive Anthropomorphization Czar, it’s my responsibility to do so. So I did. And I picked the songs from the limited set available mostly at random, so try not to read too much into that.

I started with one of the most face-like automotive front ends I could think of, an Austin-Healey Bugeye Sprite:

wombo: Bugeye Sprite

As you can see, it did pretty well! It clearly pegged the headlights as eyes, the grille as a mouth, and the resulting morphed motion definitely feels like what a rubbery Bugeye Sprite would likely look like singing James Brown.

Now, let’s try something more confusing: Luigi, the Fiat 500 , which uses the debased

Wombo: Luigi (Fiat 500) Cars

Based on this result, I am not certain the Wombo AI has a preference of its own, as I can’t tell if its reading the windshield irises as eyes or forehead? Either set of eyes is kind of working here. Hm. (The AI has clearly chosen the windshield eyes.—ED)

More study is needed.:

Wombo: Pao

I think it made a good call with the bumper-mouth there, and I’m reading the main headlights as eyes, though it’s possible the foglamps confused it? I’m not sure, but I think it works surprisingly well.

What worked surprisingly unwell is a car that I’ve always felt to have a very identifiable face, a classic Volkswagen Beetle:

Wombo: Beetle

The lack of a grille/mouth opening seems to have really confused it, making the hood act as a sort of snout. I’m not clear where it thinks the eyes are, as the headlights are all but ignored?

Let’s try something with a much more obvious grille: this International semi truck:

Wombo: International Truck

The formatting of the videos here is cutting off a bit at the bottom where a lot of the mouth articulation is happening, but I think this one works pretty well. I believe that truck wants to go to Funkytown.

Wombo: Jaguar E-Type

I picked another obvious mouth-grille here, a Jaguar E-Type, and the result is, yes, the car looks like it’s singing. Even if the AI doesn’t know what to do with the eyes, I think our brains comfortably read the headlamps as eyes in this context, though I think I saw the wipers blink.

Let’s pick a more modern car with a very facial front end, a Mazda 3:

Wombo: Mazda 3

Obvious grilles clearly help this AI succeed. Let’s do one last one, the gloriously worried-face-looking Soviet UAZ 452 van:

Wombo: UAZ 452 van

Okay, that works, in its way! That old Iron Curtain van clearly is determined to survive. It seems to be singing more out of the side of its grille than the others, but that just adds some character.

I feel like there’s a hell of a lot more important research to be done here, and I strongly encourage everyone to find some good car-faces and try it out, loading the results in the comments so we can all scrutinize and attempt to better ourselves via understanding.

Really, I can’t imagine anything more important any of you would have to do, right?

Comments
Welcome to zzdcar comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
Culture
2024 Kia EV9: What Do You Want To Know?
2024 Kia EV9: What Do You Want To Know?
At long last, we are about to get behind the wheel of for the first time. Sure, , and sure, , and sure , but hey — what can you do? Anyway, before we get behind the wheel of this three-row electric beast, we want to know what you...
Nov 21, 2024
I Can't Get Enough Of This YouTuber Who Builds Tiny, Fully Functional Scale-Model Cars
I Can't Get Enough Of This YouTuber Who Builds Tiny, Fully Functional Scale-Model Cars
I love tiny, of . I have a that is roughly half the size of a normal cat, and she’s perfect. I own a 2013 , which is like the miniature version of a normal-sized vehicle (at least here in Texas) — but beyond that, I also own a Hot...
Nov 21, 2024
Subaru Had It Right All Along
Subaru Had It Right All Along
When first came to the United States, it sold small funky cars that were decidedly un-American. As the company grew its own identity and became more established in the U.S., it became the first automaker to offer an all-wheel-drive passenger car in 1975. Subaru was also an early-adopter of...
Nov 21, 2024
Toyota Is Moving A Prewar 700-Ton Press Machine Halfway Around The World
Toyota Is Moving A Prewar 700-Ton Press Machine Halfway Around The World
closed its São Bernardo Plant in November 2023, marking the end of its first overseas production facility. The closure caps off a period of continuous car production in São Paolo, , lasting over 60 years. The plant was home to a Komatsu 700-ton press that predates itself. And now...
Nov 21, 2024
I Entered My Lifted Miata In A Real Off-Road Race, Here's What Happened
I Entered My Lifted Miata In A Real Off-Road Race, Here's What Happened
I have two automotive loves: The first is the Miata, the second is off-road racing. For a while I raced air-cooled Volkswagens in the deserts of California and Nevada and I was lucky enough to co-drive in a class 11 stock bug in the Baja 1000 a few years...
Nov 21, 2024
Watch ABS Fail When MotorWeek Tests A 1997 Chevy S-10
Watch ABS Fail When MotorWeek Tests A 1997 Chevy S-10
MotorWeek’s is some of the on the internet. The long-running automotive news magazine has a treasure trove of tests after being on the air for over 40 years. Where else can you find detailed instrumented testing of long-forgotten cars like the or a ? MotorWeek’s recent Retro Review upload is...
Nov 21, 2024
Copyright 2023-2024 - www.zzdcar.com All Rights Reserved