Face Substitution on Vimeo

00:00

115

See all Show me

102. Messages

by Kyle McDonald

2 months ago

101. Temperature Flashlight Hacking at Public Lab

by Kyle McDonald

2 months ago

100. Face++

by Kyle McDonald

2 months ago

99. Falling

by Kyle McDonald

3 months ago

98. Falling

by Kyle McDonald

3 months ago

97. Scramble Suit

by Kyle McDonald

5 months ago

96. Face Substitution

by Kyle McDonald

5 months ago

95. BBC News vs Kink & Neville Watson

by Kyle McDonald

6 months ago

94. 3d Multi-scale Turing Patterns

by Kyle McDonald

7 months ago

93. FaceOSC

by Kyle McDonald

7 months ago

92. Tessellation for extrusion

by Kyle McDonald

9 months ago

91. Autotimelapse

by Kyle McDonald

9 months ago

90. LaGuardia Landing vs Dublee

by Kyle McDonald

9 months ago

89. Easy Camera Calibration

by Kyle McDonald

10 months ago

88. ofxAutostereogram Demo

by Kyle McDonald

10 months ago

87. ofxZxing Demo

by Kyle McDonald

10 months ago

86. LGA Airtrain vs Do Make Say Think

by Kyle McDonald

11 months ago

85. Poisson Reconstruction in Meshlab

by Kyle McDonald

11 months ago

84. Qatar 2022 Bid Celebration

by Kyle McDonald

1 year ago

83. Depth of Field with Lines

by Kyle McDonald

1 year ago

82. Interaction Survey: Cinekid

by Kyle McDonald

1 year ago

81. The Janus Machine

by Kyle McDonald

1 year ago

80. Eyewriter Demo at Cinekid

by Kyle McDonald

1 year ago

79. Experimental Visualism

by Kyle McDonald

1 year ago

78. Floating Los Angeles

by Kyle McDonald

1 year ago

77. ofxSpaceNavigator development

by Kyle McDonald

1 year ago

76. keytweeter

by Kyle McDonald

1 year ago

Working on an idea with Arturo Castro vimeo.com/29279198 I feel like "good" blending looks almost too natural to be surprising. It doesn't leave any interpolation up to your imagination. It's possible to push this style further, so it's less of a blend and more of a replacement, but then you get unnatural colors and shadows.

FaceTracker library from Jason Saragih web.mac.com/jsaragih/FaceTracker/FaceTracker.html
ofxFaceTracker addon github.com/kylemcdonald/ofxFaceTracker
openFrameworks openframeworks.cc/

Download the app here github.com/arturoc/FaceSubstitution

Credits

1,418 Likes

Videographers
22 hours ago
L's act
1 day ago
kuni
1 day ago
inoook
2 days ago
Josh Murr
4 days ago
Audio Dregs Recordings
5 days ago
qi su
5 days ago
Daria Adamitskaya
6 days ago
Draige
1 week ago
BplusFILMS
1 week ago

Tags

Greg Borenstein 5 months ago

Kyle McDonald + Salvador Dali = John Waters. Awesome stuff guys!
Jason Walters 5 months ago

Brilliant as always.
Storybox 5 months ago

Great stuff. Takes the concept of what a mask is to the next level.
Dr. Woohoo! 5 months ago

Your Zach impersonation is classic! LOL. You guys are too much. I love it.
Golan Levin 5 months ago

You really inhabit those characters.
BTW, I look AWFUL.
Kyle McDonald 5 months ago

your face got tracked poorly so it doesn't really work. it's also because the light on your face is kind of harsh -- it would work better if the light was more from the front or ambient.
Garnet Hertz 5 months ago

Love it - great work.
onformative 5 months ago

Great. definitely better version of this sketch that is already some years old:
nikpalmer.com/I_am_Brad_Pitt/
David Stolarsky 5 months ago

i smell a media art meme hatching.
k.o.d.3000 5 months ago

you guys should try feature slicing three separate images and blending that together and call it ofxmegaFace lol :)
watz 5 months ago

Wow, Kyle, you getting your Marilyn on is going to haunt my dreams for a while. You're not planning to do this to anonymous strangers in Apple Stores, are you?
Kyle McDonald 5 months ago

really, it's marilyn and not paris that does it for you? ;)

also: i thought that's what the photobooth effects are for?
watz 5 months ago

Marilyn is by far the creepier. My performance artist ex-wife could do some real damage with this stuff, believe me...
Bryan V. 5 months ago

Dude! Could you use a webcam feed of your chat partner as the input source, and create a constantly evolving, hall of mirrors face?
Andy Clymer 5 months ago

Needs more Aphex Twin :)
Matthew Brown (Matty Brown) 5 months ago

Lololol!
Fizah Rahim 5 months ago

so fun!
Chris O'Shea 5 months ago

Please both make a piece on chat roulette, where you take on the face of the person you are talking to!
Pablo Marques 5 months ago

Not sure why but i have the feeling whoever does that will end up looking like a dick.
Kyle McDonald 5 months ago

i think this is the only time i've heard the phrase 'they will look like a dick' used non-metaphorically.
Dan Wilcox 5 months ago

Yeah, make a Cam plugin like FaceFlip: vimeo.com/11194351
Charlie Hoey 5 months ago

+1 - just had the same thought, gotta make this
m9dfukc 5 months ago

Nice, looks very smooth. I did some very similar test while working on "Artificial Smile" through back then I wasn't able to get them running over 10fps so never made them public.

May I ask what poisson blending algorithm you use?
Kyle McDonald 5 months ago

i haven't read the image cloning stuff, so i'm not sure if this is 'right'. i started with code arturo sent me a few weeks ago, simplified it to about 80 lines until i understood it, then implemented it as a vertex shader. the fundamental blending equation is: frag_src + (vert_dst - vert_src) where frag_src is the current color in the target face and vert_src/dst are the interpolated colors in the target/live face. the interpolation is heavily dependent on the triangulation of the mesh, so i decided to treat the (vert_dst - vert_src) operation as kind of low pass difference. the final result is: frag_src + (blur_src - blur_dst). the size of the blur kernel is given at the top left in the video, where it says 'strength'. a lower value emphasizes the dst characteristics, and higher emphasizes src.
Pablo Marques 5 months ago

You've moved it even further. Incredible.
Mercedes Elena 5 months ago

asombroso!!!
James George 5 months ago

oh this is so wonderful. I remember Joel Lewis talking once about how in the future you will be able to 'be Bruce Willis' -- our simulations will be able to fully replicate the being of someone we idolize... but in the end there will always be this hollowness in the experience. no matter how close we get to faking these things we still aren't actually the thing we are simulating... this is the beginning of discovering that difference. so rad
Didi Komara 5 months ago

cool :)
Mario Cavalli 5 months ago

Michael Jackson lives!
eccker 5 months ago

so...is a 2d image, a set of 2d images or a 3d model used for mapping???. On the other hand, I figure out that it is possible to map your face position in a 3d space, isn't it?. Cool stuff by the way.
ed knowles 5 months ago

Hey Matt,

Does this work over Skype? I work for ITN - we'd like to do an interview over the internet. Maybe using some face masks?

Get in contact with me ed.knowles@itn.co.uk or 077886643157

Cheers,
Ed
Parag K Mital 5 months ago

man you are creepy as hell in this video but awesome!
Matthew Gray 5 months ago

What's the projector you are using? And, as a director, I think you are doing justice to each of these characters... Can't wait for the rehearsal when Im going to have to tell an actor they will be 'wrapped' in another actor's face....
Dan Wilcox 5 months ago

That's not projection, it's a live composit.
Matthew Gray 5 months ago

thanks Dan. Guess I'm obviously a 'live theater guy' for asking that question!
Kevin Sweeney 5 months ago

Outstanding work! Some of those were extremely creepy.
Matt Chandler 5 months ago

face transplant preview tech.
vargasz abolcs 5 months ago

mad!
it would be more fun with the body :]
Dries Depoorter 5 months ago

Future!
Og2t 5 months ago

That's absolutely insane! Congratulations!
Duke de Silver 5 months ago

WOW that has huge potential.

Like Medical use, psychological usage, or simple avatar use, I could go on.

Who invented this most crazy of applications?
Colin Duffy 5 months ago

nice work! you guys should add facebook functionality so you can be all your friends :P
Robert Twomey 5 months ago

awesome. uncanny.
DAT DAT DAT 5 months ago

valley.
Jamie Dubs 5 months ago

Hilarious
Rob Wienk 5 months ago

Amazing! Scary though...
xamox 5 months ago

/me bows.
Dan Wilcox 5 months ago

Ah, smiling photos dont work so well.
liamk 5 months ago

A news.yc discussion of this is at news.ycombinator.com/item?id=3022479
Kyle McDonald 5 months ago

i love how intense they are about the open source-ness. arturo will be posting it to github. but i think anyone familiar with some basic computer vision + access to FaceTracker (or even code.google.com/p/aamlib-opencv/) could code this in an evening.
Jeff Handy 5 months ago

I'd like to try the lizard man.
documentingreality.com/forum/attachments/f149/136815d1268184944-lizard-man-lizardman.jpg
Gabriel Shalom 5 months ago

Are these done with photos or volumetric data? If with photos, would they be more realistic and seamless with volumetric data?
Kyle McDonald 5 months ago

this is done with photos, no depth data. depth data helps a lot if it's good -- it's what the pros use :)
Gabriel Shalom 5 months ago

Dude, I can't wait til you go "pro" ;)
Brittany 5 months ago

Kyle, as always, you are amazing and inspiring. Love this! Makes me think of Halloween costumes of the future... :)
Antonio Marcato 5 months ago

At times, completely seamless and incredibly magical. Great job.
Roy Macdonald 5 months ago

Yeah! Superb!
I did something similar some time ago but just with Opencv's haar recognition, but this is by far much better.
Keep on the good work!
DScroggins 5 months ago

Awesome! makes me laugh!
Louise Lynn 5 months ago

What if you superimposed a photo of your own face, then photographed that and superimposed it again... etc!
Kyle McDonald 5 months ago

i am wearing a mask, similar to the one you are wearing now, ... ;)
Antney Oslund 5 months ago

This is terrific!
Rokkas 5 months ago

man, this is INSANE
Utpal Pande 5 months ago

Very interesting work, can't wait to see how this evolves. BTW, you just got featured: vsual.co/2011/09/facetracker-faceoff-online
mpared 5 months ago

shared at thecuriousbrain.com/ :-)
SARA FER 5 months ago

Where can I download or buy this? haha
Mark Stuckert 5 months ago

tvtropes.org/pmwiki/pmwiki.php/Main/NightmareFace
Blake Senftner 5 months ago

I have a complete commercial framework for doing actor replacements en mass, sorta like Jib Jab on Industrial Light & Magic steriods. Check out: vimeo.com/29498409
Stefano Di Lollo 5 months ago

This is simultaneously creepy AND impressive. Great work.
Rio Matthew 4 months ago

That is one freaky Joker when you impersonate Dali. :D
Sebastian Sobótka 4 months ago

great! shared at pixeldokwadratu.pl/
Victor Diaz 4 months ago

supernice! congrats!
Carla Ferrarezi 4 months ago

amazing
Evan You 4 months ago

I laughed so hard at the end... because I'm taking a class with Zach right now
CORDELIMA® Interactive 4 months ago

:) Wow
Rafael Macho 4 months ago

Can someone make this work with Skype video? :P
Friedrich Kirschner 4 months ago

Mostest awesome!
99aqgp 4 months ago

I like how you captured the saggy holes at the edges where we can all reach up and peel our skin off.

but seriously, before you improve this, try it with some characters from Matthew Barney films.
Kyle McDonald 4 months ago

well.. you've successfully creeped me out for today.
99aqgp 4 months ago

ha, just thought the resemblance of some of the artefacts to his makeup was striking.

looked at the scramble suit test, it reminds me of videomoshing in an odd way. I wonder if there's some way that kind of technique could be combined with the transitions. perhaps some of one face being held over until the movement of your head brings it into a place where the colors match up with the next face.
Kyle McDonald 4 months ago

see vimeo.com/5769130
jahirul amin 4 months ago

crazy but awesome stuff...
joshbot ☠ 4 months ago

Prepare to be contacted by the Pentagon.
keith 4 months ago

Wow
Serge Levitski 4 months ago

The new face for Anon
Gene Wildhart 4 months ago

I keep getting the following compile error:

Using makefile: Makefile
compiling object for: src/testApp.cpp
In file included from src/testApp.h:5:0,
from src/testApp.cpp:1:
../../../addons/ofxFaceTracker/src/ofxFaceTracker.h:106:2: error: ‘FACETRACKER’ does not name a type
src/testApp.cpp: In member function ‘void testApp::updatePhysicalMesh()’:

Any Ideas??
Kyle McDonald 4 months ago

this is because it's including the wrong Tracker.h (the one from ofxCv/Tracker.h instead of FaceTracker/Tracker.h). you can try changing the filenames and includes to fix this.
PO-MO Inc. 4 months ago

You just broke our brains. Thank you!
FreeKa Tet 4 months ago

A w e s o m e
vodstrup 3 months ago

What FreeKa Tet said!
Alpha ville 3 months ago

Brilliant!
Brendan 3 months ago

Perhaps you could make a face sharing website, where you can take a scan of your own face, upload it, and try on other people's faces as well.
Kyle McDonald 3 months ago

that's a really poetic idea, i like that a lot :) maybe in the distant future we will be as comfortable sharing our identity as we are sharing various consumable resources.
Portable 3 months ago

Check out this video as featured on Portable.tv!
portable.tv/tech/post/digital-masks/
Wray Bowling 3 months ago

DUDE! I've been slacking off making use of FaceOSC and then you make this?!? Holy.. crap!
Freek Freriks 1 month ago

Hahaha thats sick.

For somehow all the generated faces do look a bit like Michael Jackson. Almost makes me wonder if all his faces are designed on a computer first before surgery.... Or
Michael Jackson probably already had the site Brendan mentioned :D
Erick Patrick 1 month ago

Kudos! I see this being used in the future to decide others… Beware!
mat mox 1 month ago

amazing! wondering if kinect cam could improve the results...
Ke Ma 1 week ago

Very Nice! and I want to know which camera you used for this? any camera is OK?
Daria Adamitskaya 6 days ago

OMG!!!! Hahaha, very creative =D