00:00
101
More
See all Show me
6. Faces
5 months ago
5. shift
1 year ago
2. Einaudi
3 years ago
This is a technical demo for face substitution technique. The application works in real time and it's developed using the opensource framework for creative coding openFrameworks: openFrameworks.cc

Most of the "magic" happens thanks to Jason Saragih's c++ library for face tracking web.mac.com/jsaragih/FaceTracker/FaceTracker.html. The face tracking library returns a mesh that matches the contour of the eyes, nose, mouth and other facial features.

That way the mesh obtained from a photo is matched to my own face in the video. Applying some color interpolation algorithms from Kevin Atkinson's image clone code: methodart.blogspot.com/ gives it the blending effect that can be seen in the final footage.

I'm also using Kyle McDonald's ofxFaceTracker addon for openframeworks github.com/kylemcdonald/ofxFaceTracker which wraps Jason's library for easier use.

Kyle has uploaded another video giving a try at a different blending algorithm, which get rids of the artifacts and an even creepier look: vimeo.com/29348533

Credits

Likes

  • k.o.d.3000 plus 5 months ago
    awesome..great work! have you tried it with cartoon faces?
  • arturo castro 5 months ago
    not yet, well actually i've tried but a cartoon face is not detected by the facetracker i would need to map the face manually
  • Kyle McDonald plus 5 months ago
    you would be surprised what faces work, though -- check out this video jason made puppeteering some more cartoony faces vimeo.com/26193010
  •  
  • David Dalmazzo plus 5 months ago
    hahahahaa!
  •  
  • Pablo Marques 5 months ago
    This is amazing.
  •  
  • manny tan plus 5 months ago
    good lord this is good
  •  
  • Kevin Atkinson 5 months ago
    Beautiful! Wonderfully freakish.
  •  
  • zach lieberman plus 5 months ago
    lovely !!
  •  
  • Vormplus plus 5 months ago
    Love it. Would be useful for chatroulette.
  •  
  • Jason Levine 5 months ago
    wild! make's me think of cirque du soleil makeup
  •  
  • mst1228 5 months ago
    Amazing.
  •  
  • Theo Watson plus 5 months ago
    haha - amazing. you're a better looking me.
    :)
  •  
  • Kevin Atkinson 5 months ago
    I imagine you could grab a face from another camera, and hence steal someone else's face in real time.
  • arturo castro 5 months ago
    yeah totally, that's actually one of the ideas i've been thinking on doing with this. thanks for the image cloning code btw. your example for that was actually what gave me the idea to try this
  • Kevin Atkinson 5 months ago
    Cool! Looking forward to further awesome freakiness....
  • jonbro 5 months ago
    that + a head mounted projector would be off the hook. projecting other peoples face on your face.
  •  
  • onurson 5 months ago
    epic.
  •  
  • Evelyn Eastmond 5 months ago
    This is just great
  •  
  • Joe Attanasio plus 5 months ago
    Cool
  •  
  • DScroggins 5 months ago
    HAHA. cool!
  •  
  • Jordan McGarry staff 5 months ago
    oh my god. amazing.
  •  
  • Eric Tsutomu 5 months ago
    LOL omg.
  •  
  • Richard Byers 5 months ago
    facehijacking!!! so good!!
  •  
  • Servando Barreiro 5 months ago
    muuuuy bueno tio!!
  •  
  • Jonathan Eger 5 months ago
    Can we please post your video on our website?
  • arturo castro 5 months ago
    yes, no problem
  • Jonathan Eger 5 months ago
    Thank You.
    Here is the permanent link: photoweeklyonline.com/real-time-face-substitution/
  •  
  • Ferg Brennan 5 months ago
    coooool
  •  
  • Pouff 5 months ago
    Creepy fun!
  •  
  • Dawud Ali 5 months ago
    that's some cool and scary stuff
  •  
  • Amaryllis Miranda 5 months ago
    Please tell me I'm not the only one who instantly thought "A Scanner Darkly" while watching this...
  • Suskis 5 months ago
    no, you're not
  •  
  • lukasz plus 5 months ago
    its like chainsaw massacre, but fun! :)
  •  
  • Kari Altmann plus 5 months ago
    This is SO EXCITING
  •  
  • cameron o 5 months ago
    this scares me.. well done sir
  •  
  • Brendan 5 months ago
    Oh god, uncanny valley oh my!

    (ie. awesome work mate)
  •  
  • Kyle McDonald plus 5 months ago
    glad to see this in public finally :)

    also i want to say that your selection of test images is perfect.
  •  
  • TrackHustle.com 5 months ago
    Amazing! I remember doing this on video games but I never thought about using the function in this way.

    TrackHustle.com
  •  
  • Chris O'Shea plus 5 months ago
    Great work Arturo
  •  
  • Kim Jerbo 5 months ago
    do the joker!
  •  
  • mpared plus 5 months ago
    wow!! Amazing its up at thecuriousbrain.com/ well done
  •  
  • Redsan 5 months ago
    Wow!!!!!
  •  
  • Andre Assalino 5 months ago
    We want the codeee :)
  •  
  • sanook 5 months ago
    Nice ... could look more "perfect", but I also like the glitches somehow!
    Anyway: Put this into a blackbox where only one person at a time can stick his/her head in, the person then sees the modded image like a mirror. Also: pipe a capture of the persons original face + the mod on external monitors and make it an installation. QUICK! IT'S "WUNST"!
  •  
  • visiophone 5 months ago
    great !!!
    the first one is creeply perfect. event the hair matches!!
  •  
  • zafer üstüner 5 months ago
    cool.

    looks like there is an issue with normals but that can be easily eliminated . disregard this if those were intentional.
  •  
  • OliShaw 5 months ago
    Fantastic, so many possibilities for this - look forward to seeing the real time face swap version :)
  •  
  • Parag K Mital 5 months ago
    nicely done!
  •  
  • jeremy Hulette 5 months ago
    So intensely good!! Freaky in a wonderful way.
  •  
  • Ashley James Brown 5 months ago
    totally awesome
  •  
  • bilderbuchi 5 months ago
    ha, that's awesome. you're a creepy bastard, arturo :D
  •  
  • pyramus plus 5 months ago
    Kyle, Arturo, great work guys!
  •  
  • Jimmy Gunawan 5 months ago
    Scanner Darkly wow.
  •  
  • Dr. Woohoo! 5 months ago
    Arturo, you're amazing!
  •  
  • Tecné Collective 5 months ago
    Arturo you made my day!
  •  
  • animatieblog 5 months ago
    Wow, that's creepy! I imagine the next James Bond will be using this to infiltrate an enemy base. :)
  •  
  • The Film Artist plus 5 months ago
    Technology! :)
  •  
  • Matt Parker 5 months ago
    Amazing job, guys! I'm sure you thought of this already, so when are you combining this with Zach's face projection stuff?
  •  
  • Jack Jack 5 months ago
    Amazing
  •  
  • chosen 5 months ago
    you forgot hitler
  •  
  • halfadeer pro 5 months ago
    holy moly
  •  
  • Jaime 5 months ago
    Wow. Scanner darkly!
  •  
  • Ben Malouf 5 months ago
    Bravo!
  •  
  • Fabienne 5 months ago
    Love it! It`s a good idea.
  •  
  • Designcollector ※ plus 5 months ago
    mesmerizing but really scary
  •  
  • juancarlossuper 5 months ago
    o yeaaaaa
  •  
  • Julian Oliver plus 5 months ago
    Good on you Arturo, so glad you finally went live with this. Was itching to tell people!
  •  
  • Lia 5 months ago
    great great great great great !!!
  •  
  • Allyn Bencen 5 months ago
    Awesome. Future tech.
  •  
  • Christian Losert 5 months ago
    oh my gosh..!
  •  
  • proconpictures 5 months ago
    Another huge step for the benefit of the porn industry!!
  •  
  • Chris Rojas 5 months ago
    scary but in a good way.
  •  
  • Storybox plus 5 months ago
    Fantastic.
  •  
  • Andy Sapp plus 5 months ago
    Looks like characters from Goldeneye... but in real life!

    Click this link, and then watch this video!
    youtube.com/watch?v=OB4DDtIKrAw

    Awesome!!!
  •  
  • Golan Levin 5 months ago
    CONGRATS arturo! Lovely work! also -- See FaceFlip, this ChatRoulette hack by my student Max -- vimeo.com/10191761
  • arturo castro 5 months ago
    yes, didn't knew it till some days ago kyle posted it in the OF forum, really great idea
  •  
  • Ronen V plus 5 months ago
    Absolutely fantastic
  •  
  • John Slaughter 5 months ago
    wow!
  •  
  • felixturner 5 months ago
    You just built the future.
  •  
  • All Things Considered plus 5 months ago
    amazing. I actually quite like the artifacts in this version.
  •  
  • Ryan Corboy 5 months ago
    Great
  •  
  • Kate Monahan 5 months ago
    fantastic! (and utterly eerie...)
  •  
  • StefanoBlack▒ 5 months ago
    this is amazing. i want to make an ultra-lo-fi music video with this for my band asap. help us!
  •  
  • Hideki Yamada 5 months ago
    wow!
  •  
  • Hana Ofangel 5 months ago
    WOW ! freacky but WOW !
  •  
  • Simon O'Flaherty 5 months ago
    This kicks everytype of ass it reminds me of minority report without the need for prostetics. Pure brilliance
  •  
  • robert brown 5 months ago
    so ugly lol.
  •  
  • Antoine Guédès 5 months ago
    It's a bit freaky, btw.
  •  
  • Friedrich Kirschner plus 5 months ago
    wow! I also want to second the good selection of pretend-o-faces!
  •  
  • cvstodia 5 months ago
    Quiero esa aplicación para facetime o skypecebook
  •  
  • Quay Quinn-Settel plus 5 months ago
    oh my god
  •  
  • Jomain Betty 5 months ago
    Excellent ! -)
  •  
  • rvlt™ 5 months ago
    Powerfull stuff, shared@blog.rvlt.tv
  •  
  • eloi maduell 5 months ago
    jodeeeer ... que flipe ...
    divertidissimo ... what a nice toy !
    congratulations mr.castro ;)
  •  
  • Dimitris Kapakoulakis 5 months ago
    Makes me think of the Scramble Suit in the adaptation o "A Scanner Darkly": youtube.com/watch?v=5fac6aHFa_k&feature=related
  • Kyle McDonald plus 5 months ago
  •  
  • Santi Vilanova 5 months ago
    flipa!
    molt guapo arturo
  •  
  • Steven Lauren 5 months ago
    I'm not quite sure why someone with a face as beautiful as yours would even want or need to create something like this?!? hahaha Now for someone as ugly as ME I can understand! :-P
  •  
  • preemiememe 5 months ago
    omg i love that,,, i can use a voice changer and this and be anyone i want,,,,, i can be a chimp,,,, or gary dell abate ,,!!
  •  
  • Burak Özdelice 5 months ago
    1001face, nice to meet you.
  •  
Showing 100 of 116 comments. Want to see the rest?
This conversation is missing your voice. Take five seconds to join Vimeo or log in.

Advertisement

Statistics

Date Plays Comments
Totals 943K 2,491 116
Mar 7th 67 0 0
Mar 6th 184 0 0
Mar 5th 215 1 0
Mar 4th 194 2 0
Mar 3rd 176 0 0
Mar 2nd 186 2 0
Mar 1st 238 0 0