FaceTook: Part 2

Problem: ML Kit face capture works! However, displaying a static photo of a face on the external screen would be boring. Identity and agency are central to the message of Veil, so doing something more to the face than simply displaying it is appealing.

Approach: Use LivePortrait to bring the face to life on the screen. This should add to the horror of seeing one’s own visage unexepectedly AND be a concrete example of how we unwillingly surrender ownership of our identity to digital surfaces.

Challenge: While I do have a Raspberry Pi 5 w/ AI hat that I plan on using for onboard compute, it may still be very slow to animate the face. I’ve prototyped with using my desktop GPU via Tailscale and it was seriously slow. In order for this to be effective, it needs to be near realtime.

short video of liveportrait-ized facial recognition capture

More updates

  • FaceTook: Part 1

    FaceTook: Part 1

    Image: Screenshot of Veil stereoscopic view with realtime facial recognition! Problem: The opportunity to make commentary art out of the vast surveillance apparatus that engulfs us is enormous. The Veil project starts with a cornerstone of the modern surveillance stack…

  • Mixed-Up reality

    Mixed-Up reality

    Problem: Wearer of the veil will have their face obscured by an outward facing screenSolution: Provide an MR-enabled immersive view on a high-refresh/hi-resolution screen Approach: Hi-res/hi-refresh screens are very expensive and may require specialized compute to run at peak performance.…

  • Salvage quest

    Salvage quest

    Summary: The Veil concept is basically an outward facing screen that covers the operators face. In order to see, the operator will have a stereoscopic screen (similar to VR headset) with a feed of the outside world. The initial hope…