• FaceTook: Part 2

    Problem: ML Kit face capture works! However, displaying a static photo of a face on the external screen would be boring. Identity and agency are central to the message of Veil, so doing something more to the face than simply displaying it is appealing.

    Approach: Use LivePortrait to bring the face to life on the screen. This should add to the horror of seeing one’s own visage unexepectedly AND be a concrete example of how we unwillingly surrender ownership of our identity to digital surfaces.

    Challenge: While I do have a Raspberry Pi 5 w/ AI hat that I plan on using for onboard compute, it may still be very slow to animate the face. I’ve prototyped with using my desktop GPU via Tailscale and it was seriously slow. In order for this to be effective, it needs to be near realtime.

    short video of liveportrait-ized facial recognition capture
  • FaceTook: Part 1

    FaceTook: Part 1

    Image: Screenshot of Veil stereoscopic view with realtime facial recognition!

    Problem: The opportunity to make commentary art out of the vast surveillance apparatus that engulfs us is enormous. The Veil project starts with a cornerstone of the modern surveillance stack — facial recognition — and sticks it in, well, your face.

    Approach: Have you ever picked up your phone to take a picture and it is in selfie mode? The horror and awkwardness of seeing your own face staring back at you. Now imagine if this thing was projected on someone elses body… without your approval! Since I am using the Pixel 7 Pro (in the interim) as an MR display, I’ve got a powerful Android 14 compute device. It has built-in facial recognition support via ML Kit so its another good choice for prototyping.

    Challenge: Just as above, this is all Google stuff on a highly-trackable mobile device. Ideally, I can get off this platform before completing this project!

    Commentary: Early experiments with ML Kit are VERY positive. It’s fast, accurate and tunable.

  • Mixed-Up reality

    Mixed-Up reality

    Problem: Wearer of the veil will have their face obscured by an outward facing screen
    Solution: Provide an MR-enabled immersive view on a high-refresh/hi-resolution screen


    Approach: Hi-res/hi-refresh screens are very expensive and may require specialized compute to run at peak performance. Turns out that I have an integrated high-quality screen/compute in my… pocket! Many low cost VR systems use a smartphone as CPU/Display, so why not for Veil?


    Challenge: Significantly increases bulk on the front of the Veil (bad). Also its a mobile phone from Google which violates many of the precepts of the project (surviellance capitalism, platform, state surveillance tool, highly trackable).


    Commentary: The Pixel 7 Pro is a good compromise for prototyping (Android has great development experience) but looking to switch to a screen-only hardware solution for launch. Pixel 7 Pro does have other advantages as well as it could provide most of the compute (except external display image) for the entire project as well.

  • Salvage quest

    Salvage quest

    Summary: The Veil concept is basically an outward facing screen that covers the operators face. In order to see, the operator will have a stereoscopic screen (similar to VR headset) with a feed of the outside world. The initial hope was reusing the screen and optics from an existing used VR headset for this function to cut down on cost and complexity.

    Problem: How to build a mixed reality platform on the cheap.


    Solution: Scavenge parts from a Meta Quest 2 headset (lenses and view screen)

    Approach: Used Quest 2 headsets have crashed in value. Widely available for $30 – $40 on ebay in used/acceptable condition.

    Challenge: After disassembly, discovered that Quest 2 screen has proprietary connector. The only resuable parts are the mechanical view port and Fresnel lenses.

    Commentary: Quest 2 is just eWaste if you don’t want to run Zuckerberg’s spyware!

  • Concept: Superhero

    Concept: Superhero

    The concept of a series of gadgets that provide countermeasures to surveillance capitalism got me thinking about superheros. If someone were to adopt all of the devices that I’ve been imagining, they would look like a costumed crusader.

    It kind of makes sense to imagine the centerpiece of my project would be a NEW superhero (COUNTERMEASURE). In addition to the tech-laden gear, they would have a sidekick (robot dog), a car (electric w/ lots of onboard compute), supervillain enemies (Zuckerberg, Bezos, etc) and a mission: to free the masses from tech platform neofeudal capitalism!

    After running this idea by a few folks, I realized that the idea of a superhero, besides being pretty passé, didn’t do justice (groan) to the seriousness of my concept. Also, superheroes tend to be loners. They right the wrongs and ride off into the sunset.

    The battle against surveillance capitalism can’t be won and it can’t be fought with a single person. While the devices that I ultimately produce may not be totally practical, the plans and concepts will be far more real than any imaginary comic book character!
  • Contexts

    The theme of Counter Measures can be expressed in an endless number of concepts. Rubrics and matrices are helpful in generating and organizing conceptualization. With The Ills cataloged, how do I come up with the actual objects for addressing them?

    I spent some time yesterday looking at artists in the technology/maker/hacking space and realized that the context of the object is a great place to start for inspiration:

    • Wearable
    • Installation
    • Environmental
    • Display
    • Vehicle/self-propelled
    • Functional/handheld/interactive
    • Virtual
    • Physical
    • Hybrid (ie screen + physical object)

    These categories or contexts are not mutually exclusive — in fact mixing and matching is where the fun begins!

  • Drifting to Where Exactly?

    Venturebeat.com - Stop drifting through AI transformation

    Interesting article about confronting the AI devolution with a handful of principles:

    • Dignity
    • pluralism
    • Transparency
    • Agency
    • Design

    Like other tech-utopianists, the author (Gary Grossman) fails to address the shareholder-obsessed, monopolistic, enshitified, platformic, regulationless, late-phase feudalistic capitalism that dominates American government.

    When we reach that (neo-medieval?) destination that AI adoption is drifting us towards, Grossman’s article will serve as yet-another I-told-ya-so artifact of our collective naivete and dread while on the The Drift.

  • Problem DEFINITION

    The best solution for a problem is found in the definition of the problem. I spent some time over the last few days mapping out the societal ills that have been exacerbated (created?) by big technology.

    Surveillance Capitalism

    Issues

    • Data collection for profit
    • Social inequality amplification
    • Privacy erosion

    Solutions

    • GDPR-style regulation
    • Data portability
    • Algorithm transparency

    Inequality + Exploitation

    Issues

    • Gig economy exploitation
    • Wealth concentration
    • Social inequality

    Solutions

    • Worker unionization
    • Universal Basic Income
    • Antitrust enforcement

    Privacy + Autonomy Loss

    Issues

    • Unwanted surveillance
    • Data analysis intrusion
    • Institutional distrust

    Solutions

    • Stronger data protection
    • Privacy-by-design
    • Biometric consent

    Manipulation + Disinformation

    Issues

    • Social media disinformation
    • Election manipulation
    • Civic disengagement

    Solutions

    • Media literacy programs
    • Algorithm accountability
    • Disinformation regulation

    Surveillance + Control

    Issues

    • Government surveillance
    • Corporate data collection
    • Civic trust erosion

    Solutions

    • Surveillance reform
    • Data minimization
    • Independent oversight

    Violence, Hate, + Bullying

    Issues

    • Hate speech and harassment
    • Violence and extremist ideologies
    • Cyberbullying and real-world harm

    Solutions

    • Content moderation policies
    • Algorithmic accountability
    • Online safety protocols

    Environmental Impact

    Issues

    • E-waste management problems
    • Data center energy consumption
    • Rare earth mineral mining

    Solutions

    • Sustainable practices
    • Environmental regulations
    • Green technology R&D

    Mental Health

    Issues

    • Social comparison and low self-esteem
    • Stress from constant connectivity
    • Decreased attention span

    Solutions

    • Digital wellness initiatives
    • Mental health resources
    • Research and awareness

    Economic Inequality

    Issues

    • Widening wealth gap
    • Job displacement from AI
    • Decreased economic mobility

    Solutions

    • Digital literacy programs
    • Job retraining programs
    • Fair labor regulations

    National Security

    Issues

    • Data breaches and cyber attacks
    • Espionage and IP theft
    • Social media manipulation

    Solutions

    • Robust cybersecurity
    • National security regulations
    • International cooperation

    This list provides a foundation for my concept explorations (coming soon).

  • _first

    _first

    For the last few years, I have been enrolled in the Digital Design & Fabrication (DDF) Graduate program at SUNY New Paltz. This site serves as an archive of my work in the program (and some other stuff I’ve worked on) and, more importantly, a living diary of my thesis project:

    Countermeasures

    Countermeasures aims to address the societal ills brought on by technology in the 21st century using physical objects. I’ll be chronicling my ideas, struggles, triumphs, techniques and whatever else comes into my mind on the pages of this website.

    Thank you for coming along for the ride!