The joy of finding faces in things
I'm Wes Lindamood, an interaction designer on the NPR Visuals team. I'll be joining you here on Look At This from time to time to explore design, technology and (I hope) some interesting stories about how we see the world. Today's rabbit hole: Faces in things.
"Ooh - I think I hear the recycling truck!"— @FacesPics
A funny photo showed up in my Twitter feed a few weeks ago, and it was the most delightful thing I saw all day. While I rationally knew that the “face” on the box was nothing more than cutout cardboard, it got me thinking about the simple joy of making a connection between two disparate things, and discovering a visual pun. It also got me thinking about facial recognition algorithms -- and how computers identify faces. Just like us, computers can distinguish a face from a box, and they also make strange and interesting mistakes when identifying faces.
This reminded me of the work of Seoul-based art collective Shinseungback Kimyonghun. They've been experimenting with facial recognition for a while. I've picked three of my favorite projects from their site that deal with facial recognition:
In Cloud Face, they point their cameras to the sky to do some cloud watching. Turns out we’re not the only ones who see faces in the clouds. As they say on their site, the project was designed “to examine the relation between computer vision and human vision.” And I found that the facial recognition algorithm they used identified several convincing cloud faces.
Thanks to Mozilla developer Heather Arthur, facial recognition also exists for cats. Shinseungback Kimyonghun has taken her script and another facial recognition algorithm -- and purposely misused them to find cats that look like humans and humans that look like cats. The project is called "Cat or Human," and after analyzing a selection of human and cat faces sourced via Flickr, their scripts identified ...
that these humans look like cats ...
and that these cats look like humans:
(Photos via Shinseungback Kimyonghun)
While I don't find the results of their project particularly compelling, I am fascinated by these false positives, and the unique perspective of algorithmic vision. Besides, the project led me to KITTYDAR, a drag-and-drop interface that is powered by the same script in the “Cat or Human” project. I tried it out using an image from BENEDICT CATBATCH, which was also not successful, but I plan to continue trying.
Where’s the cat in this photo? (source: http://benedictcatbatch.tumblr.com/)
The last Shinseungback Kimyonghun project I explored was 'FADTCHA'(FAce Detection Turing test to tell Computers and Humans Apart), which is supposed to determine if a computer or human is looking at an image. Unlike a CAPTCHA, which attempts to weed out computers, FADTCHA “requires a user to find a face in an image, which is visible only to computers.” So, for example, in the photo below, while I see one face, the computer has identified two faces outlined by red squares– proving that it is, in fact, a computer.
(Photo via Shinseungback Kimyonghun)
Looking at these experiments is a good reminder of all the devices we have created (computers, cameras, smartphones) that are now looking at the world in their own special way. It’s both charming and disconcerting that the tools we’ve created to identify faces for us are prone to error. We’ll be investigating what this means– for both computers and humans, and would love to know what you've come across. Seen similar art projects? Send us something weird.