[Electronic Rituals Final] Crowdsourced Automatic Drawing
For my final, I’m working with my fellow classmate Aileen to create a system for crowdsourced automatic drawing.
In our case, we will be building a glove that guides a drawer’s hand to move in 4 directions (up, down, left, right) via vibration motors, and a system to allow any other participants to dictate the motion of the drawing via their own devices.
Overall System Diagram
1. Participants can press up, down, left, right on their devices 2. Participants’ direction choices collect on a server 3. Direction choices affect 4 corresponding vibration motors on the glove in real-time 4. The drawer moves the pen according to what they perceive while wearing the glove
Contributions
To divide the work on this project, I’m going to be focusing on the wearable vibrational glove side (I’m combining this final with my final for Intro to Wearables, where the prompt is to make any wearable garment), and Aileen is going to focus on creating the server and participant experience.
This blog post will mostly cover my work on the wearable glove, while Aileen’s blog post will go more in detail about creating the crowdsourced experience.
Building a glove prototype
Because this concept is heavy on the physical computing side, I started this project by prototyping the electronics needed to create a haptic glove that can receive many directional commands over serial communication.
Design decisions
The main design choice I made in this glove was how to specifically translate directional commands into vibration. There are plenty of different routes one could go with this - read each successive command from the group and vibrate each corresponding motor one-by-one in order. Or, read each success command and use that information to update a global state of the glove, which can include multiple vibrations of variable intensities at any given time.
I ended up going with the latter; I think having multiple vibration motors go off and having to use intuition on what *feels* strongest is in the spirit of automatic drawing/writing in the formal sense - i.e., being guided by intuition and whim rather than certainty and lucidity.
More detail on how the glove receives directional commands and translates them into vibration can be found in a separate blog post here.
Some main challenges that I had to work around include:
Coordinating the reaction of the vibration in real-time to the inputs of users
How to account for very large amounts of data being sent to the Arduino
Designing the final form
After some quick prototyping, I realized that a one-piece glove out of fabric wasn’t going to do the trick.
My early “oven mitt” prototype revealed to me that the vibration motors would need to be closer to the skin to feel anything, so I opted to try a version where three tight rings would hold the left, top, and right vibration motors, and the bottom vibration motor would sit around the wrist.
The glove (right now) is made out of white fleece and velcro. I used silicone stranded wire (this is the white stringy mess that’s linking each of the rings to the base of the glove) to connect the system.
Documentation From Class Presentation
This next video is a snippet of the collective drawing experience I had in my Electronic Rituals final presentation on May 8, 2019.
The following images are 3 collaborative drawings done through this process during the presentation.
We set up an overhead camera to livestream the drawing process to the class, and told classmates to go to http://eroft-final.glitch.me/ on their own devices to make their votes.
The image below is a screenshot of the site that classmates can choose their directional commands on, side-by-side with the code used to control the glove via serial on the wearer/drawer side.
Future directions and improvements
From the Electronic Rituals, Oracles, and Fortune Telling side, we got several compelling discussion points for future work in this project. Some of the most memorable ones (according to my increasingly frazzled memory) are:
It would be worth experimenting by doing a blind test and compare receiving random noise direction inputs versus actual human-contributed direction inputs. What would the drawing look in one scenario versus the other? As the wearer of the glove/drawer of the drawing, how much does being in the same room and understanding there are people behind the directions influence my drawing habits?
It would also be worth experimenting with a version where users can see what other users choose. Right now we have this visible only on the drawer’s server, but maybe if participants can see what other participants choose they can collectively make decisions. (i.e. a twitch plays pokemon style experience.
From the Intro to Wearables side, I really would like more time to explore this glove visually. Jingwen (our instructor) gave great suggestions of using gold thread to evoke a ritual/mystical aesthetics. Unfortunately I didn’t have the bandwidth to focus on the aesthetic side of the glove, and instead focused on getting the functional component locked in.
My decision to use white fabric and create different segments of the glove, in retrospect, was slightly influenced by another ITP student’s (Teresa Lamb) Cyberknitics https://thenewstack.io/cyberknitics-translates-knitting-ethereal-electronic-music/ thesis project, which we saw earlier in class. I think her work sets a great precedent on how to aggregate electronics in a linked system, in a way that’s both durable, clean, and aesthetically pleasing.









