P1: Conceptual Design, aka thoughts before I stammer my way through a presentation
We have transitioned from being a gesture-based one-way communication system to a gesture-based visual-manipulation system. We made this transition based on our timeframe; since we want to submit to the TEI conference, we have even less time to work on it, and also our primary idea required hacking two devices (ideally).
As a result, I’d like to present to you: Puppet Maestro! We hope the final implementation would take in sound input which would produce a visual output (think Windows Media Player around the Windows XP era) and the visual output would be controlled through gestures. However, our primary implementation would have only gestures manipulate a visual image with no sound input.
Below is a walk-through of our initial design decisions with the final/ideal implementation.
This screen is a welcome screen - we wanted to make it clear that this was the start of an application, and make it an easy way to have the user be ready to use the application. We had a very minimalist idea to not overload the user.
This is a specific scenario where the sound input is high and the user’s hands are raised, which is reflected by the large outer circle output. We decided to put a middle dot to have a point of reference of the outer circle’s change in size, and a circle object so it is easy to manipulate.
Similar to the last scenario, this is with low volume, the hand gestures are low and the circle is a smaller size.
This scenario is where the circle flashes due to the music/sound input tempo.
The last scenario is based on the music key and the colour of the circle changes based upon whether the music/sound input is major or minor.
We hope to expand this sole visual screen (presumedly a computer monitor) to be a collection of several monitors and it becomes a large performative piece, similar to an IMAX theatre experience.