Du geste capté au geste d’interactivité numérique

[atelierlaboratoire]

[atelierlaboratoire]

3 different states: IA to the 3d environment so that it corresponds to the movement of the virtual character (on process for a real character). 

1. the character walks/moves

2.the character is on the ground

3. the character's hand is over his head

[atelierlaboratoire]

Playing With My Head

scanned face in blender (to be attached in a 3d model)

[atelierlaboratoire]

Here we are testing for the first time in our Unity test scene the Optitrack modul : the actor controls directly the virtual avatar, which moves will influence both the visual effects and the sound in real-time!

[atelierlaboratoire]

Head scan process. The resulting scan will be used to produce a realistic virtual avatar.

[atelierlaboratoire]

Diagram representing the coding architecture regarding movement - from its acquisition to its anlysis.

[atelierlaboratoire]

Getting the position of the camera (of the z axis) in SuperCollider 

[atelierlaboratoire]

Brainstorming

                                            General:

Trigger a point (object) which will make the ceiling fall apart (ceiling made of physics movement)

Trigger a point (object) which will start to grow 

The voice of the performer will change the light of the virtual environment    

As the performer walks around the structured cloths which interact  and “make space” for the figure to pass

The performer is trying to reach elements that are visible to the other corner of the virtual scene. When the performer reach them the elements fade out and are shown to the opposite corner. Then again

Plants are growing if the performer is moving 

As the performer is getting up (from the floor) a volcano sound is heard according to his movement  

procedural environment

procedural distortion of scanned environments 

actors clones / mirrors

multi-camera / shoulder rig to record the event

cloths/chains/ropes/props attached to the avatars

voice recognition / speech synthesis (chatterbot?)

Nora:

interaction with shadows

combination of the opposites: sound; the actor (or some object) starts moving; the sound stops; a light is turned on; the actor or the object stops moving...

the stage is black and white; the virtual actor or object has his/her/its natural colors.

hand-made pencil drafts that become real living full-color objects.

time is visualized through the change from summer to autumn etc; time flow is influenced by the change of the actor's pace   

the border: space is divided by three polar axes into eight different areas, eight worlds; these are visualized by the changes the person or the object is subjected to,  that crosses the intangible borders between them

in-between spaces; no-man's land.

a child's play with toy-bricks, resulting into palaces; they become real constructs, steps climbed by  avatars   

                                     AI:

Breath / Stamina

Fast response

possibility of non physically possible moves/transitions

Impredactibility - disturb the perofrmers

[atelierlaboratoire]

Du geste capté au geste d’interactivité numérique 2013

This Laboratory aims to use technology motion capture and augmented reality, in order to achieve an artistic performance based on real interaction actor

http://idefi-creatic.net/fr/atelier-laboratoire-du-geste-capte-au-geste-dinteractivite-numerique/

This blog is referring to the progress of the laboratory. Participants can communicate through notes, images, sounds, links and whatever they consider useful.