Realtime Cinema Research @realtimecinema - Tumblr Blog

Harry Schreurs and Jilt van Moorst present their real-time cinema research at Unite Europe 2016 in Amsterdam.

The tools made by early pioneers stand to shape the language of VR – but is it a language of film, games, theatre, or something else?

Harry Schreurs and I were interviewed before our talk at Unite Europe last week, turned out into a nice article.

Adding tracking markers to an ipad. To be used as a virtual light controller and/or a simple virtual camera.

UDP Server/Client for mo-cap

Today I implemented a lightweight, multi-threaded UDP sender and receiver to share real-time motion capture data between computers and mobile devices with minimal latency.

OptiTrack Motive streaming real-time into Unity.

#mocap unity

Found a surprise on my desk this morning. Meindert prepared the new 'lightweight' virtual camera rig for testing Lightcraft Previzion in our test studio. See if you can spot the actual (Blackmagic) camera.

So it looks like my hunch was correct. Here you can see the results of our first mocap test with the wide angle lens retrofitted to the 12 OptiTrack cameras. So much better.... Thanks Lukas for the moves!

#optitrack #mo-cap

lens change

Trying out some things after getting disappointing results in the motion capture studio. The problem is likely to be that the space is so small that the cameras are really close together and have very little overlapping view. Today was spent fitting a wider angle lens to our 12 IR cameras and getting them in focus.

Subject Depth in Unity / Lightcraft

Until now, we rendered the camera image on top of the Unity camera view, where the Previzion Lightcraft software has this neat feature where you can change the subject depth (distance to the camera). This allows you to put virtual objects in front of the subject, or put the subject inside a virtual car (image courtesy of Lightcraft)

The same functionality is now implemented in our Unity project by writing a script that changes the scale of a textured quad so that it always fits the screen, at any depth.

Animated Digital Doubles in Unity

On stage at Samsung’s 2014 developer conference last week, Warren Mayoss, Head of Technology Product Development at DreamWorks Animation, spoke about the company’s initial work with virtual reality on the Oculus Rift and Gear VR. Though they’ve produced several real-time VR experiences, the studio’s bread and butter is high-fidelity pre-rendered CGI. But how to bring that… Read the full article …

New motion capture studio finally ready.

This week the new space for our motion capture studio finally is delivered. This semi-permanent setup allows for great flexibility, with chroma key green backdrop + flooring on demand, and space for Previzion fiducial markers in the ceiling. I spent all day yesterday setting up the OptiTrack motion capture camera systems, calibrating with 'exceptional' results.

Today I can finally continue researching the motion capture <> Unity integration. Lacking a 24/7 assistant, I decided to create a 'stickman' out of scaffolding. This assistant shouldn't get tired of the t-pose too soon...

Finally managed to stream realtime motion capture data from our OptiTrack system in to Unity.

#unity optitrack motive nfa research

first prototype of a tool that could be used on a set to manipulate props in the virtual environment as well as the sky. Props can be translated, rotated and scaled in 3 dimensions. Sky is manipulated by time of day and weather controls.

Controller runs on any iOS/Android device.

Like the bastard progeny of experimental theater and video game production, this horror film required a new, complex form of cinematography.

cammadanar

First test of real-time facial capture streaming from Faceshift into Unity3D

Trending Blogs

Recently Viewed Blogs

Realtime Cinema Research