Stories through voice, video and virtual reality.
Challenge

RunVR

A hybrid of VR and live performance that explores the relation between human nature and technology.

Challenge

Challenge

The current state of virtual reality is often limited to single user experience. Can we overcome this restraint by juxtaposing VR with the unconventional 120’ by 11’ aspect ratio of IAC Building Ground Floor Lobby’s Video Wall and create a 5 minute immersive experience that is accessible to a large audience within two months?

Goal

Goal

As a team of 4 creatives from NYU Tisch School of the Arts with expertise in emerging technology, video, acting and dance, we all believed that concept comes first. Whatever the outcome, our piece must have a story behind.

I took on the role of art direction with Fanni. Our main responsibility was to produce everything visual, from storyboards and documentation footage to marketing video and final execution.

KL23.jpg
KL22.jpg
KL15.jpg
KL17.jpg
Ideation

Ideation

We brainstormed based on our common interests in digital capitalism and how virtual reality is re-shaping humanity and came up with three stories as our responds to the topics.

Meanwhile, we composed 400 visuals to test out various compositions on screen.


04.jpg
07.jpg
08.jpg
Storyboard I & II

Storyboard I & II

To illustrate how being different in the society can be painful, we set both story I and II in an autocratic society.

A group of performers as workers in VR headsets first performed in simple unison movement in front of the screen. They slowly entered the virtual world through the column one at a time. The last worker, by choice in one scenario and by chance in the other, decided to break the pattern and was then being punished by the omnipresent authority of the system.

storyboard3_3.jpg
storyboard3_6.jpg
storyboard3_7.jpg
Storyboard III

Storyboard III

Story III was lead by only one performer running on a treadmill in a VR headset in front of the screen. The performer's point of view was presented on screen where the audience could see him running through different virtual spaces while competing against copies of himself.

In this version, we addressed how technology is replacing and affecting the physical world by using a nude protagonist as a representation of the dichotomy between body cult, while at the same time neglecting the reality.

storyboardnew_1.jpg
storyboardnew_5.jpg
storyboardnew_7.jpg
storyboardnew_12.jpg
storyboardnew_14.jpg
storyboardnew_16.jpg
Iteration I

Iteration I

After many on-site discussions and testings, we arrived at a conclusion that Story III was the most suitable due to several reasons:

1. Lower risk and budget as it involves only one performer who we have already found a candidate.

2. Single focal point helps guiding audience on where to focus on a wide screen as it could be confusing and overwhelming.

3. Allows the audience to see what the VR player is seeing which reinforce the idea of digital intimacy and social isolation.

We began iterating on Storyboard III we previously made.

Storygraph

Storygraph

We listed all the crucial moments and designed our narrative arch.

01.jpg
02.jpg
04.jpg
05.jpg
06.jpg
08.jpg
9.jpg
10.jpg
11.jpg
13.jpg
14.jpg
15.jpg
Iteration II

Iteration II

Based on the notes we took from on-site testing and the feedback we received from peers, we narrowed down the list of landscapes our performer would be running through and specified his drive to run.

Outreach

Outreach

Our priority then was to find our protagonist who would be leading the performance. I brought Jake, a close friend of mine who I thought would be an ideal candidate, onto the team. With help from LaGuardia Studio, I got a high resolution 3D scan of Jake for production.

Prototype

Using Unreal Engine 4 (UE4), Fanni and I did a mock up of four different spaces for Jake to run through: an open field with a sudden drop, a room of Escheresque stairs, a bridge and a tunnel.

We realized through this prototype that in order to reinforce our intention behind the piece, there needs to be a common thread that ties the four spaces together.

After many group discussions, we decided to set our world in a shopping mall that contains the same movements of going down, up and forward (from the parking lot to the inside of the mall).


Motion Capture

Motion Capture

As a team, we listed the movements we wanted Jake’s avatars to perform. Fanni and I captured Jake’s data at NYU Tandon’s motion capture studio. We then divided production based on our expertise. Esther and Manuela worked with Jake on choreography and dramaturgy while Fanni and I developed everything on screen with UE4.

IMG_7351.jpg
IMG_7496.jpg
Animation

Animation

Using Maya, I rigged Jake’s 3D model to give it a skeletal structure. Cleaned the data we captured with MotionBuilder and applied them onto the model.

trainer04.JPG
trainer03.JPG
trainer20.JPG
trainer16.JPG
trainer10.jpg
trainer12.JPG
trainer13.JPG
Production

Production

Through multiple on-site testing, rehearsals, critiques and iterations, we concluded production in three months.

iac2.jpg
1D6A9757.JPG
1D6A9819.JPG
iac1.jpg
Execution

Execution

We performed RunVR to 200+ audience of all ages at the IAC Building on November 30, 2018 as part of the ITP Big Screens Show.

iac7.jpg

Show recap

1 minute highlights from the show.

Reflection

Reflection

Our piece was well received as we not only effectively bridge the visuals on screen with a live performance off screen but also successfully delivered the stories we wanted to tell.

Moving forward, we hope to attend festivals and conferences to showcase RunVR to carry on the discourses around body and belonging, digital intimacy and identity, fitness and beauty trends.

Credits

Credits

Animation & VFX: Kimberly Lin & Fanni Fazakas

Dramaturgy: Manuela Romero

Movement: Esther Manon Siddiquie

Performance: Jacob Robert

Sound Design: Rumex

Special Thanks: Todd Bryant, Taylor L Absher, Matt Romein, Jonathan Turner, Mimi Yin and Daniel Benyi.

Screen Shot 2019-07-18 at 5.49.15 PM.png
Screen Shot 2019-07-18 at 6.03.07 PM.png
Screen Shot 2019-07-18 at 10.17.34 PM.png
Next Step

Next Step

We will be presenting RunVR at IFP Media Center in Dumbo, Brooklyn from August 1-31, 2019 as part of the Expanded Cinema, Vol. 4 show. Using IFP’s co-working space with Light Harvest Studio’s 130’ x 11’ panoramic wall and 27’ x 3’ LCD panels, we will re-envision RunVR as a video installation in two different scales. Catch us at the opening reception on August 1, 6-8pm!