Virtual Production

Beginning of 2016 there was already a lot of talk about how real-time rendering will be the future.

The future is now, virtual production stepped up it's game since the last few years. Companies across the globe are moving their production into virtual. And like anyone else who is crazy enough to start from nothing and move into virtual production, I myself started collecting my equipment.

The costs of such a venture is pretty high, but as I am a 3D guy that gives me enough time to practise, practise and some more practise.

V(R)Cam

What is Virtual Production?

Virtual Production is litterally the film production going digital. For years the industry had worked to put high-end production visual effects on top of footage.

With the rise of Virtual Production the visual effects are being caught in camera for most of the job. Ofcourse traditional Visual Effects is still needed for seams or unwanted artifacts, but with everyone joining the adventure the technology is challanged and artists find clever ways to make unneccesary work redundant.

To show some examples of how Virtual Production works, here are some GIF's.

Virtual Production Core

LED Wall

Unfortunately I myself am not capable of buying such a large LED wall for my practises, so I will have to do it Indie Style. Nonetheless, I can still plan a techviz for a day of shooting on a real LED Volume.

VP Curved LED

Mastering Fundamentals

I had been waiting to purchase this book from VES, third-edition that contains virtual-production, which i see as the Bible of VFX basically.

VES Handbook

Needed for Virtual Production

Ofcourse Virtual Production begins with a camera and monitors. You also need the right cables for HDMI to connect to your external monitor.

VP Cam Setup

Next thing you should think about is a graphics record card called Deck-Link to be able to have input into Unreal Engine.

Decklink 01 Decklink 02

And to be able to connect it you should have some SDI cables.

SDI Cables

Also useful to have is a bi-directional micro converter. Not really sure when I will know for real if i need this, but the features will definitely help the progress.

Micro Converter 01 Micro Converter 02

At first I thought I would also need a way to have a stable tracker holder, but afterwards I figured I would only need a superclamp.

VR Controller Holder

Storage Expansion

So, there will be a lot of file storage needed for future projects and to be able to work with a lot of assets varying from low to high poly.

A friend of mine still had a let-over NAS that he was happily giving it to me to help me with my growth into Virtual Production.

For all of the textures, shaders, materials and other effects that could make use of librariesor other depending files should have a good space to set it in. So I have bought myself a couple of NAS Hard Drives.

NAS Iron Wolf 8TB x2

The Set

For this Indie way to work you'll need a green screen set up with some lights, just know the more lights you have the better for full control of how your scene will look.

Virtual Production Core

What's next?

Well a lot of companies have taken their position with their own systems. One example is Dutch Rose Media with their volume capture capability.

Dutch Rose Media 01

They can have actors in the middle of their set and the camera's surrounding the set will capture the 3d volume of the characters. Very impressive!

Dutch Rose Media 02

The usage can vary from history, to retail, to e-commerce and even sports.

Dutch Rose Media 03

Inside Unreal Engine

Now that the set up is as good as a Go, I can focus on getting familiar with the software and set up the VCam there.

Inside Unreal Engine 01

Now that there is an environment with multiple LOD levels It is time to set up the VCam

Inside Unreal Engine 02

I have already noticed that Unreal Engine goes really deep in how assets and materials, lighting etc. should work and behave. At the moment I am looking for great classes or courses to dive deep in Unreal Engine's power.

Hoping to achieve great results this year that will make you feel like you are actually there.

(gif is from Matt Workman.)

Indie Virtual Production

Green Screen Treadmill

I knew for a long time that I needed to have a solution for the relatively small space that I have for production at home. So that is why I was seeking for a treadmill to be able to move on the spot without compromising my production space. Luckily a close friend of mine had a treadmill which had a malfunction, a broken plate incurred by running on it A Lot.

Treadmill Product

So when I got the treadmill home again I needed to experience myself and indeed the treadmill was not in the right condition to use safely for production. So I knew for certain I had to fortify the area of threadmill to walk on.

Recycled Test Walk

For this treadmill to work I first had to find out what was the problem that needs to be fixed.

Usually in cases like this one where you deal with a machine that you probably know nothing about, you need to reverse engineer to 1. understand the mechanism and 2. to be able to do maintenance.

Reverse Engineer 01 Reverse Engineer 02

While it was taken apart to it's fundamental mechanisms I decided to test it once more and noticed a hard sounding beep whenever you push the buttons on the user panel and so I went by my parents because my dad has a soldering iron and I simply removed the speaker from the PCB plate. No more beep sound.

Removing Beep Speaker Upgraded Panel

I also noticed how dusty the components were and just cleaned them up before proceeding.

Reverse Engineer 03

The rotor engine itself als had to be taken out for the moment because it also had gathered quite some dust.

Reverse Engineer 04

Now i had stripped it down untill nothing was left and I could finally reach the inner plate that was malfunctoning.

Reverse Engineer 05

Yes. As you can see, something had to be done here. So I went to look for alternatives, but in the end I realised that the bottom plate was one of a kind which was specifically made for the walking surface since it is really smooth and has less to none friction for walking.

Broken MDF Plate

After carefully stripping and laying the parts out it was time to put it back together again after fortifying the bottom plate. I also had to sandpaper the outer surface in order to make the paint stick to it.

Reverse Engineer 06 Reverse Engineer 07 Reverse Engineer 08 Treadmill Put Together

The paint I used was Alaska+ from 'drost' with color code: S 2070-G10Y Matte 1. It had to be as matte as possible which helps later on with keying in post or real-time. Still need to do some experiments with it to figure out how to make it work.

Green Screen Paint

Now comes the fun part, preparing to paint!

Treadmill Painting 01

As mentioned earlier this was the green screen color for the paint.

Paint Color Code

And this is the reference of the result I am hoping to get.

Intended Result

The painting went fairly quick, luckily it was a small surface and the treadmill could just run while I applied the paint to it. And yes, it is really matte! Yes!

Treadmill Painting 02 Treadmill Painting 03

One more layer of paint and it was ready.

Treadmill Painting 04

I am really pleased with the result and also very curious to see it working in production. I hope you enjoyed this process and more is yet to come.

Treadmill End Result

(Example is from Youtube:"DIY Treadmill Green Screen: Tips and Tricks for Building and Painting".)

To Be Continued...