Virtual Production 101 Masterclass

Name: Virtual Production 101 Masterclass
Rating: 3.2 (62 reviews)

Get started and learn to use VP today. Unreal Engine 4, Blender, mocap, VR use cases for virtual productions!

Created byMepi.pl Video Tutorials

Last updated 12/2024

English

English [Auto],

What you'll learn

How to set up a virtual production work workflows
What hardware to use and why
Shoot your first VP scene!
Learn more about this exciting new industry
Use Unreal Engine to setup realtime Virtual Production enviroments
Use Blender and smartphone app to track cameras
Motion tracking tricks and tips bonuses!
How does virtual production work
How much does virtual production cost
How to get into virtual production

Course content

7 sections • 32 lectures • 6h 44m total length

Who is this course for?2:30
Explore virtual production with Unreal Engine, catering to beginners and seasoned users alike, and learn to link Blender with Unreal Engine using the pipeline plug-in for faster asset transfer.

Unreal Engine What is up3:52
Explore virtual production workflows with Unreal Engine 5 and 4.27, balancing real-time and pre-rendered scenes, lighting, and real-time ray tracing with RTX in a fast, evolving interface.
Intro to VP20:59
Discover virtual production essentials, from the VP supervisor role and technical artist collaboration to mocap, pre-visualization, and real-time workflows using iPhone, laser projectors, and Unreal Engine.
Switchboard25:36
Master virtual production using switchboard in Unreal Engine, a web interface to remotely control lights, cameras, and set pieces for pre-viz scenes.
Aximmetry Versions3:56
Explore Aximmetry versions, including studio, dual, and single editions, their Unreal Engine integration and licensing, watermark considerations, and starting with the free version before purchasing.
VR Mode5:03
In virtual production mode, use an Oculus headset to scout your set in immersive vr, compare spatial distances to a flat monitor, and place and edit objects with motion controllers.
Aximmetry Start14:28
Start an Unreal Engine scene for virtual production with a simple camera workflow. Use space bar, shift, and alt for quick object manipulation and virtual camera setup.
Aximmetry Configuration14:22
Configure aximmetry for virtual production, setting screen layouts, signals, and camera inputs, including 25 frames 1080p. Integrate iPhone, MIDI devices, Bridge, and OSC using node-based visuals.
Aximmetry Keying15:25
Master keying in Aximmetry for virtual production by building a scene with masks, camera positioning, and green screen workflows; adjust mattes, shadows, and billboards using iPhone inputs and Unreal integration.
Aximmetry Cameras20:41
Explore Aximmetry cameras for virtual production, examining camera setups, compositing workflows, and cinematic texture and control concepts.
Virtual Production Tips29:12
Explore practical virtual production tips using Unreal Engine, covering virtual cameras, green screen workflows, import inventory, rendering techniques, motion blur, and billboards to achieve a cinematic look.
Recoding Final Effect27:37
Explore how recoding final effect in virtual production integrates camera tech, Blackmagic equipment, and real-time recording workflows, balancing latency, signal quality, and creative impact for producing compelling final shots.

See Demoreel example based on workflow2:20
Big Update to course Unreal Engine 4.27 preview 2 and Unreal Engine 5 + Blender 2.93 LTS. Camera track anywhere with LiDar tracking and with markeless full body mocap with the help of AI to stream metahuman capture with two iPhones! New Video each week stay tuned!
How to 3D track camera using just a smartphone6:29
Turn your iPhone into a professional motion tracker to create convincing mixed reality with a green screen, three points of reference, and ARKit-based tracking.
The "Art" of Green screen (Download source files for Blender here)2:05
Here you can download the whole (file is 1.3 GB) project with source files used in the next videos:
Virtualproduction101 Panasonic BGH1 source video and project After Effects 2020.zip (1.3 GB)
https://drive.google.com/file/d/18gNzFCj6elMZxR3U0QQtWNHz2QrM5nHM/view?usp=sharing
This is a great option for students who do not have a high end camera or iPhone at home so they can practice just using the downloaded sample files.
If you would like to also have the Blender scene with the camera tracker already imported you can grab
Virtualproduction101_Camera_tracked_Sample_Blender291.zip
(File Attached to this lesson)
More source files (UE4 sample file next up!) you can use this to kickstart your project. Should be our as soon as I make sure everything is ready to publish and I will update this page with one more link to Unreal Engine content.
Importing Tracked Footage to Blender 2.9111:23
Learn to import tracked footage into Blender 2.91, set up a low-poly scene with lighting, render image sequences, and composite in post to achieve a mixed reality virtual production look.
What to look for in cameras for Virtual Production5:10
discover budget-friendly cameras for virtual production, like the Panasonic BGH1 with SDI and Ethernet power over Ethernet, enabling genlock with Unreal Engine for low-latency mixed reality.
My example camera rig with iPhone camera tracker2:55
Combine footage from our camera with camera-tracker data to improve green-screen quality. Use a double rig with an iPhone for tracking and an Android monitor, plus three-point lighting.

How to set up TouchOSC to work with Unreal12:43
Set up touchOSC to control Unreal Engine from your phone, syncing layouts and mapping faders, XY controls, and triggers via OSC with blueprint updates.
What can you do with TouchOSC and Unreal17:38
Connect TouchOSC controls to Unreal Engine blueprints to trigger fire, explosions, and sparks. Organize variables and event names, save and compile, and wire the OSCE receiver for real-time effects.
Use a iPhone as Virtual monitor Vive Tracker camera in LiveLink in UE4.262:19
I'm using here UnRemote app for previewing the Virtual Camera in Unreal 4 26. I used steam VR and in Unreal LiveLink and OpenXR plugin.
Using the VR Toolset9:37
Explore the VR toolset for virtual production, moving, rotating, and scaling objects with a gizmo, enabling real-time set edits from any perspective.
Change weather, light, trigger remote events in VR and TouchOSC11:15
Design virtual production sets in real time by changing weather and lighting, and triggering remote events with VR and TouchOSC, using Unreal Engine assets for fast, interactive set design.

Metahumans (coming soon!)0:38
Learn how metahumans are rigged and ready to animate using facial expressions to drive a character in real time, with a companion video tutorial releasing soon.
How to setup retarget animations from Mannequin to Metahuman17:27
Retarget Animations (from different skeletons) with Retarget Manager in Unreal Engine 4 mannequin
Character Motion in Blender and Rokoko Studio step by step3:08
Master retargeting motion capture data in blender with the Rococo Studio Life plugin to drive custom character animations from mocap captured with an Oculus headset and Máximo dot com characters.
Find Motion Capture data3:35
Find how to locate and import motion capture data in the PVH format, then animate in Blender using Oculus Quest hand tracking and export to Unreal Engine or BBH.
FBX animations or just record your own motion in VR3:41
Generate a character from the Myxoma website, import the SBX with automatic bone orientation, align and scale the rig, and prepare to transfer motion to another character.
Transfer motion capture Rokoko Studio plugin3:40
Apply motion capture with the Rokoko Studio plugin to retarget animation from a source to a target, saving time and enabling real-time previews and fast wireframe testing.
Making the camera smooth1:21
Animate the top portion of a character using three points, smoothing keyframes with the Rococo Studio Life plugin to create smoother, powerful motion. Log in to access the tools.

Requirements

Basic computer knowledge and OS
Basic terminology for hardware inputs ect.
Unreal engine 4.25, 4.26+
Blender 2.83, 2.91
Ready for Unreal 4.27 Aximmetry is also updated to 4.27 and it enables us a lot of opportunities!

Description

In this course, we intend to give you a solid set of techniques and tools to begin your jorney in this exciting frontier called Virtual Production. The tutorial series uses a practical, hands-on approach to teach you how to build VP projects and applications using the Unreal Engine. Each chapter walks you step-by-step through the process of building the essential building blocks of a VP you can use in your own studio application. We pair these steps with in-depth explanations of what's really going on when you follow them and why things are done the way they are. It's this why that matters.

Understanding how the underlying systems and ideas work is crucial to the work you'll do on your own after you've finished these tutorials, and, in this class, we've tried to give you both—an understanding of what to do to build a VP application, and the background you'll need in order to use this course as a springboard for your own wor.You should come away from this course with a solid understanding of how VP workflows are built, and what specifically you need to know and understand about the Unreal Engine 4.25, 2.46+ and Blender 2.83+ to set this all up!

Most of the software used in this course is free to use even for commercial projects to use so you can get started right away. It's our hope that the work we do together here will set you up to take your exploration into this new frontier wherever you want to go.Who this course is for If you're interested in creating Virtual Production setups, VR games or applications, interested in seeing how VR makes VP work eaiser this content is for you.

If you are just interested in exploring VR and seeing what it can do for VP, this course also for you. You don't have to be an experienced engineer or even deeply experienced with Unreal Engine to benefit or get started with this course; we explain everything as we go.

Viewers who are entirely new to Unreal Engine will find it helpful to run through Epic's getting started tutorials before diving in here, just so you know where everything is, but this course is carefully stuctured appropriate for both experienced Unreal users who need to learn specifically how Unreal works with VP, and for new Unreal users just finding their way around.

Whether you're entirely new to VP development and to Unreal, you've already been working in another engine, or you know your way around Unreal but are new to VP, this masterclass should be able to provide a lot of value. And we hope even those already well versed in VP&VR creation using Unreal Engine find a few interesting new perspectives and techniques as well.

We plan to update this course every two to three months with fresh VP content as new features get added. This is a WIP and all our courses get updated for years after release. We keep content up to date as new engine updates come every month. Do not miss out on this opporunity join today and start shooting today using Virtual Production!

Who this course is for:

Cinematographers, production teams, tv, web and independent creators
People who make Udemy content
Game designers, intractive UI / UX developers
Directors, Run'n'Gun Camera Operators, Production designers

Virtual Production 101 Masterclass

What you'll learn

Explore related topics

Course content

Introduction and Welcome1 lecture • 3min

2024 UPDATE* AXIMMETRY EYE UNREAL 5.41 lecture • 58min

2021 UPDATE* AXIMMETRY + UNREAL ENGINE 4.27 [PL - ENG SUBS]11 lectures • 3hr 1min

First steps in tracking a camera just using a smartphone6 lectures • 30min

Unreal Engine in VR for Virtual Production5 lectures • 54min

Great 3D creation Tools to use outside UE4 **BONUS MATERIALS!1 lecture • 45min

Motion Capture Character Animation Step by step ** BONUS (MOBILE FRIENDLY)7 lectures • 34min

Requirements

Description

Who this course is for: