Video Fundamentals – Part 1 – General Workflow

Since the first introduction of our new blog almost a year ago the number of topics covered has grown to include a wide variety of subjects to the point you could almost prepare an entire course on VJing and live video production from our collection of tutorials.

With this in mind we've started to put together a new “Introduction to Video Fundamentals” curriculum that focuses on teaching the basic knowledge needed to get started with working with visuals. While these ideas are usually demonstrated with VDMX a lot of the underlying techniques are generally translatable to other software and hardware used for video and lighting production.

In part two of this series (stay tuned!) we'll start to look at some more advanced topics for putting all of this together for live performances along with some of our case studies and tips from the pros in the field.

Using VDMX to demonstrate basic chroma key techniques.

Lesson 1.1 – Live Cameras, Interactive Video Generators, and Pre-Rendered Movies

Typically the original source material used in video production falls into one of three categories:

1. Live inputs such as video cameras, published Syphon feeds and window captures from other applications.
2. Interactive video generators such as Flash, Quartz Composer, and CoreImage.
3. Pre-rendered movies (and still images) from cameras or exported from animation software.

Case Study: The ECLECTIC METHOD REMIX, Part One - Making Loops

Tips & Notes:

• In VDMX the Media Bin plugin is used to organize and switch between video sources. 
• When using pre-rendered movies export to the PhotoJPEG, Apple Intermediate or Hap video codecs for the best playback performance in VDMX.
• Each source type has its own set of controls for manipulating the playback and output during performance. 

Assignment:

1. Download a set of sample clips  to use with the VDMX simple player template.

Challenge:

1. Create a set of your own A/V loops using a camera or other captured footage.

Lesson 1.2 – Mixing and Applying Visual FX to Video Sources

Whether working in a real-time output environment like VDMX or a non-linear editor like Final Cut Pro, the technique used for digitally processing video source materials is essentially the same:

1. Apply image filters to change the look and style of individual video sources and layer groups.
2. Mix and combine multiple video sources by adjusting the size, crop, and composition mode.

Case Study: The ECLECTIC METHOD REMIX, Part Two - Jamming 

Tips & Notes: 

• Layer masks adjust the opacity of individual pixels during composition to obscure parts of an image.
• Preview windows in VDMX  can be set to view layers both before and after FX are applied.
• New custom FX and composition modes can be created using Quartz Composer and other popular formats.

Assignments:

1. Mix, and fade between sources with the example Four Channel Mixer template. 
2. Practice removing a solid color background with a chromakey effect.

Challenge: 

1. Make a pre-rendered animation that makes use of alpha channels.

Lesson 1.3 – Publishing Video

Once video sources are processed and composited together, the next step is to output the result:

1.  Fullscreen outputs, such as projectors, displays and LED walls connected to a monitor port.
2. Syphon outputs, to send video feeds to other applications for specialized image processing.
3. Recorded to disk as a movie or still file that can be shared online or further remixed.

Case Study: How to do the Deadmau5 End of Year Tour visuals by Momo the Monster 

Tips & Notes: 

• The final output can be stretched across multiple displays. 
• Use Perspective Correction (quad mode) for simple projection mapping onto uneven surfaces. 
• Lighting designers can use the VDMX “Video to DMX” plugin to translate video streams to ArtNet universes.

Assignments: 

1. Apply an FX to only part of a layer using a mask.
2. Create and share online a short demo reel  from what you've learned so far.

Challenge: 

1. Make a 3x3 video wall using live sampled video clips.

Lesson 1.4 – Instruments and Automation

Pretty much every parameter in VDMX can be controlled by external hardware or automated with data generator plugins:

1. MIDI, OSC, and DMX (ArtNet) are common protocols for creating networks and connecting physical instruments to computers.
2.  Step Sequencers and LFOs generate control values with oscillators and looping patterns.
3. Audio Analysis and Beat Detection algorithms listen to music from sound inputs to sync visuals.

Case Study: The ECLECTIC METHOD REMIX, Part Three - Working with Ableton Live 

Tips & Notes: 

• The VDMX Echo mode can be used to set up easy “talkback” to MIDI and OSC instruments with light up LEDs and other dynamically updating interfaces.
• Layout files from TouchOSC can be directly imported into VDMX for quick mapping of parameters to iPhones, iPads and Android tablets.
• Lightning designers can configure VDMX as a custom DMX controlled media server and virtual lighting rig.
• New control plugins for Face Detection or other custom tasks can be created with Quartz Composer.

Assignments:

1. Use audio analysis (or another data-source) to trigger video clips.
2. Create a virtual layout of a MIDI instrument with the Control Surface plugin.

Challenge: 

1. Sync the playback of movies on two computers across a network with OSC.