What is Projection Mapping? Full Mini-Course

You’ve likely heard this term before, especially in recent years because of the popularity it’s gaining, but exactly what is projection mapping?

Projection mapping (also known as video mapping or spatial augmented reality), transforms ordinary surfaces into dynamic displays by projecting digital content onto them. This type of video projection technology has rapidly gained popularity in the last twenty years, being used in various fields like marketing, entertainment, and education.

From large-scale concerts to immersive museum exhibits and captivating advertisements, projection mapping creates mesmerizing visual experiences that revolutionize how we interact with our surroundings. This mini-guide will dive into what projection mapping is, and how you can get started with it.

Types of Projection Mapping

Projection mapping aims to create an optical illusion by projecting visual content onto static surfaces. There are two main projection mapping techniques: 2D and 3D.

The key difference between 2D and 3D projection mapping lies in the nature of the projection surface. 2D mapping is about creating 2D shapes and masks that you fill in with content. 3D mapping is a more complex procedure involving texturing a 3D model of your real-life object and then re-projecting the textured digital version onto the real-life version of the object.

But this technology is not just about putting an image onto display surfaces. Projection mapping is all about augmenting the real environment, by aligning the projected visuals with the features and contours of the surface or object. This creates extra dimensions, optical illusions and/or the notion of movement onto previously static objects. 

History of Projection Mapping

Projection mapping began gaining popularity fast in the 90s and early 2000s, however the first public display of this type of video mapping actually happened back in 1969 when Disney incorporated the technology into their Haunted Mansion ride at Disneyland.

This attraction featured various spooky optical illusions, including five singing busts known as the ‘Grim Grinning Ghosts.’ By projecting videos of actors singing onto the busts, Disney created the illusion that the statues were animated and singing the theme song.

The next notable instance of this technology occurred in 1980 with installation artist Michael Naimark. He filmed people interacting with objects in a living room and then projected the footage back into the room. This created the illusion that the people were physically present and interacting with the objects in real-time.

Examples of Projection Mapping

Projecting videos onto monuments or buildings, is perhaps the most well-known form of 3D projection mapping. The technique has been used all over the world, like Caesar’s Palace in Las Vegas:

And the Sydney Opera House:

Car Projection Mapping

Another popular projection map technique is onto cars, where the visuals are mapped and projected onto the surface of a vehicle, transforming its appearance in real-time. This is often used in automotive shows, commercials, and events to create stunning visual experiences and highlight design features:

Essentially, any two dimensional or three dimensional object or physical element can serve as a projection surface, opening up endless possibilities. Using 3D mapping in particular offers a richer, more immersive experience for the audience but even 2D mapping of interesting textures and content onto the real world can be quite stunning.

How Does Projection Mapping Work?

After planning out your idea and selecting or creating the object for projection, a virtual program software is used to map the video to the object’s surfaces. For 2D mapping workflows, choose the desired image or videos to project and assign them to masks you create that correspond to the object’s surfaces. 2D mapping softwares come with easy tools for creating common shapes or drawing custom masks.

3D mapping workflows involve a few more steps. The big picture is that you recreate the scene in 3D specialized software and project the virtual version of the objects onto the real-world version to augment them.

In 3D mapping, coordinates are set for the object’s placement relative to the projector. The projector’s XYZ orientation, position, and lens specifications are a pre-requisite for 3D mapping along with an accurate 3D model of the object you’re projection mapping onto.

To break down 3D projection mapping into 6 basic steps it would look like this:

1. Concept and Design: Define the purpose and create a storyboard or design for the projection.
2. Model Creation: Develop a 3D model of the projection surface/object, which could be a building, car, or any physical structure.
3. Content Development: Create the visual content, including animations, graphics, and videos as textures for the 3D model.
4. Mapping and Alignment: Use interactive projection mapping software to align the visual content with the physical structure, ensuring precision and smooth playback/creation of your content.
5. Calibration and Testing: Calibrate the projectors and test the setup to ensure the visuals align correctly on the display surface and adjust for any discrepancies.

These steps become more detailed when dealing with large scale projects of course, but the basic principles still apply.

How Much Does Projection Mapping Cost?

Projection mapping is used for permanent installations, immersive experiences, and live events all around the world. For large events, the cost for these services can be up to $10,000 USD or more for each minute of 3D video content, plus the costs of projectors, media servers, and hard drives.

The complexity of the project, the quality of equipment used, and the duration and scale of the event also impact the total price.

On a smaller scale though, you don’t need a fancy and expensive projector to get started. You can learn and play around with this technology for as little as $70:

Projection Mapping Software

Projection mapping software comes in various types, and the unique features and capabilities vary depending on the platform (like drag and drop features, warping tools, or edge blending). Some of the most popular ones are:

1. TouchDesigner: Provides extensive customization options and is popular for complex, interactive installations.
2. MadMapper: Known for its user-friendly interface and versatility, suitable for both beginners and professionals.
3. Resolume Arena: Offers robust features for live performances and VJing, including real-time video mixing.
4. HeavyM: Designed for ease of use with pre-designed effects, making it accessible for beginners.
5. Mapping Matter: A web-based tool focused on pre-visualization and planning of projection mapping projects, allowing users to simulate and optimize their setups before execution.

All of these platforms can be used for free for personal use. They all offer either free non-commercial versions or trials/demos so you can try them out.

Jobs in Projection Mapping

To get a job in this field, start by building your skills in projection mapping software like TouchDesigner and learn about projectors, media servers, and content creation. Then, create a portfolio showcasing your work, including any projection mapping projects. The great thing about projection mapping is the skills you need to do a projection mapping piece at home are smaller versions of the same skills you’d use on a building mapping project, so demonstrating small projection mapping projects at home or in your own studio can set you up to get noticed and hired quickly.

It’s a great idea to network with industry professionals by attending events and joining online communities. Look for opportunities online and apply to creative agencies, AV companies, and event production firms (be sure to check our job board regularly for new job openings).

You could also consider going the freelance route if you have a strong portfolio. Promote your services online, on social media, and through networking to build a reputation in the industry, which can lead to full-time job opportunities. It’s also important to stay updated on industry trends and technological advancements to enhance your chances of securing a job.

Using TouchDesigner for Projection Mapping

TouchDesigner is a great tool to use for projection and video mapping. It can be used as a free projection mapping software because the platform offers a free version for personal use and learning.

The software has many tools in their mapping section, including Kantan Mapper, CamSchnappr, and Stoner.

Here’s a basic guide on how to use TouchDesigner for projection mapping:

1. Download and Install TouchDesigner from the official TouchDesigner website.
2. Set Up Your Project: Open TouchDesigner and start a new project, then import your 3D model or create one within TouchDesigner.
3. Create Visual Content: Use TouchDesigner’s tools to create or import your visual content (animations, graphics, videos).
4. Map Your Content: Using one of the projection mapping tools, you can map your content onto the real-world object. In a 2D mapping pipeline you’d want to use Kantan Mapper to create masks and assign your textures to those masks. In a 3D mapping pipeline, you’d use CamSchnappr to setup your 3D model to be aligned with the real-world version of the object and get it textured. Tools like Stoner can be used in both cases to help with additional micro-adjustments on the projected output.
5. Calibrate and Test: Connect your projector to your computer, then project your content onto the target surface. Use the calibration tools in TouchDesigner to ensure the projection aligns perfectly with the physical object.
6. Fine-Tuning: Adjust the settings and refine your content to achieve the desired visual effect.
7. Run Your Projection: Once everything is set up and aligned, run your installation.

We have a full lesson on TouchDesigner Projection Mapping if you want to learn more.

Resources and Further Learning

If you’re not too familiar with TouchDesigner right now but you’ve decided that you want to learn it, the best place to start is our free TouchDesigner Tutorial Series. In this crash course, I teach you all the basics of how to use TouchDesigner, and it serves as a great starting point for all the other blogs and tutorials that we have available on our website and YouTube channel.

If you’ve got the basics down, and want to dive deeper into projection mapping, check out our resources page and our other tutorials here:

If you’re really serious about TouchDesigner and projection mapping and want to take your learning to the next level, then I recommend you join our training platform, The HQ PRO.

Wrap Up

Projection mapping has revolutionized the way we create immersive visual experiences, transforming ordinary surfaces into dynamic displays. With the advancement of software like TouchDesigner, both professionals and beginners can now easily design and execute stunning video projections.

By utilizing motion graphics, video, 3D animation, and other cutting-edge technologies, event planners, artists, and marketers now have more innovative methods to convey brand messaging, create unique stage backdrops, decorate walls and ceilings, and evoke emotions.

There is software available to suit every need and budget, and as technology continues to evolve, projection mapping will undoubtedly open up even more creative possibilities in the future.