Previously, the Interactive Immersive HQ released a blog post on Integrating TouchDesigner with Other Software, but what about hardware? What’s the difference?
In this blog, we’ll cover when to integrate hardware into TouchDesigner, the typical types of hardware, and how to have it communicate with your network.
Hardware vs. Software
Hardware is the physical component added to your computer or server, whereas software is typically another program on your machine, such as Notch Builder, Unreal Engine, or Ableton. Typically, you need to connect your hardware to your machine with a cable — HDMI, SDI, or USB.
Once the hardware is physically connected, TouchDesigner often makes it easy to start receiving signals using nodes designed for that specific device.
If you want to learn more about integrating software, read the previous blog here.
Types of Hardware
So what are the different types of hardware you might want to connect with TouchDesigner?
There are input and control hardware components that send signals into your network — typically through CHOP channels. Then there’s production-based hardware, where you send signals out from TouchDesigner — like projectors or LED lighting systems.
In this post, we’ll focus on input and control hardware.
Input and Control Hardware
MIDI Controllers
MIDI stands for Musical Instrument Digital Interface — a protocol for communication between musical devices. Beyond audio control, it’s also widely used for lighting and visual control. Despite its age, MIDI remains one of the easiest and most reliable ways to communicate between devices in a media environment.
Read the MIDI Device Beginner Guide from Interactive Immersive HQ to learn more.
How to Integrate a MIDI Controller:
- Plug in your MIDI controller — it should light up.
- Open TouchDesigner and drop down a MIDI In CHOP. You’ll first see a yellow exclamation mark warning.
- In the top bar, go to Dialogs → MIDI Device Mapper.
- Click Create New Mapper.
- In both the In Device and Out Device dropdowns, select your device.
- Move your knobs and sliders — you should start seeing CHOP channels appear.
For deeper learning, check out Matthew Ragan’s MIDI series.
Depth Camera Sensors
There are many sensors to choose from — Kinect, Leap Motion, RealSense, ZED, Orbbec, etc. Many of these have dedicated TOP and CHOP nodes in TouchDesigner.
How to Integrate Depth-Camera Sensors
Depending on your model, TouchDesigner may already have a node for it:
- Kinect Azure → Kinect Azure TOP / CHOP
- RealSense → RealSense TOP
- ZED → ZED TOP / CHOP
- Orbbec → Orbbec TOP (you can also use Kinect Azure TOP / CHOP)
- Leap Motion → Leap Motion TOP / CHOP
Get Our 7 Core TouchDesigner Templates, FREE
We’re making our 7 core project file templates available – for free.
These templates shed light into the most useful and sometimes obtuse features of TouchDesigner.
They’re designed to be immediately applicable for the complete TouchDesigner beginner, while also providing inspiration for the advanced user.
LiDAR
What’s the difference between LiDAR and depth cameras?
LiDAR uses laser pulses to measure the time it takes for light to bounce off an object and return, making it great for long-range or outdoor use. It’s generally more robust than depth cameras, which can be sensitive to lighting, heat, or weather.
Integrating LiDAR in TouchDesigner:
Integration depends on the model. For example, Hokuyo models can use the Hokuyo CHOP.
Or an Ouster LiDAR has an Ouster TOP.
You can also watch Lake Heckaman’s video on integrating Slamtec LiDAR with TouchDesigner.
Arduino
Integrating Arduino with TouchDesigner opens up access to a wide range of sensors and components.
Integrating Arduino in TouchDesigner:
There isn’t a dedicated node like there is for MIDI or depth sensors, but it’s absolutely possible with some light coding.
Check out How to Use TouchDesigner & Arduino Together – Beginner Tutorial by P.G. Lucio for a solid starting point.
Wrap-Up
TouchDesigner’s strength lies in its seamless integration of software and hardware. Whether you’re triggering visuals with a MIDI controller, capturing body motion with a depth sensor, or using LiDAR for spatial mapping, the key is understanding how data flows in and out of your network.
By combining TouchDesigner’s flexibility with the unique capabilities of external devices, you can expand what’s possible, creating responsive, data-driven, and truly interactive experiences.
