What is Music Math?
There’s math, and then there’s music. Look closely, and you’ll see they share rhythmic patterns, and each can teach you more about the other. I call it music math, though you might know parts of it as phrasing or phrase counting. For me, knowing where I am in the song and using music math means knowing what’s coming next, so I can create better content with the larger show in mind. This is how I prepare a more cohesive show.
This post is for anyone who wants their visuals to move with the music in a larger composition, building a language, not just reacting to the music. In this post, I walk through my process and concepts like montage, metric and rhythmic editing, genre and song structure, musical frequency, my 64-beat counting method, and finally, when to break the rules.

Montage
Montage is a common term in film, but it’s also a way to communicate meaning through any medium, especially visual ones. A + B = C is the easiest example, known in film as the Kuleshov effect, closely related to what Sergei Eisenstein called intellectual montage. “A” may represent a blue sky, and ”B” may represent a happy dog; “C” may then be taken as the by-product of both, which, for many, means the dog is happy because the sky is blue. You can do this infinitely until you have a whole movie full of meaning and context, driven by cause-and-effect emotions. Live visuals work the same way: a visual loop paired with a lyric or a drop can create a meaning neither has on its own. Understanding this is basic but essential to the next part.
Metric and Rhythm in Editing
Metric editing uses montage to create a formula that builds rhythm in the frame. Much like music has BPM, you can think of metric editing as cutting on a set count, like a new shot every 2 bars, to create rhythm in the frame. Its sibling, rhythmic editing, lets movement inside the shot drive the pace, so the on-screen action rides the beat. Tying image speed to the music’s beats makes it tighter and more intentional, and it lets you section the music with motifs that pair with the music’s motifs, not just in sound but in tempo. I identify this as actions per second, but it’s more of an intuition than a metric.
For instance, you can build on the blue sky and the dog when the music starts, but then when the song slows, make it rain and have the dog run for shelter. This continues the story, but also the rain falling creates faster action on the screen, and so does the dog running. If the music gets really dramatic and builds, you could increase the tempo of the cuts, or even slow them down on purpose as a kind of counterpoint, playing against the tempo so the build hits even harder when it lands. When the music crescendos, you could cut to the sun coming through the clouds, the dog stopping, and the music picking back up.
Genre and Song Structure
Song Structures
Music has its own formulas. In songwriting, you may learn about song structure: the verse, the chorus, and the bridge. A typical pop song runs intro, verse, pre-chorus, chorus, verse, chorus, bridge, chorus, outro, while a typical EDM track runs intro, build, drop, breakdown, build, drop, outro. Song sections can also follow similar rules, using the same techniques for motifs and language to create a larger meaning.

Musical Patterns
Music genres also have patterns that define them. Waltzes have their ONE-two-three count in 3/4 time, EDM has its builds and drops (and fake drops), and rock has its solos. Tempo is part of the formula too: house usually sits around 120-128 BPM with a kick on every beat, techno tends to run a little faster, hip-hop verses commonly last 16 bars, and drum and bass races along at around 170-175 BPM. You don’t have to use them, but noticing and studying them for the genre you are creating visuals for can be incredibly helpful, and it can also help you appreciate the nuances of artists within each genre, as well as how each genre borrows from another.
Leitmotifs
Music also uses motifs, often called leitmotifs, to represent emotions, characters, scenes, or objects. You can see this in soundtracks, operas, and symphonies, as well as electronic and rock songs. Pairing these motifs with visual elements lets the audience return to a visual cue every time its musical theme does, so they feel the connection before they even notice it.
Some of my favorite examples: in Once Upon a Time in the West, Ennio Morricone gives each character a musical theme represented with a single instrument (guitar, harmonica, etc). Prokofiev’s Peter and the Wolf does the same without visuals, giving each character a distinct instrument, like the flute for the bird and the French horns for the wolf.
Musical Frequency
Rhythm tells you when things happen, but frequency tells you what kind of energy is hitting. The lows, like the kick and bass (roughly below 250 Hz), hit less often but carry the most weight, and each hit swells and then falls off. That suits big moves like scale, brightness, or full-screen pulses that fade with the tail. The highs, like hi-hats, shakers, and cymbals (roughly above 4 kHz), land far more often, but each hit is small and quick, so the high end stays fairly steady with less fall-off. That suits fine detail like particles, flicker, and texture, while the mids, where the melody and vocals live, are a good fit for color and shape changes.

Get Our 7 Core TouchDesigner Templates, FREE
We’re making our 7 core project file templates available – for free.
These templates shed light into the most useful and sometimes obtuse features of TouchDesigner.
They’re designed to be immediately applicable for the complete TouchDesigner beginner, while also providing inspiration for the advanced user.
64-beat Method
It’s not perfect, but my own 64-beat counting method is how I first put these ideas together. Assuming 4/4 time, every 4 beats is a bar, so 64 beats is 16 bars, and at 128 BPM that one block is exactly 30 seconds. Most dance music moves in 8-bar phrases, with bigger changes like a build, drop, or breakdown every 16 or 32 bars, so a long 32-bar drop is just two 64-beat blocks back to back.
Once you know how your genre moves through those blocks, you can plan a whole song quickly, think ahead to the build or the drop, decide how long to let something ride, or know exactly when to cut your visuals so the lasers can own the moment. Just keep your ears open: some songs add or drop a bar, and anything outside 4/4, like a waltz, needs its own count.
Diverting Expectations
Many ask why not automate everything if it’s math. You could, but a live show needs room to improvise. The performer might change things up, you might want a special moment, or the audience may have seen it before, and that last one matters most. When people can see the pattern, it’s like learning how a magic trick is done. Reading the room and knowing when to divert expectations gets the reaction you want, and if the tools do it all, you never build that instinct.
That said, automation has its place. Timecode, BPM sync, and frequency analysis are great for keeping an intentional show locked in or carrying long sets and VJ shifts.

Wrap Up
Music math comes down to simple concepts and tools. Not all of these are necessary to build an amazing show, but it does deepen the language you create your work with. Building a language for your work also helps you communicate in ways others can’t and makes your work unique. If you find these tools helpful, I’d love to see what you make with them! (tag us on Instagram @interactiveimmersivehq)
If you are coming at it for the first time, though, the simplest place to start is to count your beats at your next show and time changes every 4, 8, or 16 beats. Pretty soon it may feel less like math and more like a dance.