Most of the time when visual dubbing is used in AI-assisted editing, you’re changing or adding dialogue. Sometimes, though, you need a pause, a beat, a breath – something that helps the moment land and the story tighten.
That’s where performance muting comes in.
With visual dubbing, you can remove dialogue, add silence or pauses, and give a scene the dramatic beats it needs – without cutting away or sacrificing the shot.
Performance muting is a key technique of visual dubbing technology. It lets you mute an actor – while they remain on screen. You remove unneeded dialogue, without introducing lip flap.
Everything else about the actor’s performance – for example, body language and movement – and the shot stays intact.
A well-placed pause can heighten tension, deepen emotion, or land a joke. But traditionally, editors have only been able to control timing through cuts, not through the performance itself.
When an actor doesn't pause where the story needs them to, your options have been limited:
These workarounds interrupt flow and introduce pacing compromises that can weaken what might otherwise be a perfect take.
With performance muting, all you need is a new audio recording with the same duration as the original shot, with audio stripped out where you need your actor muted.
Edit the audio of your original shot to remove unwanted dialogue, for example, using Avid or other non-linear editor (NLE).
Upload your new audio recording and original shot together in DeepEditor – either in the web app or via the Avid plugin.
DeepEditor combines the two pieces of media together into a new shot: a vub.
Workflow TipIn DeepEditor, there are two types of vub output: draft vubs and final vubs. We recommend you use draft vubs for creative iteration and problem solving in the edit – they are affordably priced to let you use them in this way. They work in HD, making them perfect for offline editing. You can even remove the watermark for non-commercial purposes, like showing your director and producers your edit. Once everyone’s happy to commit, you can upgrade your vub to a final quality output (up to 8K, 16-bit and with lossless color), so the online edit has a truly flawless result. |
Because DeepEditor is assistive AI, not generative, every output from DeepEditor is fully controllable after creation. If needed, you have the option to use the DeepEditor refinement tool to make tweaks to the vub.
It’s also critical you get consent from the actor once your vub is created via the Artistic Rights Treasury (A.R.T.) to be compliant with guilds and unions.
Insert your DeepEditor vub into your timeline in Avid or other NLE, and continue your edit!
The result:
The biggest practical benefit of performance muting is that you avoid having to reshoot – which can be practically impossible when the sets are struck and cast has moved on.
Performance muting also means your edit serves your story better. This takes the form of solving a handful of specific editorial challenges:
DeepEditor offers several powerful use cases for film and TV production, each designed to solve specific post-production challenges:
Performance muting addresses the timing and pacing challenges that have traditionally been solved only through editorial structure. But the underlying technology – frame-by-frame facial performance control – makes all of these applications possible.