AI agent use cases for live events and stage tech

Real tools and workflows for show control, LED/video, audio, lighting, TouchDesigner and production ops.

64 use cases

Ableton Live control over OSC through MCP

Exposes Ableton Live's OSC interface to AI assistants for session and transport control.

AudioIntermediateAbleton LiveOSCMCP
Add ChatGPT and Whisper speech-to-text components to TouchDesigner

A Derivative community tutorial by blankensmithing on two components that run Whisper speech-to-text and ChatGPT inside TouchDesigner with only an OpenAI API key.

TouchDesignerBeginnerTouchDesignerOpenAI WhisperChatGPT
Agent control of ETC Eos and Nomad over OSC

An MCP server with a large Eos tool set so assistants can query and drive the console.

LightingAdvancedETC EosOSCMCP
Agent control of OBS Studio scenes and sources

An MCP server that gives assistants programmatic control of OBS for streams and IMAG recording.

LED/VideoBeginnerOBS Studioobs-websocketMCP
AI-assisted Lua plugins for grandMA2

Community grandMA2 plugins including AI-assisted tools such as cue info editors.

LightingIntermediategrandMA2Lua
Apple Vision models (hands, pose, depth) in TouchDesigner on Mac

Brings Apple's on-device neural networks into TD so a Mac Mini can do tracking and segmentation locally.

TouchDesignerIntermediateTouchDesignerApple Silicon
Automate show events with Bitfocus Companion triggers

Companion triggers run any button action automatically when an event happens, such as a time interval, a variable change or startup. They're the simplest automation layer to put under an agent.

Show ControlBeginnerBitfocus Companion
Automate VJ workflows in Resolume with Claude

Lets an assistant trigger clips and manage layers in Resolume from natural-language requests.

LED/VideoBeginnerResolume Avenue/ArenaMCP
Automatic camera switching from audio with Gabin

Switches cameras automatically based on who is talking, useful for panels and podcasts.

Show ControlIntermediateOBSBitfocus Companion
Batch-build QLab 5 cues from a spreadsheet export

Taylor Glad's script reads TSV/CSV exports from a Google Sheet template and creates 17 kinds of QLab cues in one pass. A spreadsheet produced by an AI or by paperwork tools becomes a cue list.

Show ControlIntermediateQLab 5Google SheetsAppleScript
Blackmagic ATEM switcher control via MCP

An MCP server for driving ATEM switchers from an AI assistant.

LED/VideoIntermediateBlackmagic ATEMMCP
Bridge DMX, Art-Net and sACN with Open Lighting Architecture

The open-source "travel adaptor" for lighting protocols that many agent and scripting tools use underneath.

LightingIntermediateOLADMXArt-NetsACN
Build Unreal Engine scenes for virtual production with AI

Lets assistants like Cursor or Claude control Unreal Engine, useful for previs and LED volume content.

ExperimentalLED/VideoAdvancedUnreal EngineMCP
Chase SMPTE, MTC and Art-Net timecode in Companion with TimeCore

The TimeCore module brings a Visual Productions TimeCore into Companion, so buttons and triggers can show and react to incoming timecode.

Show ControlIntermediateBitfocus CompanionVisual Productions TimeCoreTimecode
Control a Behringer X32 or Midas M32 from an AI assistant

An MCP server that maps mixer actions to OSC so an assistant can read and set faders, mutes and routing.

AudioIntermediateBehringer X32Midas M32OSCMCP
Control a grandMA3 console with an AI assistant

An MCP server that sends commands to grandMA3 so an assistant can help program and operate a lighting rig.

ExperimentalLightingAdvancedgrandMA3MCP
Control Behringer WING consoles programmatically

A C API for Behringer WING consoles. The GitHub repo now points to the author's own download site for the library.

AudioAdvancedBehringer WINGC
Control Lightkey on macOS via OSC from an assistant

Lets an MCP client trigger Lightkey presets and cues, a simple path to AI-assisted lighting on Mac.

LightingBeginnerLightkeyOSCMCP
Control PowerPoint over OSC with OSCPoint

A PowerPoint add-in that lets show control or agents advance and query slides via OSC.

Show ControlBeginnerPowerPointOSC
Control vMix live production from an MCP client

Lets an assistant switch inputs and run vMix functions for live video production.

LED/VideoIntermediatevMixMCP
Depth maps from any camera with Depth Anything in TD

Monocular depth estimation accelerated by TensorRT, turning a regular camera into a depth source for effects and masking.

TouchDesignerAdvancedTouchDesignerDepth AnythingTensorRT
Describe a visual and have an agent build a playable TD node network

Type a description of the look you want and tdmcp has the assistant assemble a working node network you can perform with.

TouchDesignerBeginnerTouchDesignerMCPClaude/Cursor/Codex
Display Companion variables on a crew dashboard

A dashboard for showing Companion variables, like timers and states, to crew screens.

Production OpsBeginnerBitfocus Companion
Drive QLC+ from Claude Desktop over WebSocket

An MCP server that exposes QLC+ functions so an assistant can run free, open-source lighting control.

LightingBeginnerQLC+WebSocketMCP
Drive TouchDesigner from AI coding agents with Derivative's TDMCP

An MCP server published under the TouchDesigner GitHub org that lets coding agents control a live TD session.

ExperimentalTouchDesignerIntermediateTouchDesignerMCPcoding agents
Expanded X32 MCP server for deeper console control

A rewrite of an earlier OSC MCP server with a wider set of X32 tools for agents.

AudioIntermediateBehringer X32OSCMCP
Expose Stream Deck actions to AI assistants with Elgato's MCP server

Stream Deck 7.4 adds MCP support. Actions you put on a dedicated MCP Actions profile become tools that Claude Desktop or other AI clients can trigger.

Show ControlBeginnerElgato Stream Deck 7.4+MCPClaude Desktop
Generate console-aware cue lists with AI

An open-source AI cue list generator that formats output for specific lighting console families.

Production OpsBeginnerEosMA2/MA3AI
Generate hundreds of sequential show control cues in QLab

A QLab Cookbook workspace with script-cue generators for OSC, QLab-format OSC, MSC and MIDI program change cues. It saves hours of typing when QLab drives consoles or media servers.

Show ControlIntermediateQLabAppleScriptOSCMIDI/MSC
Give your assistant searchable TouchDesigner operator documentation

A documentation-focused MCP server so an assistant can look up operators, Python API details and tutorials instead of guessing.

TouchDesignerBeginnerTouchDesignerMCP
GPU MediaPipe tracking for interactive stage visuals

Hand, face and pose tracking inside TouchDesigner without extra hardware, good for audience-reactive installations.

TouchDesignerBeginnerTouchDesignerMediaPipe
grandMA3 toolkit with a verified knowledge corpus

Built by a lighting director against a live console, pairing MA3 tooling with reference knowledge for agents.

LightingAdvancedgrandMA3MCP
Import timecode cue lists into ETC Eos over OSC

rsmck's EOS Timecode Companion takes a CuePoints export or any tab-delimited CSV and writes the timecode events into an Eos show over OSC, with no USB sticks.

Show ControlIntermediateETC EosCuePointsOSCTimecode
Inspect and edit QLab 5 workspaces safely with an agent

A safety-focused MCP server for reading and editing QLab cues over OSC.

Show ControlIntermediateQLab 5OSCMCP
Keep lighting paperwork in sync with an Eos console

Light Assistant builds cue sheets, spot sheets, hookups and schedules. During tech it follows Eos consoles over OSC so notes stay attached to the right cue.

Commercial productProduction OpsBeginnerLight AssistantETC EosVectorworksOSC
Let an AI agent build and edit TouchDesigner networks via MCP

Connect an MCP-capable assistant to a running TouchDesigner project so it can create, inspect and wire operators from plain-language requests.

TouchDesignerIntermediateTouchDesignerMCPClaude/Cursor
Let an LLM build tracks and clips in Ableton Live for playback rigs

Popular MCP bridge that lets an assistant create tracks and arrange clips, handy for prepping show playback sessions.

AudioBeginnerAbleton LiveMCP
Live AI translation captions as an OBS overlay

A live caption and translation system you can drop into OBS or other video tools as an overlay.

LED/VideoBeginnerOBSspeech AI
Local Whisper-powered live captions for services and events

Open-source, local-first real-time captioning that can feed screens or a stream overlay.

AudioBeginnerWhisperOBS
Mark up scripts and export cue lists straight to Eos with Promptbook

Promptbook is a digital prompt book for stage managers. It handles script markup, automatic standbys, live Eos and QLab cue tracking, and CSV export for import into ETC Eos.

Commercial productProduction OpsBeginnerPromptbookETC EosQLab
Mixer-agnostic MCP control with editable mapping profiles

ConsoleMCP uses user-editable profiles so the same agent workflow can target several console families over OSC.

AudioIntermediateX32/M32WINGOSCMCP
Open-source control software for X32, M32 and WING

An open project running custom control software on digital consoles, useful for experimenting with automation.

ExperimentalAudioAdvancedX32M32WING
Plot X32/M32 scene files for documentation

Turns console scene files into readable plots for show binders and handoffs.

Production OpsBeginnerBehringer X32Midas M32
Print patch lists from X32 scene files

Generates printable patch lists from a scene file, a good input for agent-written show docs.

Production OpsBeginnerBehringer X32
Program DMX shows through OLA with an AI agent

An MCP server for building and running DMX lighting shows via the Open Lighting Architecture.

ExperimentalLightingIntermediateDMXOLAMCP
Proxy X32 control over UDP and WebSockets for web tools and agents

Relays console traffic so browser apps or remote agents can talk to an X32 without direct UDP access.

AudioIntermediateBehringer X32WebSocketUDP
Read-first production monitoring for vMix workflows

CueScope gives an agent read access to production state for reporting and checks without risky writes.

Show ControlBeginnervMixMCP
Real-time generative video pipelines with StreamDiffusion

The real-time diffusion pipeline behind many live-visual integrations; runs well on high-VRAM local GPUs.

LED/VideoAdvancedStreamDiffusionNVIDIA GPU
Real-time Stable Diffusion visuals inside TouchDesigner

TouchDiffusion brings StreamDiffusion into TD for interactive, low-latency generated imagery driven by live inputs.

ExperimentalTouchDesignerAdvancedTouchDesignerStreamDiffusionNVIDIA GPU
Resolume Arena control with a large MCP tool set

An MCP server covering playback, composition and Advanced Output for agent-assisted VJ and LED work.

LED/VideoIntermediateResolume ArenaMCP
Resolume OSC module for Stream Deck via Companion

Unofficial Companion module with clip slots and feedback, so button surfaces and automations can drive Resolume.

LED/VideoBeginnerResolume ArenaBitfocus CompanionOSC
Run one live production schedule with AI conflict checks

ShowOps.AI's Produce module keeps a single schedule across departments from load-in to strike. It flags conflicts such as overlapping dock use and creates call sheets once staffing is confirmed.

Commercial productProduction OpsBeginnerShowOps.AI
Run QLab cues live from an MCP client

Query workspaces, search cues and fire or stop them from an assistant over OSC.

Show ControlIntermediateQLabOSCMCP
Send and receive arbitrary OSC from Companion buttons

Companion's Generic OSC connection sends integers, floats, strings, blobs and multi-argument messages to any OSC device, and exposes received messages as variables.

Show ControlBeginnerBitfocus CompanionOSC
Send TouchDesigner frames through ComfyUI workflows

A TD interface to ComfyUI so you can trigger node-based image generation from your show file and pull results back.

TouchDesignerIntermediateTouchDesignerComfyUI
Stream images, video and audio from ComfyUI into TouchDesigner

A ComfyUI custom node that streams generated media straight into TouchDesigner for real-time use.

TouchDesignerIntermediateComfyUITouchDesigner
Talk to disguise Designer's REST API from an agent

An MCP service for querying and controlling disguise Designer through its REST API.

LED/VideoAdvanceddisguiseRESTMCP
Trigger Stream Deck actions by voice with NVIDIA G-Assist

Elgato's video shows NVIDIA's Project G-Assist using voice to fire Stream Deck actions through the Stream Deck MCP server. This makes hands-free cueing possible for simple setups.

Show ControlBeginnerElgato Stream DeckNVIDIA Project G-AssistMCP
Turn a Stream Deck into a show-control surface with Companion

The standard open-source shotbox for production gear, and a common trigger point for automations.

Show ControlBeginnerBitfocus CompanionStream Deck
Use a real X32 church scene file as a template

A published production team's X32 scene file you can study or adapt as a starting template.

Production OpsBeginnerBehringer X32
Use AI as a show director behind safe TouchDesigner mappings

A Derivative forum thread proposing an AI layer that picks pre-approved cues and moods. Hazardous effects stay operator-only, and changes go through dry runs and approval queues.

ExperimentalShow ControlAdvancedTouchDesignertdmcpLLM
Use Embody as a full MCP toolkit for TouchDesigner projects

Embody packages a broad set of MCP tools for TouchDesigner, giving an agent structured access to operators, parameters and project files.

TouchDesignerIntermediateTouchDesignerMCP
Use QLab 5's OSC dictionary as an agent's control vocabulary

Figure 53's official dictionary lists every OSC message QLab 5 accepts, so it's the reference an agent or script should use to target workspaces and cues.

Show ControlIntermediateQLab 5OSC
X32/M32 OSC utilities and protocol reference for automation

Patrick Maillot's long-running collection of X32 tools and protocol notes, the foundation many agent integrations build on.

AudioAdvancedBehringer X32Midas M32OSC
AI on Stage, a weekly newsletter

New agent use cases for live events, once a week.