← All use cases

Add ChatGPT and Whisper speech-to-text components to TouchDesigner

TouchDesignerBeginnerTouchDesignerOpenAI WhisperChatGPT

What it does

A Derivative community tutorial by blankensmithing on two components that run Whisper speech-to-text and ChatGPT inside TouchDesigner with only an OpenAI API key.

How to set it up

  1. Get the project file and components linked in the tutorial (hosted on the author's Patreon).
  2. Add your OpenAI API key to the components.
  3. Wire Whisper's transcript into ChatGPT, or into text and visual parameters, to build voice-reactive installations.

Source: Derivative community tutorial

FAQ

Is it free?

The tutorial is free. The components are linked via the author's Patreon, and API usage is billed by OpenAI.

Is it local?

No. It calls OpenAI's hosted APIs.

Original source: https://derivative.ca/community-post/tutorial/custom-chatgpt-and-whisperspeech-text-plugins-touchdesigner/67446

AI on Stage, a weekly newsletter

New agent use cases for live events, once a week.