Skip to main content

Whisper Extension

Whisper is OpenAI's pre-trained model for automatic speech recognition (ASR) and speech translation. Trained on 680k hours of labelled data, Whisper models demonstrate a strong ability to generalise to many datasets and domains without the need for fine-tuning. See more on Whisper's official page.

Whisper Extension for Switchboard allows you to effortlessly add speech-to-text capabilties in your applications.

  • Multiple Models Available: choose from vareity of Whisper models to suite your needs,whether you require higher accuracy with more extensive training data or a lightweight model optimized for faster performance and lower resource usage.
  • Wide Language Coverage: a diverse set of languages are supported
  • CUDA Acceleration: run Whisper inference on CUDA to harness power of NVIDIA GPUs for more efficient speech processing.
  • OpenVINO Acceleration: run Whisper inference on OpenVINO to harness power of Intel hardware (CPUs, GPUs and NPUs) more efficient speech processing (in beta).

The Whisper Extension provides the following audio nodes for a Switchboard SDK audio graph:

NodeDescription
WhisperSTTNodeA sink node that uses Whisper models to predict text from audio sent to it.

Download SDK Extension​

You can download this SDK extension from our Downloads Page.

Visit the page to access the latest version and start integrating it into your project!