Skip to main content

LLM Demo App

About LLM Demo App​

The LLM Demo App shows how easy it is to use the Switchboard SDK to combine Speech-To-Text implementations like Whisper.cpp, and LLM's via Llama.cpp to achieve a fluid voice-based conversation with an LLM agent, with one or many human participants.

LLM Demo App​

The app has the following features, with more coming soon:

  • Select Speech-To-Text implementation from a variety of options, including Whisper.cpp and Sherpa.
  • Select LLM model from a variety of options, including Llama2, Llama3, Mixtral, and many more.
  • Chat one-on-one with an LLM or add an LLM to a call with multiple human participants.

Video Demo​

In the following video we have a quick chat with Llama2 via Whisper Speech-To-Text.