Skip to content

AI Live Streaming Overview

Clevercast lets you add AI-generated closed captions and synthetic speech translations to your live stream in multiple languages.

Notes:

  • to add multilingual AI captions and/or speech translations to your live streams, you need an AI Multilingual enterprise plan or a multilingual webinar plan with AI hours.
  • Clevercast also supports a multi-track broadcast (for local interpreters), remote simultaneous interpretation and human real-time subtitling (via our dedicated interfaces), which can be combined with AI captions and speech. This manual, however, focuses on AI events. For a more comprehensive explanation, see the Enterprise manual.

Introduction

If you are a first-time user, we strongly encourage you to start with the introduction to live streams with AI closed captions and speech translations.

Getting Started

Our guide for delivering AI live streams lets you get started with configuring, testing and delivering a live stream with AI closed captions and speech translations. An additional guide discusses AI live streams in which multiple languages are spoken. Both guides assume that you embed our video player. For other ways to deliver the live stream or subtitles, see 'Delivery options' below.

Management

The event page

In Clevercast, the name Event is used to denote a live stream and its metadata and features. Our guide for creating and managing AI events explains how to create and manage events.

The vocabulary

To improve the accuracy of AI captions and speech, Clevercast lets you create a vocabulary for each every event. In this vocabulary you can add terms (names, acronyms, industry jargon, technical phrases ...) that may appear in the live stream, so they will be correctly displayed in the captions and pronounced in the speech translations. For more info, see our vocabulary guide.

The real-time correction room

The Real-time Correction Room makes it possible to edit the text returned by the speech-to-text conversion in real-time. You can do the correction yourself or you can contact us for professional correctors. This way, you can approach 100% accuracy at a limited cost: since only the source text needs to be corrected, you just need one or two correctors (unlike interpreters or subtitlers who are needed for each language).

The real-time management room

The Real-time Management room lets you watch the incoming stream without delay, temporarily stop AI captions and speech, change the speech-to-text language (if multiple languages are spoken in a live stream) and communicate with real-time correctors through text chat.

Delivery options

Live streaming in embedded player

Clevercast is designed for customers to embed our video player on their site or third-party platform. This lets you to take full advantage of the integration of our platform and video player. Under the hood, Clevercast does adaptive live streaming with global delivery (using Akamai). Your viewers can select their preferred closed captions and/or speech translations in the player.

Delivering the live stream yourself

The live stream, including subtitles and audio translations, is delivered through the HTTP Live Streaming (HLS) protocol. It is therefore possible to retrieve the stream(s), deliver them yourself and use your own player. Contact us if you wish to do so. Keep in mind that you'll lose all features related to the integration of our video player and platform (e.g. event status switching with poster images, showing custom messages in the player ...).

Real-time transcription for on-site users

Clevercast lets event organizers make the AI text transcript and its translation(s) available in the form of a real-time scrolling text page. On-site participants can use it to read the speech-to-text conversion without any delay, for example on a big screen or on their smartphone. It can also be used by remote participants in virtual events. For more info, see the real-time transcription guide.

Simulcasting

Clevercast supports simulcasting of live streams with AI generated subtitles that are burned into the video stream. By using this feature, you can send a live stream to YouTube (or other social media) with accurate subtitles in any language, perfectly in-sync with the video. For more info, see this tutorial.

Cloud recording & Video on-Demand

Clevercast makes cloud recordings of both the broadcasted video and audio and the AI-generated closed captions and speech translations. Recordings can be downloaded and/or converted to Video on-Demand. For more info, see the 'Recordings' section of the event page.

See our Enterprise Manual on how to generate multilingual closed captions for a VoD item. Multilingual VoD items can be embedded or used as the source for simulive streaming.