Video translation by AI: The AIVideo Translator

Many high-quality video tutorials, such as those by TYPO3 expert Wolfgang Wagner, are currently only available in German. To make this content accessible to an international audience, web-vision has developed the AIVideo Translator - an AI-based tool for automated video translation.

What is the AIVideo Translator?

The AIVideo Translator is an open source tool that automatically transcribes videos, recognises and translates technical terms with the help of glossaries and generates a new audio track in the target language. The tool also creates subtitles in SRT format to improve the accessibility of the videos.

Technical realisation

The tool is based on various open-source libraries and was developed in the Python programming language

  • OpenAI Whisper for speech recognition
  • transformers for machine translations
  • gTTS (Google Text-to-Speech) for speech output
  • ffmpeg-python for video and audio editing

AIVideo Translator can be used completely offline and does not require any subscriptions or cloud services.

The first translated videos are already available on YouTube:

For further or more extensive examples, please contact us.

With the AIVideo Translator, web-vision offers an efficient solution for providing multilingual and accessible video content - ideal for companies and content creators who want to expand their reach internationally.

Further information and the download can be found on the official project page on GitHub.