D-ID showcased its latest innovation: an AI-powered video translation tool that not only translates spoken language, but also clones the original speaker’s voice and synchronizes their lip movements with the translated audio.
The technology, named AI Video Translate, builds on D-ID’s previous work in AI-driven video creation, which gained widespread attention through a viral trend involving animated family photos. The company has since secured $25 million in Series B funding, largely due to the growing interest from enterprise clients in the U.S. who utilize D-ID’s technology for creating AI-enhanced videos.
With AI Video Translate, users can translate videos into 30 different languages, including widely spoken ones like Arabic, Mandarin, and Spanish, among others. This feature is now available to D-ID subscribers at no additional cost, as part of their existing subscription plans. The tool supports videos ranging from 10 seconds to 5 minutes in length and works best with a single person in the frame, facing the camera.
D-ID’s new tool enters a competitive market where several companies are already offering AI-based video translation and dubbing services. The emergence of such tools is part of a broader trend toward making video content more accessible to global audiences. This trend is also reflected in recent developments by other companies like Vimeo and Microsoft, which have introduced similar technologies.
The technology behind AI Video Translate is powered by D-ID’s proprietary model, Rosetta-1. While the tool offers potential cost savings for companies looking to scale their content globally, it also presents new opportunities for smaller creators who previously found such technology out of reach.
The release of AI Video Translate highlights the growing intersection of AI with video production, a field that continues to evolve rapidly. As AI capabilities expand, so too do the possibilities for content creation, enabling more creators to engage with audiences across linguistic boundaries. The company’s focus on video translation is aligned with the increasing demand for localized content in various sectors, including marketing, entertainment, and education.
As the use of AI in content creation continues to grow, tools like D-ID’s AI Video Translate may become standard in the industry, offering a new level of accessibility and personalization in video communication. However, the impact of such technologies on traditional localization practices and the broader content creation industry remains to be seen.
