Can the series soon be dubbed by artificial intelligences?


If seeing movies in the original version with subtitles isn’t for you (whatever the reason), but your chosen voices often make your eardrums bleed, technology may soon be coming to your rescue.

According to Washington Post, artificial intelligence and machine learning will soon allow the following magic trick: any work can be dubbed in any language in the blink of an eye, or almost, and as satisfactorily as possible.

The result is described as optimal, with a voice perfectly sticking to that of the original performer and a work of synchronization with the movement of the lips. This technology named «auto-dubbing» (“Self-dubbing”) is currently being developed by several American startups.

The process is simple: just ask the original interpreter to record 5 minutes of any text in their original language. The machine then does the rest. The developed artificial intelligence indeed manages to learn to speak like the actor or the actress, and the language thus obtained is digitally converted into the desired language. A process which, according to the Washington Post, currently takes several weeks.

Coming soon to Netflix

We will soon be able to observe the result on Netflix, where the American thriller Every Time I Die will be offered in Spanish and Portuguese versions generated by an AI developed by the startup Deepdub, based in Dallas and Tel Aviv.

At Flawless, another company, we even try to go further: to synchronize the dialogues as well as possible with the movements of the performers’ lips, we have developed a device that modifies the image so that the mouths adapt to replicas. Will the result be discreet enough not to disturb the public? It is permissible to doubt it. The level of unease will probably lie between that of the deepfake and that of the “valley of the strange” …

As for the future of dubbers, whose best manage to put soul and depth in their (re) interpretations, it is potentially compromised by these technological advances which, once the investment amortized starting point, may save production studios a lot of money. In defiance of the artistic and the maintenance of jobs.


Source: Slate.fr by www.slate.fr.

*The article has been translated based on the content of Slate.fr by www.slate.fr. If there is any problem regarding the content, copyright, please leave a report below the article. We will try to process as quickly as possible to protect the rights of the author. Thank you very much!

*We just want readers to access information more quickly and easily with other multilingual content, instead of information only available in a certain language.

*We always respect the copyright of the content of the author and always include the original link of the source article.If the author disagrees, just leave the report below the article, the article will be edited or deleted at the request of the author. Thanks very much! Best regards!