Meta has introduced an AI-powered video translation feature on Facebook and Instagram that automatically dubs videos, especially Reels, into another language while preserving the creator’s original voice tone and style. This translation tool also offers lip-syncing that matches the translated audio with the creators’ mouth movements, making it seem as if they are naturally speaking the translated language.
Key features of the Meta video translation tool include:
- Automatic audio translations between English and Spanish at launch, with plans to add more languages.
- A toggle option called “Translate your voice with Meta AI” available before posting a Reel, allowing creators to enable translation and optionally add lip-syncing.
- Creators can preview and approve translations before publishing, with the ability to turn off the feature without affecting the original video.
- Translated Reels are shown to viewers in their preferred language, with a label indicating the use of Meta AI for translation.
- Creator tips for best results include speaking clearly, minimizing background noise, facing the camera, and avoiding overlapping speech between two speakers.
- Facebook creators with more than 1,000 followers and Instagram public accounts can access the feature where Meta AI is available.
- Meta recently added the ability for Facebook creators to upload up to 20 manual dubbed audio tracks to a single Reel to connect with audiences beyond AI-supported languages.
- The tool also provides new analytics in the Insights panel, showing views by language to help creators gauge their expanded reach.
This feature aims to break down language barriers, helping creators reach a broader global audience by making their video content accessible in multiple languages with natural-sounding translations and synced lip movements.
Leave a Reply