Zuckerberg Showcases AI-Powered Translation in Ray-Ban Smart Glasses at Connect 2024

Share
Source: https://www.meta.com/blog/quest/ray-ban-meta-smart-glasses-new-styles-multimodal-ai-ferrari/

Meta CEO Mark Zuckerberg teamed up with former UFC Flyweight Champion Brandon Moreno to unveil interesting advancements in Ray-Ban clever glasses. The spotlight of the demonstration changed into a new real-time AI translation characteristic, permitting customers to speak throughout language obstacles seamlessly.

During the live demonstration, Moreno spoke in Spanish, prompting Zuckerberg to inquire about his recovery from a knee injury in English. The smart glasses translated their conversation instantly, showcasing the impressive capabilities of the technology.

The upcoming feature allows users wearing the glasses to hear real-time translations through a built-in speaker when conversing with speakers of Spanish, French, or Italian. Users can respond in English, with the translation voiced through a connected app for the other party. This innovation promises to enhance travel experiences and foster connections amongst human beings from numerous linguistic backgrounds.

Zuckerberg emphasized the implications of this technology, noting that it is able to assist “destroy down language boundaries and convey humans closer collectively.” While Meta has but to announce a particular release date, they plan to make bigger the range of supported languages within the future.

In addition to the translation feature, Zuckerberg highlighted other updates powered by Meta’s latest AI model, Llama 3.2. The enhancements include voice-activated AI capabilities for translating menus and providing information about landmarks. Furthermore, a new automatic video dubbing feature for Reels will synchronize lip movements to make it appear as though subjects are speaking the dubbed language, starting with English and Spanish.

As Meta continues to innovate, these advancements reflect a commitment to integrating technology into everyday communication and enhancing user experiences across platforms.