Google Gemini has launched real-time, continuous translation using your phone and a pair of connected earbuds, in what looks like a powerful transformative change to the way in which we interact with speakers from other countries.
Google buried its announcement in an update to Gemini voice model updates on Friday, but the additional translation features look like they could change the way in which people interact with foreign speakers.
Google is launching a beta of Google Translate to accommodate both real-time translation and two-way conversations, powered by Gemini. Wander through the markets in Bangkok, and the update promises that you’ll hear the ambient conversations of vendors around you translated into English, via a pair of connected earbuds. In a two-way conversation, you’ll have the same experience, but you’ll have a chance to speak, and then your phone will play back what you’ve said via your phone’s speaker.
Google is promising that Translate will auto-detect over 70 languages and 2,000 language pairs, or a direct back-and-forth translation between English, for example, and Italian. The company is also promising that the phone will filter out extraneous noise as well as preserve the nuance of the conversation using AI. Translate will even accommodate multiple languages in a single session.
Those are all issues that I’ve wrestled with while traveling overseas, using various translation devices. In Taiwan, for example, I naively thought that Mandarin would be the primary spoken language, and it seems to be. But locals use others, including Hakka or Hokkien, and switched back and forth at will. I also can speak some French, but like others who lack immersion training I can speak French far better than I understand it — and probably not all that well at that.
Put simply, in my experience translation apps have almost reached a level of utility where I could depend upon them. If Google’s services works as advertised, however, this could really put translation services over that critical threshold. Google published a video showing off what the new service could do, and it’s amazing in its simplicity.
One of the things that I personally have loved about technology is watching its impact on culture. ReplayTV and TiVo introduced the ability to pause live TV, which was revolutionary to a generation of consumers, even those who owned VCRs. Remember GPS devices? When Google released its free Google Maps app for Android phones with GPS and directions, companies like Magellan faded from public view almost overnight.
Many, many people own smartphones and headphones or earbuds, and travel overseas without fluency in the local language. A few years ago, you’d be at the mercy of a local who understood English. Google’s updated Translator app really looks like we’ve moved past that, where translators will always be available in our ear.