Android Marshmallow has a hidden feature: universal translation

Android 6.0 'Marshmallow' allows users to instantly translate text between languages from within popular apps including WhatsApp, TripAdvisor, and LinkedIn.

Tony Avelar/AP
Android 6.0 "Marshmallow" allows users to translate written text from within apps, without having to switch over to Google's dedicated Translate app. Here, Google VP of Engineering Dave Burke speaks about Marshmallow at a Google event in San Francisco on September 29, 2015.

Google’s language translation features have always been pretty good. Way back in 2010, the company introduced the ability to translate street signs, menu items, and other written text just by snapping a picture. And earlier this year, Google beefed up its instant translation app by adding 20 more languages, allowing a user with an Android or iOS device to translate written text simply by viewing it through the device’s screen.

Android 6.0 “Marshmallow” takes translation one step further by automatically integrating it into popular apps such as LinkedIn, WhatsApp, and TripAdvisor.

Users will need to have Google’s Translate app installed on their phone or tablet for the feature to work, but they won’t need to switch back and forth between Translate and other apps to be able to understand text written in other languages. The translated text will appear right in the app being used.

Say you’re using TripAdvisor to read reviews of a hotel or a tourist attraction in Germany. You can highlight the German text you’d like to understand, and a “translate” option will pop up alongside the usual copy-and-paste commands.

If you’re using WhatsApp to communicate with someone in another language, the feature will help you to read his or her messages and to compose your own – just type a response in your preferred language, and Android will convert it to the language spoken by the other person. Google says the feature will allow for translation between any of 90 languages.

The translation relies on an under-the-hood change in the way Android Marshmallow handles text selection. When you highlight text, Android displays a floating toolbar with “cut,” “copy,” and “paste” as well as context-sensitive options such as “Comment,” “Search,” and “Translate.” The translation feature won’t work with previous versions of Android, and because of the way it’s implemented, it probably won’t appear on iPhones or iPads either.

Google says that more than 500 million people use its translation services each month, and that more than 100 billion words are translated each day.

Recent advances in machine learning and data collection are helping companies such as Google and Microsoft to increase the accuracy and speed of automated translation, by giving translation algorithms a bigger body of text in different languages to draw from. Last year Microsoft-owned Skype launched a preview of its real-time audio translation service, which allow users to have face-to-face video conversations even if they don’t speak the same language.

You've read  of  free articles. Subscribe to continue.

Dear Reader,

About a year ago, I happened upon this statement about the Monitor in the Harvard Business Review – under the charming heading of “do things that don’t interest you”:

“Many things that end up” being meaningful, writes social scientist Joseph Grenny, “have come from conference workshops, articles, or online videos that began as a chore and ended with an insight. My work in Kenya, for example, was heavily influenced by a Christian Science Monitor article I had forced myself to read 10 years earlier. Sometimes, we call things ‘boring’ simply because they lie outside the box we are currently in.”

If you were to come up with a punchline to a joke about the Monitor, that would probably be it. We’re seen as being global, fair, insightful, and perhaps a bit too earnest. We’re the bran muffin of journalism.

But you know what? We change lives. And I’m going to argue that we change lives precisely because we force open that too-small box that most human beings think they live in.

The Monitor is a peculiar little publication that’s hard for the world to figure out. We’re run by a church, but we’re not only for church members and we’re not about converting people. We’re known as being fair even as the world becomes as polarized as at any time since the newspaper’s founding in 1908.

We have a mission beyond circulation, we want to bridge divides. We’re about kicking down the door of thought everywhere and saying, “You are bigger and more capable than you realize. And we can prove it.”

If you’re looking for bran muffin journalism, you can subscribe to the Monitor for $15. You’ll get the Monitor Weekly magazine, the Monitor Daily email, and unlimited access to CSMonitor.com.