Google loves an experiment. The company is willing to throw various projects against the proverbial wall and see what sticks.
The latest Google Experiment, which the company calls Look to Speak, could actually be a life-changing app for users with motor and speech impairments. It allows users to select from a customizable list of phrases using only their eyes and a smartphone with a front-facing camera.
Google's Look to Speak App
Google has a page on Google Experiments that breaks down everything Look to Speak is capable of. The page also provides a bit of backstory about the experiment came to be.
Everything you need to know can be found in the downloadable guide at the bottom of the post. That guide provides detailed instructions for mounting the smartphone where the user can look at the device comfortably.
Once the device is in place, users can look left and right to select from a range of pre-written phrases. Once the user chooses a phrase, it's played through the phone's speaker. The front-facing camera is used to read the eye movements and select the appropriate phrase.
Users can adjust the app's sensitivity to eye movements, which is important for finding that sweet spot where they can navigate the app without accidentally sending messages they didn't want.
There's also a feature that allows the user to look up to snooze the device, preventing it from reading their eye movements and speaking messages accidentally.
According to Google, the app isn't intended to replace full communication devices used by those with motor and speech impairments. Instead, it will serve as a way for users to send quick messages in situations where having a smaller device is more practical than a larger communication system.
Importantly, Google says that all Look to Speak data is private and only stored locally on the device.
The Look to Speak app is part of the Start with One project, which Google describes as "a collection of experiments that started by working with one person to make something impactful for them and their community."
Look to Speak App Availability
The application is available for download now on any phone running Android 9.0 or newer. Additionally, Google has made it so the functionality is supported on budget-friendly phones running Android One. That makes the barrier to entry incredibly small, as users won't need high-end phones to run this potentially life-changing app.
You can download Look to Speak on Google Play right now. Just make sure to have a look at the documentation to make sure you're using it correctly.