Lulu
A hands-free smart communication system you can download & try on your smart device.
Lulu is compatible with all existing assistive switches, including eye-tracking, head mouse, or joystick.
Problem
01
Limited & inefficient communication
Both end-user and their family/friends/caregivers feel frustrated and leave them socially isolated.
02
Lack of independence
Heavily rely on family and caregivers to perform even basic tasks
03
no suitable, out-dated & expensive
Only 1 in 10 people with disabilities currently has access to the assistive technologies they need.
Approach
who is it for
Gustavo is an 18 years old Chilean boy with Cerebral Palsy. Because of his condition, he was never able to talk and move since birth. The only way he could communicate with his family was through blinking.
Like Gustavo, millions of people suffer from motor disabilities or disorders that affect their ability to connect with the world.
The difficulties in communication they suffer often lead to frustration, loss of independence, and social isolation.
How Gustavo play with Lulu
1. Learn
2. Try
.jpg)
3. Play
User research
User testing
100 users with +2000 hours from ALS, Cerebral Palsy, Multiple Sclerosis and Spinal Cord Injury
1st iteration
Object detection
Video processing AI detects objects in real-time and suggests different kinds of interactions.
Speech Recognition
Speech recognition with predictive text, activated by a wake word (such as our user’s name).
2nd iteration
OS: Windows app
New Feature: Smart home
User Scenarios
"Lulu understands you."
Lulu assisted you based on what you see and hear. For example, when Lulu see or hear the bottle of water, Lulu suggests you say
“I am thirsty.” or “Can I have some water?”.
This saves your time from typing each word.
" Lulu is your smart assistant."
Existing speech-to-text/text-to-speech technology is slow; it can take over 10 minutes to write a straightforward sentence.
Lulu’s intelligent sentence prediction learn from your communication style and personalized library help you to communicate efficiently and faster.
Smart Compose
powered by ML that helps you
to communicate efficiently
Intelligent sentence prediction
learn from your communication style
Personalized library
provides you a shortcut to the most
commonly used sentences
3rd iteration wireframe (on the process)
OS: Mobile/tablet app
New Feature: Built-in Eye/head-tracking
It is designed for those who are unable or struggle to talk or move their upper body and cannot communicate and connect with their community and loved ones. Lulu has been iterated and validated by a number of users to meet their needs.
Lulu is built for the end-user first.
We carefully layout and design the interaction for the end-user to feel comfortable to use and is compatible with all existing assistive switches, including eye-tracking, head mouse, or joystick.
