School1.png
Lulu_nobg.png

Lulu

A hands-free smart communication system you can download & try on your smart device.

Lulu is compatible with all existing assistive switches, including eye-tracking, head mouse, or joystick.

Problem

frustration.png

01

Limited & inefficient communication

Both end-user and their family/friends/caregivers feel frustrated and leave them socially isolated. 

02

Lack of independence

Heavily rely on family and caregivers to perform even basic tasks 

03

no suitable, out-dated & expensive

Only 1 in 10 people with disabilities currently has access to the assistive technologies they need.

Approach

who is it for

Gustavo is an 18 years old Chilean boy with Cerebral Palsy. Because of his condition, he was never able to talk and move since birth. The only way he could communicate with his family was through blinking.

Like Gustavo, millions of people suffer from motor disabilities or disorders that affect their ability to connect with the world.

The difficulties in communication they suffer often lead to frustration, loss of independence, and social isolation.

Mint_Lulu.jpg

How Gustavo play with Lulu

1. Learn

Mint_Lulu1.jpg

2. Try

gustavo (7).jpg

3. Play

Mint_Lulu2.jpg

User research

Screen Shot 2021-11-14 at 11.12.22 PM.png

User testing

100 users with +2000 hours from ALS, Cerebral Palsy, Multiple Sclerosis and Spinal Cord Injury

Lulu Pitchdeck.png

1st iteration

Object detection

Video processing AI detects objects in real-time and suggests different kinds of interactions.

Speech Recognition

Speech recognition with predictive text, activated by a wake word (such as our user’s name).

2nd iteration

OS: Windows app
New Feature: Smart home

User Scenarios

"Lulu understands you."

Lulu assisted you based on what you see and hear. For example, when Lulu see or hear the bottle of water, Lulu suggests you say

“I am thirsty.” or “Can I have some water?”.

This saves your time from typing each word.

1.png

" Lulu is your smart assistant."

Existing speech-to-text/text-to-speech technology is slow; it can take over 10 minutes to write a straightforward sentence.
Lulu’s intelligent sentence prediction learn from your communication style and personalized library help you to communicate efficiently and faster.

product.png

Smart Compose

powered by ML that helps you
to communicate efficiently

Intelligent sentence prediction

learn from your communication style

product.png
2.png

Personalized library

provides you a shortcut to the most
commonly used sentences

3rd iteration wireframe (on the process)

OS: Mobile/tablet app
New Feature: Built-in Eye/head-tracking

wireframe.png
wireframe2.png

It is designed for those who are unable or struggle to talk or move their upper body and cannot communicate and connect with their community and loved ones. Lulu has been iterated and validated by a number of users to meet their needs.

Lulu is built for the end-user first.

We carefully layout and design the interaction for the end-user to feel comfortable to use and is compatible with all existing assistive switches, including eye-tracking, head mouse, or joystick.

download1.png