How would you design Alexa for the blind people?
Amazon- Ana Rodriguez
Clarify
– when you say alexa , do you mean the hardware or the software- IIRC alexa is also available as a softwre assitant on certain devices like cars
– assuming youre referring to the hardware scope here
– Im assuming this is for the US
– What is alexa, alexa is a hardware voice assistant that can :
- Answer your queries
- Help you control certain iOT devices
- Play games
- Stream music or podcasts or audiobooks
- Order on Amazon
- Make calls
- Certain alexa model also have:
- screens so can be used to stream
- clock displays
– When you say blind – whats the definition of blind, is it medically blind or legally blind, assuming we are to medically blind here
– is there a specific goal or the goal is to optimise for the user/build the best product possible, assuming the latter
who is the user?
Users who have completely lost their vision/medically blind
Persona is :
- Spends a lot of time at home
- May be living with an assistant/nurse or family
- Visits the doc often for check ups
- is on medication
- Relies on voice as an inputs mechanism
- Relies on voice interface as primary interface
- Telling time
- timers
- searches
- Finds out about latest trends esp in music etc from family
- Looks it up on alexa and listens to songs/audiobooks
- Prone to fraud
- unable to verify calls etc
- Not able to keep track of quantity of their groceries till its too late
pain points
Entertainment – Discovery of content
Reminders – Managing medicine routine
Safety and Security – Awareness of surroundings , visitor safety, visitor management, taking calls/verifying source
Troubleshooting issues with home/home repairs – ad hoc communication for repairs and queries, for example electricity issues etc
Other cohort
Family/nurse staying with the user
Proposal
Audio streaming assistance mode – Users can enable ‘assistance mode’ and specify disability and alexa will enable discovery of relevant content (audio) with a voice approach as part of the experience.
For example when you’re listing to a song it may towards the end/on pause name and play samples of songs from recommendations
For example when you’re listing to a song it may towards the end/on pause name and play samples of songs from recommendations
RICE: VH H H M -> High frequency high reach high impact use case , PICK
Medical Reminders/emergency medicial – Users can set up medicine routine or allow their doctors to set them as part of the precription for medicines and routine check ups. Assistant will proactively remind and ensure user takens medicine on time. It will also allow patient to contact guardian/doctor quickly incase user needs assistance.
Prescriptions can also be used to order meds online for home delivery (leverage Amazon’s capabilities)
RICE: M M H H -> as part of V1 patient can set up reminders manually using alex voice assistant on the phone, remaining scope can be in the next iteration post user study/testing, not sure on risks vs benefits here and adoption here since the problem is complex
Awareness mode – Alexa is ambient environment aware – noise and temperature. It can keep listening for issues such as water left running or temperature suddenly shooting (indicating a fire hazard) and alert the user
RICE: H H H H -> PICK, its a must have for the user given their limitations
Smart purchase reminders – Integrate with amazon account and Alexa can keep reminding in time that you’re about to run out of something basis your consumption pattern for groceries/items you order on repeat. User can manually disable reminders for certain products should they want to
If a user wants to shop then it allows the user to quickly build a basket of products they need to buy in one go basis their past preferences.
RICE: M H H H -> PICK, it contributes to the independence of the user
Automatic Fall detection – For devices with cameras, devices will auto dial emergency/guardian in case user falls within x seconds, user will have the chance to cancel the call.
RICE: L H H H -> can be in the next iteration, needs more user study esp around privacy
Voice detection based mode switching – considering alexa will be in a household with multiple members, alexa will be able to switch assistance mode and regular mode setting basis voice detection
RICE: VH H H M -> PICK, must have given the shared nature of households