As millions worldwide face the challenges of dementia, innovative technologies are emerging to aid both patients and caregivers. A UK-based cooperative, Animorph, has developed CrossSense, smart glasses designed to assist individuals wiht dementia in navigating daily life by identifying objects, providing real-time prompts, and enhancing safety. The device, currently undergoing trials in the UK, represents a notable step toward maintaining independence for those experiencing cognitive decline and is a finalist in the prestigious Longitude Prize on Dementia.
Smart glasses equipped with cameras and voice recognition, developed by a UK cooperative, are helping patients with dementia plan their day in manageable steps.
Imagine holding a rolling pin, but struggling to recall its name. Your brain offers possibilities – a stick, a bat, “that thing” – but none feel right. Or being in the kitchen, holding a coffee maker, unsure of what to do next. These challenges are common and deeply frustrating for individuals living with dementia, who often experience difficulty completing seemingly simple tasks. Now, a pair of smart glasses (currently being trialed only in the UK and in English) may offer a solution: identifying the object as a “rolling pin,” or prompting, “Now you need to put coffee in the moka pot.”
Extending Independence for Patients with Alzheimer’s
Table of Contents
“I wish I could bring order to things. I struggle to focus on one thing at a time, rather than millions of things I don’t want to think about.” “What I want is to continue living in my apartment and not be a burden to my son.” These are common sentiments expressed by those experiencing dementia. Maintaining independence for as long as possible is a deeply felt desire for individuals in the early stages of cognitive decline. And the need is significant: globally, over 55 million people live with a form of dementia, with Alzheimer’s disease being the leading cause. In Italy alone, at least 600,000 people suffer from Alzheimer’s, among over one million dementia cases. These numbers are projected to rise rapidly in the coming decades, placing a substantial strain on healthcare systems and families.
Glasses That Recognize People and Objects
Individuals with dementia often recognize the challenges that come with cognitive decline, knowing that their ability to live independently may diminish over time without effective therapies. Animorph, a London-based cooperative, has responded to this need with CrossSense, high-tech glasses connected to an augmented reality app designed to make daily life less daunting. The CrossSense glasses are equipped with cameras, live display lenses, and voice recognition, enabling them to identify objects and people, alert users to potential hazards, assist with daily activities, and even recall names – ultimately promoting a safer and more independent life, while easing the burden on family members and caregivers.
Object Identification and Real-Time Guidance
When looking at an object, such as an apple, the name “apple” appears on the glasses’ display. The integrated AI assistant, Wispy, can identify food, locate misplaced keys, or help adjust the thermostat. “If you look at a toaster,” explains Szczepan Orlins, director of Animorph and software architect, “it will tell you what you can do with it, but also to be careful when removing the toast.” The system also provides reminders and guidance for scheduled tasks, like taking medication. This technology offers a potential solution to the cognitive challenges that can make everyday tasks overwhelming for those with dementia.
Real-Time Prompts and Safety Alerts
The glasses communicate with the wearer through integrated speakers in the arms, providing reassuring guidance. A person with dementia might be alerted if they’ve left the gas on or reassured about their route during an outdoor walk. This constant support aims to enhance safety and confidence for individuals navigating daily life with cognitive impairment.
The Times tested the device with a woman living with vascular dementia. The smart glasses guided her step-by-step through safely making a cup of tea with a kettle, prompting her to smell the milk to ensure it hadn’t spoiled. “Wait for the water to boil, then pour it into the cup, then add a tea bag.” While some in the UK questioned the procedure (many prefer adding the tea bag first, a point developers acknowledge as a “cultural hallucination”), the process was completed safely.
Planning the Day in Stages
Powered by a large language model, Wispy, the integrated AI assistant, can help plan a day and break down tasks into smaller steps. The glasses also feature functionality designed to read a person’s emotional state. “Being able to understand how an individual is feeling is one of the essential elements of this project,” Szczepan Orlins told The Times. “We can analyze tone of voice, words, and movements. All three together can provide a very effective assessment.”
A key benefit of the smart glasses is providing structure to procedures. Individuals with Alzheimer’s often struggle with the sequence of steps, and the question of “what comes next?” can be overwhelming. When these questions accumulate, a simple task can become complex. Unlike reminder apps, CrossSense follows the user (with a gentle, non-pressuring voice) through each step of a sequence. This applies to making tea, preparing a full meal, or getting dressed. The AI software also helps find the right words to describe objects and gently reminds the user of what they were doing, tracking conversations.
Open Questions: Cost and Availability
However, several challenges remain. Will older patients with dementia tolerate wearing talking glasses? Could a digital companion feel too intrusive? The current frames weigh 75 grams (compared to 30-40 grams for standard frames) – will they be too uncomfortable? The glasses have a battery life of about an hour, but come with an integrated power bank for all-day use, though the idea is to wear them for up to two hours, during times when memory difficulties are greatest.
The AI software will be commercially available later this year with a subscription costing around £50 per month, in addition to the £700 cost of the glasses. The company states that the device is encrypted and operates offline “in a secure and independent network,” protecting user privacy: no data is sent to the cloud.
The Longitude Prize on Dementia
The technology is one of five projects selected for the Longitude Prize on Dementia, which aims to promote and fund technologies capable of helping people with dementia maintain independence for as long as possible. After a global search that began in 2022, the five finalists each received £300,000 last year to develop their solutions. The winner of the £1 million grand prize will be announced in March.
