Tech giant Lenovo, alongside Innovations in Dementia, announced a proof-of-concept project dubbed Alzheimer’s Intelligence, a photorealistic AI-enabled 3D avatar that converses with individuals with dementia. It offers curated advice gathered from hundreds of real people living with dementia and Alzheimer’s.
Lenovo’s technology aggregates experience and advice collected from hundreds of individuals into a 3D avatar capable of having unscripted and natural conversations with a dementia patient in real time. The avatar can be used as a conversational resource and aid for dementia patients.
The AI avatar was developed using a composite of images from ten individuals with Alzheimer’s and dementia. AI was then used to create faces inspired by the ten individuals to develop several thousand expressions and angles for the avatar.
The avatar, named Liv, was created by blending the faces and creating one dataset based on data that came directly from individuals with the disease, entries from Innovations in Dementia’s Dementia Diaries project and panel interviews.
When a user asks Liv a question, the LLM queries the dataset and expresses answers using a vocal synthesizer created for the project in the language of the persona created for Liv.
The company said, “‘Sentiment analysis’ is used to analyze the underlying feeling of the reply, which is reflected in the facial expression of the AI when it speaks. Finally, real-time 4k visual AI is used to allow the speech generated by the vocal synth to appear to be spoken in real-time.”
The AI is currently undergoing a trial process, but the company says the goal is to make it publicly available in the future.
“We recognize the importance of giving everyone a voice in innovation,” Doug Fisher, chief security and AI officer at Lenovo, said in a statement.
“With huge advancements in AI and smarter technologies, now is the time to explore and pilot creative new ways to use technology like AI thoughtfully and responsibly for the greater good. Ultimately, it’s about re-imagining a future where technology is for – and from – all, giving everyone a voice in what they want from the most transformative technology of our generation.”
THE LARGER TREND
Numerous companies are contemplating how to use avatars – and their potential use cases within healthcare.
In a study published last year, researchers examined if avatar technology could help patients use telemedicine applications more easily if they experience impairment or have limited health-related literacy.
Findings suggested that a “nurse look-a-like avatar integrated into a telemedicine application was positively assessed by heart failure patients.” Still, future studies were warranted to explore further use of the technology.
Earlier this year, Cole Wiser, executive creative director at the Virtual Wild, and Srini Iyer, chief technology officer for Leidos’ health and civil sector, joined HIMSS TV to discuss the use of hologram technology for caregiver training, virtual greeters and patient interactions, stating the future for holograms in healthcare is limitless.
