Brain Implant Lets Man with ALS Speak and Sing with His ‘Real Voice'
The system — known as a brain–computer interface (BCI) — used artificial intelligence (AI) to decode the participant's electrical brain activity as he attempted to speak. The device is the first to reproduce not only a person's intended words but also features of natural speech such as tone, pitch and emphasis, which help to express meaning and emotion.
In a study, a synthetic voice that mimicked the participant's own spoke his words within 10 milliseconds of the neural activity that signalled his intention to speak. The system, described today in Nature, marks a significant improvement over earlier BCI models, which streamed speech within three seconds or produced it only after users finished miming an entire sentence.
On supporting science journalism
If you're enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today.
'This is the holy grail in speech BCIs,' says Christian Herff, a computational neuroscientist at Maastricht University, the Netherlands, who was not involved in the study. 'This is now real, spontaneous, continuous speech.'
Real-time decoder
The study participant, a 45-year-old man, lost his ability to speak clearly after developing amyotrophic lateral sclerosis, a form of motor neuron disease, which damages the nerves that control muscle movements, including those needed for speech. Although he could still make sounds and mouth words, his speech was slow and unclear.
Five years after his symptoms began, the participant underwent surgery to insert 256 silicon electrodes, each 1.5-mm long, in a brain region that controls movement. Study co-author Maitreyee Wairagkar, a neuroscientist at the University of California, Davis, and her colleagues trained deep-learning algorithms to capture the signals in his brain every 10 milliseconds. Their system decodes, in real time, the sounds the man attempts to produce rather than his intended words or the constituent phonemes — the subunits of speech that form spoken words.
'We don't always use words to communicate what we want. We have interjections. We have other expressive vocalizations that are not in the vocabulary,' explains Wairagkar. 'In order to do that, we have adopted this approach, which is completely unrestricted.'
The team also personalized the synthetic voice to sound like the man's own, by training AI algorithms on recordings of interviews he had done before the onset of his disease.
The team asked the participant to attempt to make interjections such as 'aah', 'ooh' and 'hmm' and say made-up words. The BCI successfully produced these sounds, showing that it could generate speech without needing a fixed vocabulary.
Freedom of speech
Using the device, the participant spelt out words, responded to open-ended questions and said whatever he wanted, using some words that were not part of the decoder's training data. He told the researchers that listening to the synthetic voice produce his speech made him 'feel happy' and that it felt like his 'real voice'.
In other experiments, the BCI identified whether the participant was attempting to say a sentence as a question or as a statement. The system could also determine when he stressed different words in the same sentence and adjust the tone of his synthetic voice accordingly. 'We are bringing in all these different elements of human speech which are really important,' says Wairagkar. Previous BCIs could produce only flat, monotone speech.
'This is a bit of a paradigm shift in the sense that it can really lead to a real-life tool,' says Silvia Marchesotti, a neuroengineer at the University of Geneva in Switzerland. The system's features 'would be crucial for adoption for daily use for the patients in the future.'
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Yahoo
6 hours ago
- Yahoo
Breakthrough study finds deficiency of this common nutrient could contribute to Alzheimer's
A deficiency of the metal lithium in the body could be a key factor contributing to the development of dementia in Alzherimer's patients, a groundbreaking new study reveals. The decade-long research, published in the journal Nature, shows for the first time that lithium occurs naturally in the brain and maintains the normal function of all its major cell types, preventing nerves from degradation. Scientists from Harvard Medical School found that lithium loss in the human brain is one of the earliest changes leading to Alzheimer's, while in mice, a similar lithium depletion accelerated memory decline. A reduced lithium level was found in some cases due to the metal's impaired uptake and its binding to amyloid plaques, which are known to be smoking gun signs of Alzheimer's. Researchers also showed that a new type of lithium compound – lithium orotate – can avoid capture by amyloid plaques and restore memory in mice. In the study, scientists used an advanced type of mass spectroscopy chemical analysis method to measure trace levels of about 30 different metals in the brain and blood samples from a range of people, including cognitively healthy people, those in an early stage of dementia, and those with advanced Alzheimer's. The analysis revealed that lithium was the only metal with markedly different levels across groups, which also seemed to change at the earliest stages of memory loss. 'Lithium turns out to be like other nutrients we get from the environment, such as iron and vitamin C,' study senior author Bruce Yankner said. 'It's the first time anyone's shown that lithium exists at a natural level that's biologically meaningful without giving it as a drug,' Dr Yankner said. Although lithium compounds have been historically in use to treat a range of mental conditions like bipolar disorder and major depressive disorder, in these cases, they are given at much higher concentrations that could even be toxic to older people. Scientists have now found that lithium orotate is effective at one-thousandth this dose – enough to mimic the natural level of lithium in the brain. The latest findings with lithium orotate, however, needs to be confirmed in humans via clinical trials. Yet, researchers suspect that measuring lithium levels could help screen people for early Alzheimer's. The findings revise the theory of Alzheimer's disease, which affects nearly 400 million people worldwide, offering a new strategy for early diagnosis, prevention, and treatment. Decades of studies have shown that Alzheimer's disease involves an array of brain abnormalities, including clumps of the protein amyloid beta, tangles of the protein tau, and a loss of the brain's protective protein REST. However, these abnormalities have never fully explained the condition. For instance, it remains unclear why some people with Alzheimer's-like changes in the brain never go on to develop dementia or cognitive decline. Recent treatments developed to target amyloid beta plaques also don't seem to reverse memory loss, only modestly reducing the rate of cognitive decline. Now, scientists say lithium could be the critical missing link. 'The idea that lithium deficiency could be a cause of Alzheimer's disease is new and suggests a different therapeutic approach,' Dr Yankner said. 'You have to be careful about extrapolating from mouse models, and you never know until you try it in a controlled human clinical trial... But so far the results are very encouraging,' he added. Solve the daily Crossword
Yahoo
15 hours ago
- Yahoo
Scientists Found a Hidden Trigger That Could Make Your Eyes Regenerate
Here's what you'll learn when you read this story: Many groups in the animal kingdom have the remarkable ability to regenerate their eyes, but mammals are not one of them—at least, not yet. A new study analyzed the genetic mechanisms behind the ocular regenerative ability of the golden apple snail to see if a similar technique could be used in human eyes. Although separated by hundreds of millions of years of evolution, human eyes and apple snail eyes retain remarkable similarities, both physically and genetically. Talk to most freshwater biologists, and you likely won't find much love for the golden apple snail. An invasive species outside of South America, this freshwater snail (Pomacea canaliculata) is both extremely resilient and what is known as a prolific organism, meaning it makes a lot of babies. This is a one-two punch of bad news for conservationists. But in a strange twist of fate, these particular attributes of the golden apple snail—along with its impressive ability to regenerate its eyes when damaged—made it the perfect test subject for Alice Accorsi, an assistant professor of molecular and cellular biology at the University of California (UC) Davis. So much so, in fact, that Accorsi was surprised no other study had yet detailed exactly how these snails wield such impressive powers of regeneration. 'When I started reading about this, I was asking myself, why isn't anybody already using snails to study regeneration?' Accorsi, the lead author of the new study, said in a press statement. 'I think it's because we just hadn't found the perfect snail to study, until now. A lot of other snails are difficult or very slow to breed in the lab, and many species also go through metamorphosis, which presents an extra challenge.' In the experiment, Accorsi and her team developed methods to tweak the apple snail's genome, hoping to better understand why it can regrow its eyes—an enviable ability that vertebrates (including humans) can't seem to achieve. Although separated by more than 600 million years of evolution, humans and apple snails both have camera-type eyes that make use of a system of corneas, lens, and retinas. Accorsi also said that many of the genes that participate in human eye development can be found in these snails as well. An apple snail's ocular regeneration process takes a month from start to finish. In the first 24 hours, the amputated wound heals and unspecialized cells congregate in the area before building new ocular hardware. By day 15, all parts of the eye's structure (including the optic nerve) are present, but the snail requires a few more weeks to fully mature. During this incredible process, scientists analyzed gene expression in the snail's genome, and found that immediately upon amputation, 9,000 genes expressed themselves at different rates than they did in a normal apple snail. The team then used CRISPR/Cas9 techniques to edit a snail embryo's genome—specifically, a gene known as Pax6, which is also known to control the development of the brain and eye in humans. 'The idea is that we mutate specific genes and then see what effect it has on the animal, which can help us understand the function of different parts of the genome,' Accorsi said in a press statement. When the snail embryo had two non-functional copies of the gene—one from each parent—eyes didn't develop at all once the snail reached maturation. Future studies will investigate if the manipulation of the gene in adult snails similarly impacts regeneration. 'If we find a set of genes that are important for eye regeneration, and these genes are also present in vertebrates, in theory we could activate them to enable eye regeneration in humans,' Accorsi said in a press statement. The idea of regenerating human eyes isn't new. A study published earlier this year in the journal Nature Communications showed evidence of the 'first successful induction of long-term neural regeneration in mammalian retinas,' according to the researchers, by inhibiting the PROX1 protein that can block retinal cell types in animals, including ones that could help restore vision to those suffering from retinitis pigmentosa. Similarly, this research was inspired by the amazing eye-regenerating abilities of the zebrafish. We humans may be the one with the big brains of the animal kingdom, but the varied biology of Earth's incredible creatures still has so much to teach us. Get the Issue Get the Issue Get the Issue Get the Issue Get the Issue Get the Issue Get the Issue Get the Issue You Might Also Like Can Apple Cider Vinegar Lead to Weight Loss? Bobbi Brown Shares Her Top Face-Transforming Makeup Tips for Women Over 50 Solve the daily Crossword
The Hill
19 hours ago
- The Hill
Promising vaccine may prevent certain cancers from returning
An experimental cancer vaccine has shown promising results in keeping pancreatic and colorectal cancers from coming back. In a clinical trial led by the Jonsson Comprehensive Cancer Center at the University of California, Los Angeles, researchers tested the vaccine on 25 patients who had previously been treated for pancreatic and colorectal cancers. Colorectal cancer is the third most common cancer diagnosed in both men and women in the United States, according to the American Cancer Society, and pancreatic cancer accounts for about 3 percent of all cancers in the country. Researchers found that the vaccine, named ELI-002 2P, could trigger lasting immune responses and may help prevent or delay cancer recurrence in high-risk patients whose tumors are driven by KRAS mutations, which are responsible for half of colorectal cancers and more than 90 percent of pancreatic cancers, researchers noted. When they followed up with patients after more than a year, they found the average relapse-free survival was 16 months and the average overall survival was 28 months — both exceeding historical norms — with the greatest benefit seen in patients who developed strong mKRAS-specific T cell responses after getting the vaccine. Dr. Thomas Marron, an oncologist who was not involved with the study, told NewsNation the results are 'extremely promising,' as both cancers typically have a high risk of recurrence. 'This vaccine is about teaching patients' immune systems how to recognize and attack those tiny amounts of cancer cells so that they keep them from coming back, increasing the likelihood that we can cure patients with surgery and chemotherapy or radiation,' Marron said. Marron said UCLA's vaccine could become available within the coming years.
