OUT OF MIND
Would you like to react to this message? Create an account in a few clicks or log in to continue.
Latest topics
» Enormous Ancient Mystery Plateau Found?
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyToday at 11:45 am by PurpleSkyz

» GRANT CAMERON An Insight into the TTSA UAP App with Rob Freeman
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyToday at 11:24 am by PurpleSkyz

» Keukenhof Gardens Spring Series
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyToday at 11:20 am by PurpleSkyz

» Sane COVID Vax Advice For Emergency Workers in Canada
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyToday at 10:45 am by PurpleSkyz

» Florida Gov. DeSantis Says Lockdowns Have Been a ‘Huge, Huge Mistake’
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyToday at 10:41 am by PurpleSkyz

» Thrive Movement - Is there a fundamental structure to our universe?
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyYesterday at 5:44 pm by PurpleSkyz

» Alan Watts ~ Why Do We Resist Change
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyYesterday at 11:02 am by PurpleSkyz

» Elon Musk’s SpaceX chosen by NASA for historic mission to send humans to the Moon
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyYesterday at 10:56 am by PurpleSkyz

» Strange Sightings Increasing Worldwide! (2021)
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyYesterday at 10:52 am by PurpleSkyz

» Sean Stone - The Jon Benet Ramsey Conspiracy?
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyYesterday at 10:41 am by PurpleSkyz

» UFO NEWS ~ Disc like object (UFO) captured at Bexhill on Sea, East Sussex UK plus MORE
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyYesterday at 10:38 am by PurpleSkyz

» Anthony Weiner Has Public MELTDOWN lol lol
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyYesterday at 10:13 am by PurpleSkyz

» Deep Space is full of Mysteries
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyYesterday at 9:55 am by PurpleSkyz

» Vaccines Are Sowing Seeds of Immune System Destruction
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyYesterday at 9:51 am by PurpleSkyz

» CDC: 3,005 Recorded Deaths in VAERS Following COVID-19 Experimental “Vaccines” – More than Total Vaccine Deaths for Past 13+ Years
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyYesterday at 9:45 am by PurpleSkyz

» Nanotubes Assemble into ‘Black Strands’…
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyYesterday at 9:40 am by PurpleSkyz

» Eudra Database Vax Stats Update to April 10th 2021
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyYesterday at 9:35 am by PurpleSkyz

» Business Owner Buys Stone for Autistic Boy’s Mother’s Grave: ‘I’m Going to See That’s Done’
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyYesterday at 9:27 am by PurpleSkyz

» Dave Schmidt (Meta 1 Coin Scam) - SEC warns Meta 1 Coin scheme is ongoing despite Court orders
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyFri Apr 16, 2021 4:26 pm by PurpleSkyz

» Monopoly: An overview of the Great Reset – Follow the Money
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyFri Apr 16, 2021 3:56 pm by PurpleSkyz

» An Agenda That Is As Diabolical As It Is Unthinkable
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyFri Apr 16, 2021 3:52 pm by PurpleSkyz

» ‘Dead-Heads’, Garbage In Equals Garbage Out…
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyFri Apr 16, 2021 3:51 pm by PurpleSkyz




You are not connected. Please login or register

OUT OF MIND » MOTHER NATURE » SCIENCE & TECHNOLOGY » Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech

Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech

Go down  Message [Page 1 of 1]

PurpleSkyz

PurpleSkyz
Admin
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech


 Jan 30, 2019


A team of researchers at Columbia University has developed a speech brain-computer interface system that translates brain signals into intelligible, recognizable speech. By monitoring someone’s brain activity, the system can reconstruct the words a person hears with unprecedented clarity. The breakthrough, reported in the journal Scientific Reports, could lead to new ways for computers to communicate directly with the brain, and lays the groundwork for helping people who cannot speak.
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech Image_6862-Speech-Brain-Computer-Interface
Advance marks critical step toward brain-computer interface systems that hold immense promise for those with limited or no ability to speak. Image credit: Kai Kalhh.
“Our voices help connect us to our friends, family and the world around us, which is why losing the power of one’s voice due to injury or disease is so devastating. With today’s study, we have a potential way to restore that power. We’ve shown that, with the right technology, these people’s thoughts could be decoded and understood by any listener,” said senior author Dr. Nima Mesgarani, principal investigator in the Mortimer B. Zuckerman Mind Brain Behavior Institute at Columbia University.
Early efforts to decode brain signals by Dr. Mesgarani and colleagues focused on simple computer models that analyzed spectrograms, which are visual representations of sound frequencies.
But because this approach has failed to produce anything resembling intelligible speech, the team turned instead to a vocoder, a computer algorithm that can synthesize speech after being trained on recordings of people talking.
“This is the same technology used by Amazon Echo and Apple Siri to give verbal responses to our questions,” Dr. Mesgarani said.
“We asked epilepsy patients already undergoing brain surgery to listen to sentences spoken by different people, while we measured patterns of brain activity. These neural patterns trained the vocoder.”
Next, the researchers asked those same patients to listen to speakers reciting digits between 0 to 9, while recording brain signals that could then be run through the vocoder.
The sound produced by the vocoder in response to those signals was analyzed and cleaned up by neural networks, a type of artificial intelligence that mimics the structure of neurons in the biological brain. The end result was a robotic-sounding voice reciting a sequence of numbers.
To test the accuracy of the recording, the scientists tasked individuals to listen to the recording and report what they heard.
“We found that people could understand and repeat the sounds about 75% of the time, which is well above and beyond any previous attempts,” Dr. Mesgarani said.
“The improvement in intelligibility was especially evident when comparing the new recordings to the earlier, spectrogram-based attempts. The sensitive vocoder and powerful neural networks represented the sounds the patients had originally listened to with surprising accuracy.”
The study authors now plan to test more complicated words and sentences next, and they want to run the same tests on brain signals emitted when a person speaks or imagines speaking.
Ultimately, they hope their system could be part of an implant, similar to those worn by some epilepsy patients, that translates the wearer’s thoughts directly into words.
_____
Hassan Akbari et al. 2019. Towards reconstructing intelligible speech from the human auditory cortex. Scientific Reports 9, article number: 874; doi: 10.1038/s41598-018-37359-z

Thanks to: http://www.sci-news.com



  

Back to top  Message [Page 1 of 1]

Permissions in this forum:
You cannot reply to topics in this forum