OUT OF MIND
Would you like to react to this message? Create an account in a few clicks or log in to continue.
Latest topics
» 24-Year-Old Irish Athlete Dillon Quirke Dies Unexpectedly After Collapsing Mid-Game
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyYesterday at 6:48 pm by PurpleSkyz

» Ou Yang Li-hsing Found Dead in Hotel Room…After Pelosi’s Visit…Heart Attack?
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyYesterday at 6:44 pm by PurpleSkyz

» Find Out if You’re Eligible for Part of the $90M Facebook Data Tracking Settlement
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyYesterday at 10:03 am by PurpleSkyz

» The “Unvaccinated” Question (Revisited)
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyYesterday at 8:48 am by PurpleSkyz

» These people are nuts: Reuters Links Deadly DC Lightning Strike To Global Warming
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyYesterday at 8:44 am by PurpleSkyz

» Thousands of Jabbed Teenage Girls Are Developing Tics, Doctors Baffled
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyYesterday at 8:34 am by PurpleSkyz

» EUDRA Stats thru July 30th 2022
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyYesterday at 8:21 am by PurpleSkyz

» US Declares Monkeypox Public Health Emergency – Big Pharma Ready for Windfall Profits, Again
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyYesterday at 7:56 am by PurpleSkyz

» Good Samaritans Fined, Threatened with Arrest for Pulling Government Litter Out of a River
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyYesterday at 7:52 am by PurpleSkyz

» MRNA 'VACCINE' GENOCIDE 2021-2022: TESTIMONIES FROM THE VICTIMS AND MEDICAL STAFF
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyWed Aug 03, 2022 10:17 am by PurpleSkyz

» Mysterious metallic orb containing a secret code inside falls on Veracruz, Mexico
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyWed Aug 03, 2022 10:10 am by PurpleSkyz

» 10,000% Increase in Cancers Following COVID-19 Vaccines as Doctors and Scientists Worldwide Sound the Alarm
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyWed Aug 03, 2022 9:55 am by PurpleSkyz

» Good People Doing Good Things – Dr. Sanduk Ruit & Dr. Geoffrey Tabin
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyWed Aug 03, 2022 9:48 am by PurpleSkyz

» UK Government admits 19 million Brits remain Unvaccinated & 30 million Brits have refused the COVID Booster Jab
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyWed Aug 03, 2022 9:38 am by PurpleSkyz

» New Details on Paul Pelosi Arrest Reveal He Allegedly Had More Than Just Alcohol in His System
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyWed Aug 03, 2022 9:31 am by PurpleSkyz

» WORLD PREMIERE: These Little Ones
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyWed Aug 03, 2022 8:49 am by PurpleSkyz

» China Summons US Ambassador Overnight, Says Washington “Must Pay The Price”
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyWed Aug 03, 2022 1:14 am by PurpleSkyz

» Bright Green Meteors Seem to Be Raining Down on New Zealand, But Why?
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyWed Aug 03, 2022 1:10 am by PurpleSkyz

»  Cosmic Buckyballs Could Be The Source of Mysterious Infrared Light
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyWed Aug 03, 2022 1:07 am by PurpleSkyz

» Consciousness may persist after death, study suggests
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyWed Aug 03, 2022 1:04 am by PurpleSkyz

» Connecticut’s Largest Solar Power Plant Completed
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyWed Aug 03, 2022 12:53 am by PurpleSkyz

» Here’s Another ‘Great Reset’ Tool Designed to Wipe Out Good Food
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech EmptyWed Aug 03, 2022 12:48 am by PurpleSkyz

You are not connected. Please login or register

OUT OF MIND » THE INSANITY OF REALITY » SCIENCE & TECHNOLOGY » Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech

Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech

Go down  Message [Page 1 of 1]

PurpleSkyz

PurpleSkyz
Admin

Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech


 Jan 30, 2019


A team of researchers at Columbia University has developed a speech brain-computer interface system that translates brain signals into intelligible, recognizable speech. By monitoring someone’s brain activity, the system can reconstruct the words a person hears with unprecedented clarity. The breakthrough, reported in the journal Scientific Reports, could lead to new ways for computers to communicate directly with the brain, and lays the groundwork for helping people who cannot speak.
Experimental Brain-Computer Interface Translates Brain Signals into Recognizable Speech Image_6862-Speech-Brain-Computer-Interface
Advance marks critical step toward brain-computer interface systems that hold immense promise for those with limited or no ability to speak. Image credit: Kai Kalhh.
“Our voices help connect us to our friends, family and the world around us, which is why losing the power of one’s voice due to injury or disease is so devastating. With today’s study, we have a potential way to restore that power. We’ve shown that, with the right technology, these people’s thoughts could be decoded and understood by any listener,” said senior author Dr. Nima Mesgarani, principal investigator in the Mortimer B. Zuckerman Mind Brain Behavior Institute at Columbia University.
Early efforts to decode brain signals by Dr. Mesgarani and colleagues focused on simple computer models that analyzed spectrograms, which are visual representations of sound frequencies.
But because this approach has failed to produce anything resembling intelligible speech, the team turned instead to a vocoder, a computer algorithm that can synthesize speech after being trained on recordings of people talking.
“This is the same technology used by Amazon Echo and Apple Siri to give verbal responses to our questions,” Dr. Mesgarani said.
“We asked epilepsy patients already undergoing brain surgery to listen to sentences spoken by different people, while we measured patterns of brain activity. These neural patterns trained the vocoder.”
Next, the researchers asked those same patients to listen to speakers reciting digits between 0 to 9, while recording brain signals that could then be run through the vocoder.
The sound produced by the vocoder in response to those signals was analyzed and cleaned up by neural networks, a type of artificial intelligence that mimics the structure of neurons in the biological brain. The end result was a robotic-sounding voice reciting a sequence of numbers.
To test the accuracy of the recording, the scientists tasked individuals to listen to the recording and report what they heard.
“We found that people could understand and repeat the sounds about 75% of the time, which is well above and beyond any previous attempts,” Dr. Mesgarani said.
“The improvement in intelligibility was especially evident when comparing the new recordings to the earlier, spectrogram-based attempts. The sensitive vocoder and powerful neural networks represented the sounds the patients had originally listened to with surprising accuracy.”
The study authors now plan to test more complicated words and sentences next, and they want to run the same tests on brain signals emitted when a person speaks or imagines speaking.
Ultimately, they hope their system could be part of an implant, similar to those worn by some epilepsy patients, that translates the wearer’s thoughts directly into words.
_____
Hassan Akbari et al. 2019. Towards reconstructing intelligible speech from the human auditory cortex. Scientific Reports 9, article number: 874; doi: 10.1038/s41598-018-37359-z

Thanks to: http://www.sci-news.com



  

Back to top  Message [Page 1 of 1]

Permissions in this forum:
You cannot reply to topics in this forum