#human computer interface

[scipunk]

GANTZ: O (2016)

[kenyatta]

Computer system transcribes words users “speak silently” | MIT News

MIT researchers have developed a computer interface that can transcribe words that the user verbalizes internally but does not actually speak aloud.

The system consists of a wearable device and an associated computing system. Electrodes in the device pick up neuromuscular signals in the jaw and face that are triggered by internal verbalizations — saying words “in your head” — but are undetectable to the human eye. The signals are fed to a machine-learning system that has been trained to correlate particular signals with particular words.

The device also includes a pair of bone-conduction headphones, which transmit vibrations through the bones of the face to the inner ear. Because they don’t obstruct the ear canal, the headphones enable the system to convey information to the user without interrupting conversation or otherwise interfering with the user’s auditory experience.

The device is thus part of a complete silent-computing system that lets the user undetectably pose and receive answers to difficult computational problems. In one of the researchers’ experiments, for instance, subjects used the system to silently report opponents’ moves in a chess game and just as silently receive computer-recommended responses.

[noosphe-re]

Mouse—screen. Hand—world. Click—select. Wave—browse.

Ahmed Salman

[scifigeneration]

How you and your friends can play a video game together using only your minds

Telepathic communication might be one step closer to reality thanks to new research from the University of Washington. A team created a method that allows three people to work together to solve a problem using only their minds.

In BrainNet, three people play a Tetris-like game using a brain-to-brain interface. This is the first demonstration of two things: a brain-to-brain network of more than two people, and a person being able to both receive and send information to others using only their brain. The team published its results April 16 in the Nature journal Scientific Reports, though this research previously attracted media attention after the researchers posted it September to the preprint site arXiv.

“Humans are social beings who communicate with each other to cooperate and solve problems that none of us can solve on our own,” said corresponding author Rajesh Rao, the CJ and Elizabeth Hwang professor in the UW’s Paul G. Allen School of Computer Science & Engineering and a co-director of the Center for Neurotechnology. “We wanted to know if a group of people could collaborate using only their brains. That’s how we came up with the idea of BrainNet: where two people help a third person solve a task.”

As in Tetris, the game shows a block at the top of the screen and a line that needs to be completed at the bottom. Two people, the Senders, can see both the block and the line but can’t control the game. The third person, the Receiver, can see only the block but can tell the game whether to rotate the block to successfully complete the line. Each Sender decides whether the block needs to be rotated and then passes that information from their brain, through the internet and to the brain of the Receiver. Then the Receiver processes that information and sends a command — to rotate or not rotate the block — to the game directly from their brain, hopefully completing and clearing the line.

The team asked five groups of participants to play 16 rounds of the game. For each group, all three participants were in different rooms and couldn’t see, hear or speak to one another.

The Senders each could see the game displayed on a computer screen. The screen also showed the word “Yes” on one side and the word “No” on the other side. Beneath the “Yes” option, an LED flashed 17 times per second. Beneath the “No” option, an LED flashed 15 times a second.

“Once the Sender makes a decision about whether to rotate the block, they send ‘Yes’ or ‘No’ to the Receiver’s brain by concentrating on the corresponding light,” said first author Linxing Preston Jiang, a student in the Allen School’s combined bachelor’s/master’s degree program.

The Senders wore electroencephalography caps that picked up electrical activity in their brains. The lights’ different flashing patterns trigger unique types of activity in the brain, which the caps can pick up. So, as the Senders stared at the light for their corresponding selection, the cap picked up those signals, and the computer provided real-time feedback by displaying a cursor on the screen that moved toward their desired choice. The selections were then translated into a “Yes” or “No” answer that could be sent over the internet to the Receiver.

“To deliver the message to the Receiver, we used a cable that ends with a wand that looks like a tiny racket behind the Receiver’s head. This coil stimulates the part of the brain that translates signals from the eyes,” said co-author Andrea Stocco, a UW assistant professor in the Department of Psychology and the Institute for Learning & Brain Sciences, or I-LABS. “We essentially ‘trick’ the neurons in the back of the brain to spread around the message that they have received signals from the eyes. Then participants have the sensation that bright arcs or objects suddenly appear in front of their eyes.”

If the answer was, “Yes, rotate the block,” then the Receiver would see the bright flash. If the answer was “No,” then the Receiver wouldn’t see anything. The Receiver received input from both Senders before making a decision about whether to rotate the block. Because the Receiver also wore an electroencephalography cap, they used the same method as the Senders to select yes or no.

The Senders got a chance to review the Receiver’s decision and send corrections if they disagreed. Then, once the Receiver sent a second decision, everyone in the group found out if they cleared the line. On average, each group successfully cleared the line 81% of the time, or for 13 out of 16 trials.

The researchers wanted to know if the Receiver would learn over time to trust one Sender over the other based on their reliability. The team purposely picked one of the Senders to be a “bad Sender” and flipped their responses in 10 out of the 16 trials — so that a “Yes, rotate the block” suggestion would be given to the Receiver as “No, don’t rotate the block,” and vice versa. Over time, the Receiver switched from being relatively neutral about both Senders to strongly preferring the information from the “good Sender.”

The team hopes that these results pave the way for future brain-to-brain interfaces that allow people to collaborate to solve tough problems that one brain alone couldn’t solve. The researchers also believe this is an appropriate time to start to have a larger conversation about the ethics of this kind of brain augmentation research and developing protocols to ensure that people’s privacy is respected as the technology improves. The group is working with the Neuroethics team at the Center for Neurotechnology to address these types of issues.

“But for now, this is just a baby step. Our equipment is still expensive and very bulky and the task is a game,” Rao said. “We’re in the ‘Kitty Hawk’ days of brain interface technologies: We’re just getting off the ground.”

Co-authors include Darby Losey, a graduate student at Carnegie Mellon University who completed this research as a UW undergraduate in computer science and neurobiology; Justin Abernethy, a research assistant at I-LABS; and Chantel Prat, an associate professor in the Department of Psychology and I-LABS. This research was funded by the National Science Foundation, a W.M. Keck Foundation Award and a Levinson Emerging Scholars Award.

[scifigeneration]

Ultra-small nanoprobes could be a leap forward in high-resolution human-machine interfaces

Machine enhanced humans -- or cyborgs as they are known in science fiction -- could be one step closer to becoming a reality, thanks to new research Lieber Group at Harvard University, as well as scientists from University of Surrey and Yonsei University.

Researchers have conquered the monumental task of manufacturing scalable nanoprobe arrays small enough to record the inner workings of human cardiac cells and primary neurons.

The ability to read electrical activities from cells is the foundation of many biomedical procedures, such as brain activity mapping and neural prosthetics. Developing new tools for intracellular electrophysiology (the electric current running within cells) that push the limits of what is physically possible (spatiotemporal resolution) while reducing invasiveness could provide a deeper understanding of electrogenic cells and their networks in tissues, as well as new directions for human-machine interfaces.

In a paper published by Nature Nanotechnology, scientists from Surrey's Advanced Technology Institute (ATI) and Harvard University detail how they produced an array of the ultra-small U-shaped nanowire field-effect transistor probes for intracellular recording. This incredibly small structure was used to record, with great clarity, the inner activity of primary neurons and other electrogenic cells, and the device has the capacity for multi-channel recordings.

Dr Yunlong Zhao from the ATI at the University of Surrey said: "If our medical professionals are to continue to understand our physical condition better and help us live longer, it is important that we continue to push the boundaries of modern science in order to give them the best possible tools to do their jobs. For this to be possible, an intersection between humans and machines is inevitable.

"Our ultra-small, flexible, nanowire probes could be a very powerful tool as they can measure intracellular signals with amplitudes comparable with those measured with patch clamp techniques; with the advantage of the device being scalable, it causes less discomfort and no fatal damage to the cell (cytosol dilation). Through this work, we found clear evidence for how both size and curvature affect device internalisation and intracellular recording signal."

Professor Charles Lieber from the Department of Chemistry and Chemical Biology at Harvard University said: "This work represents a major step towards tackling the general problem of integrating 'synthesised' nanoscale building blocks into chip and wafer scale arrays, and thereby allowing us to address the long-standing challenge of scalable intracellular recording.

"The beauty of science to many, ourselves included, is having such challenges to drive hypotheses and future work. In the longer term, we see these probe developments adding to our capabilities that ultimately drive advanced high-resolution brain-machine interfaces and perhaps eventually bringing cyborgs to reality."

Professor Ravi Silva, Director of the ATI at the University of Surrey, said: "This incredibly exciting and ambitious piece of work illustrates the value of academic collaboration. Along with the possibility of upgrading the tools we use to monitor cells, this work has laid the foundations for machine and human interfaces that could improve lives across the world."

Dr Yunlong Zhao and his team are currently working on novel energy storage devices, electrochemical probing, bioelectronic devices, sensors and 3D soft electronic systems. Undergraduate, graduate and postdoc students with backgrounds in energy storage, electrochemistry, nanofabrication, bioelectronics, tissue engineering are very welcome to contact Dr Zhao to explore the opportunities further.

[cybernetic-world]

https://blogs.scientificamerican.com/cross-check/are-cyborg-warriors-a-good-idea/?utm_medium=social&utm_content=organic&utm_source=twitter&utm_campaign=SciAm_&sf207531968=1

[kenyatta]

Cortical control of a tablet computer by people with paralysis

General-purpose computers have become ubiquitous and important for everyday life, but they are difficult for people with paralysis to use. Specialized software and personalized input devices can improve access, but often provide only limited functionality. In this study, three research participants with tetraplegia who had multielectrode arrays implanted in motor cortex as part of the BrainGate2 clinical trial used an intracortical brain-computer interface (iBCI) to control an unmodified commercial tablet computer. Neural activity was decoded in real time as a point-and-click wireless Bluetooth mouse, allowing participants to use common and recreational applications (web browsing, email, chatting, playing music on a piano application, sending text messages, etc.). Two of the participants also used the iBCI to “chat” with each other in real time. This study demonstrates, for the first time, high-performance iBCI control of an unmodified, commercially available, general-purpose mobile computing device by people with tetraplegia.

[kyreniacommentator]

A ray of hope for paralysis patients

A ray of hope for paralysis patients

  By Ahmet Abdulaziz …..

Murat Arslan and Senol Korkmaz, engineers at the Innovation and Information Technologies Centre, at the Near East University, have developed a novel Human Computer Interface (HCI) that can be used by head and eye movements without needing a physical touch. (more…)

View On WordPress