Meta unveils wristband for controlling computers with hand gestures

The Star

4 days ago

SAN FRANCISCO: The prototype looks like a giant rectangular wristwatch. But it doesn't tell the time: It lets you control a computer from across the room simply by moving your hand.
With a gentle turn of the wrist, you can push a cursor across your laptop screen. If you tap your thumb against your forefinger, you can open an app on your desktop computer. And when you write your name in the air, as if you were holding a pencil, the letters will appear on your smartphone.
Designed by researchers at Meta, the tech giant that owns Facebook, Instagram and WhatsApp, this experimental technology reads the electrical signals that pulse through your muscles when you move your fingers. These signals, generated by commands sent from your brain, can reveal what you are about to do even before you do it, as the company detailed in a research paper published Wednesday in the journal Nature .
With a little practice, you can even move your laptop cursor simply by producing the right thought. 'You don't have to actually move,' Thomas Reardon, the Meta vice president of research who leads the project, said in an interview. 'You just have to intend the move.'
Meta's wristband is part of a sweeping effort to develop technologies that let wearers control their personal devices without touching them. The aim is to provide simpler, quicker and less awkward ways of interacting with everything from laptops to smartphones – and maybe even to develop new digital devices that replace what we all use today.
Most of these technologies are years away from widespread use. They typically involve tiny devices surgically implanted in the body, which is a complicated and risky endeavor. These implants are tested solely with disabled people who cannot move their arms and hands, and need new ways of using computers or smartphones.
Neuralink, a Silicon Valley startup founded by Elon Musk, aims to implant chips under the skull, beside the brain. Synchron, run by an Australian neurologist, hopes to implant devices inside blood vessels in the neck. These efforts, like those of many other startups, aim to read brain activity directly – an enormously complex process that must be tailored to the individual.
Meta is taking a simpler approach. Its technology does not require surgery. Anyone can strap on the device and start using it. Using artificial intelligence techniques, Reardon and his team have identified common electrical signals that appear when a person moves a finger, wrist or thumb.
'This idea – this kind of technology – is not new, it is decades old,' said Dario Farina, a professor of bioengineering at Imperial College, London, who has tested the technology but was not involved in the research. 'The breakthrough here is that Meta has used artificial intelligence to analyse very large amounts of data, from thousands of individuals, and make this technology robust. It now performs at a level it has never reached before.'
Meta's wristband uses a technique called electromyography, or EMG, to gather electrical signals from muscles in the forearm. These signals are produced by neurons in the spinal cord – called alpha motor neurons – that connect to individual muscle fibers.
Because these neurons connect directly to the muscle fibers, the electrical signals are particularly strong – so strong that they can be read from outside the skin. The signal also moves much faster than the muscles. If a device like Meta's wristband can read the signals, it can type much faster than your fingers.
'We can see the electrical signal before you finger even moves,' Reardon said.
EMG has long provided a way for amputees to control prosthetic hands. But technologies that use the technique as a computer interface are only beginning to mature.
In 2012, three Canadian entrepreneurs founded a company called Thalmic Labs, which built an armband called Myo that sent simple computer commands using hand gestures. With the swipe of a hand, for instance, you could switch to a new slide in a PowerPoint presentation. But the company discontinued the product several years later.
Reardon started similar research after founding a company called Ctrl Labs with two other neuroscientists he had met in a Ph.D. program at Columbia University. In 2019, the startup was acquired by Meta, where it now operates within a research operation called Reality Labs.
Although Reardon and his colleagues have been privately demonstrating their technology for years, they are only now beginning to publicly share their work because it is now mature enough for the marketplace. The key development is the use of AI techniques to analyse the EMG signals.
After collecting these signals from 10,000 people who agreed to test the prototype, Reardon used a machine learning system called a neural network – the same breed of AI that drives ChatGPT – to identify common patterns in this data. Now, it can look for these same patterns even when a different person is using the device.
'Out of the box, it can work with a new user it has never seen data for,' said Patrick Kaifosh, director of research science at Reality Labs and one of the neuroscientists that founded Ctrl Labs.
According to Reardon, who is also known as the founding father of the Internet Explorer web browser at Microsoft, Meta plans to fold the technology into products over the next few years. Last fall, the company demonstrated how its wristband could be used to control an experimental version of its smart glasses, which can take photos, record videos, play music and verbally describe the world around you.
Like technologies from Neuralink and Synchron, Meta's wristband could also provide new options for disabled people. Researchers at Carnegie Mellon are testing the wristband with people who have spinal cord injuries, allowing them to use smartphones and computers even though they do not have full use of their arms or hands.
Most people with these types of injuries retain the ability to activate at least some of their muscle fibers. This allows the device to read what their brain is trying to do, even though their bodies can't actually make it happen.
'We can see their intention to type,' said Douglas Weber, a professor of mechanical engineering and neuroscience at Carnegie Mellon.
In a similar way, Meta's wristband lets you control a computer with the appropriate thought. Merely thinking about a movement is not enough. But if you intend to make a movement, the wristband can pick up on what you aim to do – even if you do not physically move.
'It feels like the device is reading your mind, but it is not,' Reardon said. 'It is just translating your intention. It sees what you are about to do.'
When you move your arm or hand or finger, the number of muscle fibers you activate varies depending on how big or how small the movement is. If you practice using the wristband long enough, you can learn to activate a tiny number of fibers without actually moving your fingers.
'We can listen to a single neuron. We are working at the atomic level of the nervous system.' – ©2025 The New York Times Company
This article originally appeared in The New York Times.