During a press conference held virtually this afternoon, scientists at Elon Musk’s Neuralink gave a progress update. It came just over a year after the company, which was founded in 2016 with the goal of creating brain-machine interfaces, first revealed to the world its vision, software, and implantable hardware platform. Little of what was discussed today was surprising or necessarily unanticipated, but it provided assurances the pandemic hasn’t prevented Neuralink from inching toward its ambitious goals.
Neuralink’s prototype can extract real-time information from many neurons at once. During a live demo, Neuralink showed readings from a pig’s brain; when the pig touched an object with its snout, neurons captured by Neuralink’s technology fired in a visualization on a TV monitor. That isn’t novel in and of itself — Kernel and Paradromics are among the many outfits developing under-skull brain-reading chips — but Neuralink uniquely leverages flexible cellophane-like conductive wires inserted into tissue using a “sewing machine.” Neuralink says it received a Breakthrough Device designation in July and it’s working with the FDA on potential future human clinical trials.
It is the work of founding Neuralink members from the University of California Tim Hanson and Philip Sabes along with University of California, Berkeley professor Michel Maharbiz, and the version demonstrated today is an improvement over what was shown last year. Musk calls it “V2,” and he’s confident it’ll someday take less than an hour to embed within a human brain. He also says it’ll be easy to remove and leave no lasting damage, should a patient wish to upgrade or discard Neuralink’s interface.
Neuralink collaborated with Woke Studios, a creative design consultancy based in San Francisco, on the design of the sewing machine. Woke began working with Neuralink over a year ago on a behind-the-ear concept that Neuralink presented in 2019, and the two re-engaged shortly after for the surgical robot.
According to Woke head designer Afshin Mehin, machine is capable of seeing the entirety of the brain.
“The design process was a close collaboration between our design team at Woke Studios, the technologists at Neuralink, and prestigious surgical consultants who could advise on the procedure itself,” Mehin told VentureBeat. “Our role specifically was to take the existing technology that can perform the procedure, and hold that against the advice from our medical advisors as well as medical standards for this type of equipment, in order to create a non-intimidating robot that could perform the brain implantation.”
The machine consists of three parts. There’s a “head,” which houses automated surgical tools and brain-scanning cameras and sensors, against which a patient situates their skull. First, a device removes a portion of skull, and a device replaces the portion of skull that was removed. Then, computer vision algorithms guide a needle containing 5-micron-thick bundles of wires and insulation six millimeters into the brain, avoiding blood vessels. (Neuralink says the machine is technically capable of drilling to arbitrary lengths.) The wires — which measure a quarter of the diameter of a human hair (4 to 6 μm) — link to a series of electrodes at different locations and depths. At maximum capacity, the machine can insert six threads containing 192 electrodes per minute.
A single-use bag attaches with magnets around the machine’s head to maintain sterility and allow for cleaning, and angled wings around the inner facade ensure a patient’s skull remains in place during surgical insertion. machine’s “body” attaches onto a base, which provides weighted support for the entire structure, concealing the other technologies that enable the system to operate.
When asked about whether the prototype would ever make its way into clinics or hospitals, Mehin danced around the question, but noted that the design was intended for “broad-scale” use. “As engineers, we know what’s possible and how to communicate the design needs in an understandable way, and likewise, their team is able to send over highly complex schematics that we can run with,” he said. “We imagine this is a design that could live outside of a laboratory and into any number of clinical settings.”
The N1 chip
As Neuralink detailed last year, the first device designed for trials — the N1 — contains the aforementioned chip, a thin film, and a hermetic substrate that can interface with up to 1,024 electrodes. Up to 10 can be placed in one brain hemisphere, optimally at least four in the brain’s motor areas and one in a somatic sensory area.
Musk says the device is dramatically simplified compared with the version shown off last year. It no longer has to sit behind your ear, it’s the size of a large coin (23 millimeters wide an 8 millimeters tall), and the wires connect within a centimeter of the device itself.
The electrodes relay detected neural pulses to a processor placed on the surface of the skull that is able to read information from up to 1,536 channels, roughly 15 times better than current systems embedded in humans. It meets the baseline for scientific research and medical applications and is potentially superior to Belgian rival Imec’s Neuropixels technology, which can gather data from thousands of separate brain cells at once. Musk claims Neuralink’s commercial system could include as many as 3,072 electrodes per array across 96 threads.
The chip contains inertial measurement sensors, pressure sensors, and a battery that lasts “all day” and inductively charges, along with analog pixels, which amplify and filter neural signals before they’re converted into digital bits. (Neuralink claims the analog pixels are at least 5 times smaller than the known state of the art.) One analog pixel can capture the entire neural signals of 20,000 samples per second with 10 bits of resolution, resulting in 200Mbps of neural data for each of the 1,024 channels recorded.
Once the signals are amplified, they’re converted and digitized by on-chip analog-to-digital converters that directly characterize the shape of neuron pulses. According to Neuralink, it takes the N1 only 900 nanoseconds to compute incoming neural data.
The N1 will be connected via small wires under the scalp. This will pair wirelessly up to 10 meters through the skin to a battery-powered Bluetooth device called the Link. Neuralink says the implants will be configurable through a smartphone app and that patients might be able to control buttons and redirect outputs from the phone to a computer keyboard or mouse.
During the pig demo, Neuralink showed that it was able to predict the position of all of the animal’s limbs with “high accuracy.” The next step is writing to neurons — millions of neurons could be influenced with a single N1 sensor, according to Musk.
One of Neuralink’s aspirational goals is to allow a tetraplegic to type at 40 words per minute, said Musk. Eventually, he hopes Neuralink’s system will eventually be used to create what he describes as a “digital super-intelligent [cognitive] layer” that enables humans to “merge” with artificially intelligent software.
High-resolution brain-machine interfaces, or BCI for short, are predictably complicated — they must be able to read neural activity to pick out which groups of neurons are performing which tasks. Implanted electrodes are well-suited to this, but historically, hardware limitations have caused them to come into contact with more than one region of the brain or produce interfering scar tissue.
That has changed with the advent of fine biocompatible electrodes, which limit scarring and can target cell clusters with precision (though questions around durability remain). What hasn’t changed is a lack of understanding about certain neural processes.
Rarely is activity isolated in brain regions, such as the prefrontal lobe and hippocampus. Instead, it takes place across various brain regions, making it difficult to pin down. Then there’s the matter of translating neural electrical impulses into machine-readable information; researchers have yet to crack the brain’s encoding. Pulses from the visual center aren’t like those produced when formulating speech, and it is sometimes difficult to identify signals’ origination points.
It’ll also be incumbent on Neuralink to convince regulators to approve its device for clinical trials. Brain-computer interfaces are considered medical devices requiring consent from the U.S. Food and Drug Administration, and obtaining that consent can be time-consuming and costly.
Perhaps anticipating this, Neuralink has expressed interest in opening its own animal testing facility in San Francisco, and the company last month publishing a job listing for candidates with experience in phones and wearables. Last year, Neuralink claimed it performed 19 surgeries on animals and successfully placed wires about 87% of the time.
The road ahead
All these challenges haven’t discouraged Neuralink, which has over 90 employees and has received $158 million in funding including at least $100 million from Musk. However, they’ve potentially been exacerbated by what STAT News described in a report as a “chaotic internal culture.” Responding to the story via a New York Post inquiry, a Neuralink spokesperson said many of STAT’s findings were “either partially or completely false.”
While Neuralink expects that inserting the electrodes will initially require drilling holes through the skull, it hopes to soon use a laser to pierce bone with a series of small holes, which might lay the groundwork got research into alleviating conditions like Parkinson’s and epilepsy and helping physically disabled patients hear, speak, move, and see.
That’s less far-fetched than it might sound. Columbia University neuroscientists have successfully translated brain waves into recognizable speech. A team at the University of California, San Francisco built a virtual vocal tract capable of simulating human verbalization by tapping into the brain. In 2016, a brain implant allowed an amputee to use their thoughts to move the individual fingers of a prosthetic hand. And experimental interfaces have allowed monkeys to control wheelchairs and type at 12 words a minute using only their minds.
Credit: Source link