“I’m holding in my hand a chip with one million neurons, 256 million synapses, and 4096 cores. With 5.4 billion transistors, it’s the largest chip IBM has built.”
Dr. Dharmendra S. Modha sounds positively giddy as he talks to me on the phone. This is the third time I’ve talked to him about his long-term project – an IBM project with the goal of creating an entirely new type of computer chip, SyNAPSE, whose architecture is inspired by the human brain. This new chip is a major success in that project.
“Inspired” is the key word, though. The chip’s architecture is based on the structure of our brains, but very simplified. Still, within that architecture lies some amazing advantages over computers today. For one thing, despite this being IBM’s largest chip, it draws only a tiny amount of electricity – about 63 mW – a fraction of the power being drawn by the chip in your laptop.
What’s more, the new chip is also scalable – making possible larger neural networks of several chips connected together. The details behind their research has been published today in Science.
“In 2011,
we had a chip with one core,” Modha told me. “We have now scaled that to 4096 cores, while shrinking each core 15x by area and 100x by power.”
we had a chip with one core,” Modha told me. “We have now scaled that to 4096 cores, while shrinking each core 15x by area and 100x by power.”
Each core of the chip is modeled on a simplified version of the brain’s neural architecture. The core contains 256 “neurons” (processors), 256 “axons” (memory) and 64,000 “synapses” (communications between neurons and axons). This structure is a radical departure from the von Neumann architecture that’s the basis of virtually every computer today (including the one you’re reading this on.)
Work on this project began in 2008 in a collaboration between IBM and several universities over the years. The project has received $53 million in funding from the Defense Advanced Research Projects Agency (DARPA). The first prototype chip was developed in 2011, and a programming language and development kit was released in 2013.
“This new chip will provide a powerful tool to researchers who are studying algorithms that use spiking neurons,” Dr. Terrence J. Sejnowski told me. Sejnowski heads Computational Neurobiology Laboratory at the Salk Institute. He’s unaffiliated with IBM’s project but is familiar with the technology. “We know that such algorithms exist because the brain uses spiking neurons and can outperform all existing approaches, with a power budget of 20 watts, less than your laptop.”
It’s important to note, though, that the SyNAPSE system won’t replace the computers of today – rather, they’re intended to supplement them. Modha likened them to co-processors used in high performance computers to help them crunch data faster. Or, in a more poetic turn as he continued talking to me, he called SyNAPSE a “right-brained” computer compared to the “left-brained” architecture used in computers today.
“Current von Neumann machines are fast, symbolic, number-crunchers,” he said. “SyNAPSE is slow, multi-sensory, and better at recognizing sensor data in real-time.”
So to crunch big numbers and do heavy computational lifting, we’ll still need conventional computers. Where these “cognitive” computers come in is in analyzing and discerning patterns in that data. Key applications include visual recognition of patterns – something that Dr. Modha notes would be very useful for applications such as driverless cars.
As Sejnowski told me, “The future is finding a path to low power computing that solves problems in sensing and moving — what we do so well and digital computers do so awkwardly.”
SOURCE: Tech News
Has laoreet percipitur ad. Vide interesset in mei, no his legimus verterem. Et nostrum imperdiet appellantur usu, mnesarchum referrentur id vim.
0 comments:
Post a Comment