The Future of Computing: Brain-Like Computers

neuronsIt’s no secret that computer scientists and engineers are looking to the human brain as means of achieving the next great leap in computer evolution. Already, machines are being developed that rely on machine blood, can continue working despite being damaged, and recognize images and speech. And soon, a computer chip that is capable of learning from its mistakes will also be available.

The new computing approach, already in use by some large technology companies, is based on the biological nervous system – specifically on how neurons react to stimuli and connect with other neurons to interpret information. It allows computers to absorb new information while carrying out a task, and adjust what they do based on the changing signals.

brain_chip2The first commercial version of the new kind of computer chip is scheduled to be released in 2014, and was the result of a collaborative effort between I.B.M. and Qualcomm, as well as a Stanford research team. This “neuromorphic processor” can not only automate tasks that once required painstaking programming, but can also sidestep and even tolerate errors, potentially making the term “computer crash” obsolete.

In coming years, the approach will make possible a new generation of artificial intelligence systems that will perform some functions that humans do with ease: see, speak, listen, navigate, manipulate and control. That can hold enormous consequences for tasks like facial and speech recognition, navigation and planning, which are still in elementary stages and rely heavily on human programming.

googleneuralnetworkFor example, computer vision systems only “recognize” objects that can be identified by the statistics-oriented algorithms programmed into them. An algorithm is like a recipe, a set of step-by-step instructions to perform a calculation. But last year, Google researchers were able to get a machine-learning algorithm, known as a “Google Neural Network”, to perform an identification task (involving cats) without supervision.

And this past June, the company said it had used those neural network techniques to develop a new search service to help customers find specific photos more accurately. And this past November, researchers at Standford University came up with a new algorithm that could give computers the power to more reliably interpret language. It’s known as the Neural Analysis of Sentiment (NaSent).

deep_learning_laptopA similar concept known as Deep Leaning is also looking to endow software with a measure of common sense. Google is using this technique with their voice recognition technology to aid in performing searches. In addition, the social media giant Facebook is looking to use deep learning to help them improve Graph Search, an engine that allows users to search activity on their network.

Until now, the design of computers was dictated by ideas originated by the mathematician John von Neumann about 65 years ago. Microprocessors perform operations at lightning speed, following instructions programmed using long strings of binary code (0s and 1s). The information is stored separately in what is known as memory, either in the processor itself, in adjacent storage chips or in higher capacity magnetic disk drives.

neural-networksBy contrast, the new processors consist of electronic components that can be connected by wires that mimic biological synapses. Because they are based on large groups of neuron-like elements, they are known as neuromorphic processors, a term credited to the California Institute of Technology physicist Carver Mead, who pioneered the concept in the late 1980s.

These processors are not “programmed”, in the conventional sense. Instead, the connections between the circuits are “weighted” according to correlations in data that the processor has already “learned.” Those weights are then altered as data flows in to the chip, causing them to change their values and to “spike.” This, in turn, strengthens some connections and weakens others, reacting much the same way the human brain does.

Neuromorphic-chip-640x353In the words of Dharmendra Modha, an I.B.M. computer scientist who leads the company’s cognitive computing research effort:

Instead of bringing data to computation as we do today, we can now bring computation to data. Sensors become the computer, and it opens up a new way to use computer chips that can be everywhere.

One great advantage of the new approach is its ability to tolerate glitches, whereas traditional computers are cannot work around the failure of even a single transistor. With the biological designs, the algorithms are ever changing, allowing the system to continuously adapt and work around failures to complete tasks. Another benefit is energy efficiency, another inspiration drawn from the human brain.

IBM_stacked3dchipsThe new computers, which are still based on silicon chips, will not replace today’s computers, but augment them; at least for the foreseeable future. Many computer designers see them as coprocessors, meaning they can work in tandem with other circuits that can be embedded in smartphones and the centralized computers that run computing clouds.

However, the new approach is still limited, thanks to the fact that scientists still do not fully understand how the human brain functions. As Kwabena Boahen, a computer scientist who leads Stanford’s Brains in Silicon research program, put it:

We have no clue. I’m an engineer, and I build things. There are these highfalutin theories, but give me one that will let me build something.

calit2PhotoLuckily, there are efforts underway that are designed to remedy this, with the specific intention of directing that knowledge towards the creation of better computers and AIs. One such effort comes from the National Science Foundation financed the Center for Brains, Minds and Machines, a new research center based at the Massachusetts Institute of Technology, with Harvard and Cornell.

Another is the California Institute for Telecommunications and Information Technology (aka. Calit2) – a center dedicated to innovation in nanotechnology, life sciences, information technology, and telecommunications. As
Larry Smarr, an astrophysicist and director of Institute, put it:

We’re moving from engineering computing systems to something that has many of the characteristics of biological computing.

Human-Brain-project-Alp-ICTAnd last, but certainly not least, is the Human Brain Project, an international group of 200 scientists from 80 different research institutions and based in Lausanne, Switzerland. Having secured the $1.6 billion they need to fund their efforts, these researchers will spend the next ten years conducting research that cuts across multiple disciplines.

This initiative, which has been compared to the Large Hadron Collider, will attempt to reconstruct the human brain piece-by-piece and gradually bring these cognitive components into an overarching supercomputer. The expected result of this research will be new platforms for “neuromorphic computing” and “neurorobotics,” allowing for the creation of computing and robotic architectures that mimic the functions of the human brain.

neuromorphic_revolutionWhen future generations look back on this decade, no doubt they will refer to it as the birth of the neuromophic computing revolution. Or maybe just Neuromorphic Revolution for short, but that sort of depends on the outcome. With so many technological revolutions well underway, it is difficult to imagine how the future will look back and characterize this time.

Perhaps, as Charles Stross suggest, it will simply be known as “the teens”, that time in pre-Singularity history where it was all starting to come together, but was yet to explode and violently change everything we know. I for one am looking forward to being around to witness it all!

Sources: nytimes.com, technologyreview.com, calit2.net, humanbrainproject.eu

Dead in Space: Government Shutdown, NASA and Mars

marsAs the government shutdown goes into its second week, there is growing concern over how it is affecting crucial programs and services. And its certainly no secret that a number of federally-funded organizations are worried about how it will affect their long term goals. One such organization is NASA, who has seen much of its operations frozen while the US government attempts to work out its differences.

In addition to 97% of NASA’s 18,000 employees being off the job, its social media accounts and website going dark, and its television channel being shut down, activities ranging from commercial crew payouts, conferences, and awards and scholarship approvals are all being delayed as well. Luckily, certain exemptions are being made when it comes to crucial work on Mars.

NASA_mavenThese include the Mars Atmosphere and Volatile EvolutioN (MAVEN) orbiter. Following two days of complete work stoppage, technicians working on the orbiter were granted an exemption and permitted to continue prepping it for launch. And not a moment too soon, seeing as how a continued shutdown would have caused the orbiter to miss its crucial launch window.

Designed to survey the Martian atmosphere while orbiting the planet, NASA hopes that MAVEN will provide some clues as to what became of the planet’s onetime atmosphere. MAVEN was been scheduled to blast off for the Red Planet on Nov.18 atop an Atlas V rocket from the Florida Space Coast until those plans were derailed by the start of the government shutdown that began at midnight, Oct. 1.

But as Prof. Bruce Jakosky, MAVEN’s chief scientist, stated in an interview just two days later:

We have already restarted spacecraft processing at the Kennedy Space Center (KSC) today. [Today, we] determined that MAVEN meets the requirements allowing an emergency exception relative to the Anti-Deficiency Act.

Curiosity-roverAnother merciful exception to the shutdown has been the Curiosity Rover. Since contract workers at NASA’s Jet Propulsion Laboratory (JPL) oversee the rover’s mission, the Curiosity team is not subject to the same furloughs as other NASA employees. At JPL, the technicians and workers at the lab are employed by the California Institute of Technology, and are therefore able to keep the mission going.

However, the management at JPL and Cal Tech will continue to assess the situation on a weekly basis, and it’s possible the team may not remain completely intact in the event of a prolonged shutdown. This would be particularly detrimental for Curiosity since the Mars rover requires daily maintenance by scientists, engineers and programmers and cannot run on autopilot.

curiosity_sol-177-1As Veronica McGregor, a media relations manager at JPL, said in a recent interview:

Right now, things continue on as normal. Curiosity is one where they literally look at the data each day, sit down, create a plan, decide what science instrument is going to be used tomorrow, they write software for it and upload it. [It’s] is kind of a unique mission in that way.

Other programs running out JPL will also continue. These include the Opportunity and Odyssey rovers, the Mars Reconnaissance Orbiter, the HiRISE camera, Dawn, Juno, and Spitzer space probes, and the Voyager satellites, APL, MESSENGER, and New Horizons.  In addition, operations aboard the International Space Station will continue, but with the bare minimum of ground crew support.

cassini_spaceprobeRobotic missions that are already in operation – such as the Cassini spacecraft circling Saturn, or the Lunar Atmosphere and Dust Environment Explorer (LADEE) winging its way to the moon – will have small crews making sure that they are functioning properly. However, no scientific analysis will be conducted during the shutdown period.

As the shutdown continues, updates on which programs are still in operation, which ones will need to be discontinued, and how they will be affected will continue to be made available. One can only hope the politically-inspired deadlock will not become a prolonged affair. It’s not just current programs that are being affected after all.

Consider the proposed 2030 manned mission to Mars, or the plans to tow an asteroid closer to Earth. I can’t imagine how awful it would be if they were delayed or mothballed due to budget constraints. Politics… bah!

Sources: universetoday.com, (2), mashable.com