A New Method of Artificial Intelligence Inspired by the Functioning of the Human Brain
Researchers at the University of Liège have developed a new algorithm based on a biological mechanism called neuromodulation, making it possible to create intelligent agents capable of performing tasks not encountered during training
Despite the immense progress in the field of AI in recent years, we are still very far from human intelligence. Indeed, if current AI techniques allow to train computer agents to perform certain tasks better than humans when they are trained specifically for them, the performance of these same agents is often very disappointing when they are put in conditions (even slightly) different from those experienced during training.
The human being is capable of adapting to new situations very effectively by using the skills he has acquired throughout his life. For example, a child who has learned to walk in a living room will quickly learn to walk in a garden as well. In such a context, learning to walk is associated with synaptic plasticity, which modifies the connections between neurons, while the rapid adaptation of walking skills learned in the living room to those needed to walk in the garden is associated with neuromodulation. Neuromodulation modifies the input-output properties of the neurons themselves via chemical neuromodulators.
Synaptic plasticity is the basis of all the latest advances in AI. However, no scientific work has so far proposed a way to introduce a neuromodulation mechanism into artificial neural networks. This result, described this week in the journal PLOS ONE, is the result of an extremely fruitful collaboration between neuroscientists and artificial intelligence researchers at the University of Liège developing intelligent algorithms: two PhD researchers, Nicolas Vecoven and Antoine Wehenkel, as well as two professors, Damien Ernst (specialist in artificial intelligence), and Guillaume Drion (neuroscientist).
Related Article: Helping Machines Perceive Some Laws of Physics
These ULiège researchers have developed a completely original artificial neural network architecture, introducing an interaction between two sub-networks. The first one takes into account all the contextual information concerning the task to be solved and, on the basis of this information, neuromodule the second subnetwork in the manner of the brain's chemical neuromodulators. Thanks to neuromodulation, this second sub-network, which determines the actions to be performed by the intelligent agent, can therefore be adapted extremely quickly to the current task. This allows the agent to efficiently solve new tasks.
This innovative architecture has been successfully tested on classes of navigation problems for which adaptation is necessary. In particular, agents trained to move towards a target, while avoiding obstacles, were able to adapt to situations in which their movement was disrupted by extremely variable wind directions.
"The novelty of this research is that, for the first time, cognitive mechanisms identified in neuroscience are finding algorithmic applications in a multi-tasking context," Ernst said. "This research opens perspectives in the exploitation in AI of neuromodulation, a key mechanism in the functioning of the human brain."
- This press release was originally posted on the University of Liège website