advertisement
Science News
from research organizations

Solving algorithm 'amnesia' reveals clues to how we learn

Finding could help combat cognitive impairments

Date:
July 6, 2022
Source:
University of California - Irvine
Summary:
发现算法如何学习和后悔ain information more efficiently offers potential insight into the brain's ability to absorb new knowledge. The findings could aid in combating cognitive impairments and improving technology.
Share:
advertisement

FULL STORY

发现算法如何学习和后悔ain information more efficiently offers potential insight into the brain's ability to absorb new knowledge. The findings by researchers at the University of California, Irvine School of Biological Sciences could aid in combatting cognitive impairments and improving technology. Their study appears inProceedings of the National Academy of Sciences.

The scientists focused on artificial neural networks, known as ANNs, which are algorithms designed to emulate the behavior of brain neurons. Like human minds, ANNs can absorb and classify vast quantities of information. Unlike our brains, however, ANNs tend to forget what they already know when fresh knowledge is introduced too fast, a phenomenon known as catastrophic forgetting.

Researchers have long theorized that our ability to learn new concepts stems from the interplay between the brain's hippocampus and the neocortex. The hippocampus captures fresh information and replays it during rest and sleep. The neocortex grabs the new material and reviews its existing knowledge so it can interleave, or layer, the fresh material into similar categories developed from the past.

然而,有一些问题关于这个process, given the excessive amount of time it would take the brain to sort through the whole trove of information it has gathered during a lifetime. This pitfall could explain why ANNs lose long-term knowledge when absorbing new data too quickly.

Traditionally, the solution used in deep machine learning has been to retrain the network on the entire set of past data, whether or not it was closely related to the new information, a very time-consuming process. The UCI scientists decided to examine the issue in greater depth and made a notable discovery.

“我们发现,当人工神经网络交叉smalle得多r subset of old information, including mainly items that were similar to the new knowledge they were acquiring, they learned it without forgetting what they already knew," said graduate student Rajat Saxena, the paper's first author. Saxena spearheaded the project with assistance from Justin Shobe, an assistant project scientist. Both members of the laboratory of Bruce McNaughton, Distinguished Professor of neurobiology & behavior.

"It allowed ANNs to take in fresh information very efficiently, without having to review everything they had previously acquired," Saxena said. "These findings suggest a brain mechanism for why experts at something can learn new things in that area much faster than non-experts. If the brain already has a cognitive framework related to the new information, the new material can be absorbed more quickly because changes are only needed in the part of brain's network that encodes the expert knowledge."

The discovery holds potential for tackling cognitive issues, according to McNaughton. "Understanding the mechanisms behind learning is essential for making progress," he said. "It gives us insights into what's going on when brains don't work the way they are supposed to. We could develop training strategies for people with memory problems from aging or those with brain damage. It could also lead to the ability to manipulate brain circuits so people can overcome these deficits."

The findings offer possibilities as well for making algorithms in machines such as medical diagnostic equipment, autonomous cars and many others more precise and efficient.

Funding for the research was provided by a Defense Advanced Research Projects Agency Grant in support of basic research of potential benefit to humankind and by the National Institutes of Health.

advertisement

Story Source:

Materialsprovided byUniversity of California - Irvine.Note: Content may be edited for style and length.


Journal Reference:

  1. Rajat Saxena, Justin L. Shobe, Bruce L. McNaughton.Learning in deep neural networks and brains with similarity-weighted interleaved learning.Proceedings of the National Academy of Sciences, 2022; 119 (27) DOI:10.1073/pnas.2115229119

Cite This Page:

University of California - Irvine. "Solving algorithm 'amnesia' reveals clues to how we learn: Finding could help combat cognitive impairments." ScienceDaily. ScienceDaily, 6 July 2022. .
University of California - Irvine. (2022, July 6). Solving algorithm 'amnesia' reveals clues to how we learn: Finding could help combat cognitive impairments.ScienceDaily. Retrieved July 26, 2023 from www.koonmotors.com/releases/2022/07/220706153056.htm
University of California - Irvine. "Solving algorithm 'amnesia' reveals clues to how we learn: Finding could help combat cognitive impairments." ScienceDaily. www.koonmotors.com/releases/2022/07/220706153056.htm (accessed July 26, 2023).

Explore More
from ScienceDaily

RELATED STORIES