Inductive Biases May Bridge The Gap Between Current Deep Learning And Human Cognitive Abilities

  • by
Inductive Biases May Bridge The Gap Between Current Deep Learning And Human Cognitive Abilities

At present, machine learning (ML) models find applications in various fields, and many ML systems have achieved remarkable accuracy in a variety of domains. However, in many cases, the answers seem inconsistent depending on the training dataset and the tasks they encounter. Therefore, whether the model’s reasoning or judgment is correct has come under question. Understanding human intelligence will help in building intelligent machines. But as in physics, the principles alone are not sufficient to predict the behavior of complex systems like brains; we need substantial computation to simulate human-like intelligence.

Anirudh Goyal and Yoshua Bengio at Mila, University of Montreal, suggests that deep learning can be extended qualitatively instead of adding additional data and computing resources. In their new paper, Inductive Biases for Deep Learning of Higher-Level Cognition, they explore how inductive biases can bridge the gap between current deep learning and human cognitive abilities to bring deep learning closer to human-level AI.

Currently, Deep learning (DL) incorporates several fundamental inductive biases found in humans and other animals. The team proposes that augmenting these inductive biases can advance deep learning. Focusing on biases that involve higher-level and sequential conscious processing can improve DL from its current successes on in-distribution understanding in highly supervised learning tasks to more robust and human-like out-of-distribution conception transfer learning abilities.

Summary: https://www.marktechpost.com/2020/12/19/inductive-biases-may-bridge-the-gap-between-current-deep-learning-and-human-cognitive-abilities/

Paper: https://arxiv.org/pdf/2011.15091.pdf

https://preview.redd.it/bu3jxexn24661.png?width=655&format=png&auto=webp&s=52822ae4484f5d08d9ab4f2ec173995785da7467

submitted by /u/ai-lover
[link] [comments]

Leave a Reply

Your email address will not be published. Required fields are marked *