Skip to Main content Skip to Navigation
Preprints, Working Papers, ...

Confidence-controlled Hebbian learning efficiently extracts category membership from stimuli encoded in view of a categorization task

Abstract : In experiments on perceptual decision-making, individuals learn a categorization task through trial-and-error protocols. We explore the capacity of a decision-making attractor network to learn a categorization task through reward-based, Hebbian type, modifications of the weights incoming from the stimulus encoding layer. For the latter, we assume a standard layer of a large number of stimulus specific neurons. Within the general framework of Hebbian learning, authors have hypothesized that the learning rate is modulated by the reward at each trial. Surprisingly, we find that, when the coding layer has been optimized in view of the categorization task, such reward-modulated Hebbian learning (RMHL) fails to extract efficiently the category membership. In a previous work we showed that the attractor neural networks nonlinear dynamics accounts for behavioral confidence in sequences of decision trials. Taking advantage of these findings, we propose that learning is controlled by confidence, as computed from the neural activity of the decision-making attractor network. Here we show that this confidence-controlled, reward-based, Hebbian learning efficiently extracts categorical information from the optimized coding layer. The proposed learning rule is local, and, in contrast to RMHL, does not require to store the average rewards obtained on previous trials. In addition, we find that the confidence-controlled learning rule achieves near optimal performance.
Document type :
Preprints, Working Papers, ...
Complete list of metadatas

Cited literature [51 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02912714
Contributor : Kevin Berlemont <>
Submitted on : Thursday, August 6, 2020 - 3:04:14 PM
Last modification on : Friday, September 25, 2020 - 3:35:19 AM

File

arxiv_version.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02912714, version 1

Citation

Kevin Berlemont, Jean-Pierre Nadal. Confidence-controlled Hebbian learning efficiently extracts category membership from stimuli encoded in view of a categorization task. 2020. ⟨hal-02912714⟩

Share

Metrics

Record views

76

Files downloads

35