The neural mechanisms of learning from competitors.
Scientific Abstract
Learning from competitors poses a challenge for existing theories of reward-based learning, which assume that rewarded actions are more likely to be executed in the future. Such a learning mechanism would disadvantage a player in a competitive situation because, since the competitor's loss is the player's gain, reward might become associated with an action the player should themselves avoid. Using fMRI, we investigated the neural activity of humans competing with a computer in a foraging task. We observed neural activity that represented the variables required for learning from competitors: the actions of the competitor (in the player's motor and premotor cortex) and the reward prediction error arising from the competitor's feedback. In particular, regions positively correlated with the unexpected loss of the competitor (which was beneficial to the player) included the striatum and those regions previously implicated in response inhibition. Our results suggest that learning in such contexts may involve the competitor's unexpected losses activating regions of the player's brain that subserve response inhibition, as the player learns to avoid the actions that produced them.
Similar content
Preprint
MRC CoRE in RND Output
ePC: Fast and Deep Predictive Coding in Digital Simulation
Paper
MRC CoRE in RND Output
ePC: Fast and Deep Predictive Coding in Digital Simulation
2026. 43rd International Conference on Machine Learning
Paper
MRC CoRE in RND Output
On the Infinite Width and Depth Limits of Predictive Coding Networks
2026, Proceedings of the 43rd International Conference on Machine Learning
Preprint
MRC CoRE in RND Output
Temporally distinct reward and action prediction error signals during value learning and habit formation
The neural mechanisms of learning from competitors.
Scientific Abstract
Learning from competitors poses a challenge for existing theories of reward-based learning, which assume that rewarded actions are more likely to be executed in the future. Such a learning mechanism would disadvantage a player in a competitive situation because, since the competitor's loss is the player's gain, reward might become associated with an action the player should themselves avoid. Using fMRI, we investigated the neural activity of humans competing with a computer in a foraging task. We observed neural activity that represented the variables required for learning from competitors: the actions of the competitor (in the player's motor and premotor cortex) and the reward prediction error arising from the competitor's feedback. In particular, regions positively correlated with the unexpected loss of the competitor (which was beneficial to the player) included the striatum and those regions previously implicated in response inhibition. Our results suggest that learning in such contexts may involve the competitor's unexpected losses activating regions of the player's brain that subserve response inhibition, as the player learns to avoid the actions that produced them.
Citation
2010.Neuroimage, 53(2):790-9.
Downloads
Similar content
Preprint
MRC CoRE in RND Output
ePC: Fast and Deep Predictive Coding in Digital Simulation
Paper
MRC CoRE in RND Output
ePC: Fast and Deep Predictive Coding in Digital Simulation
2026. 43rd International Conference on Machine Learning
Paper
MRC CoRE in RND Output
On the Infinite Width and Depth Limits of Predictive Coding Networks
2026, Proceedings of the 43rd International Conference on Machine Learning
Preprint
MRC CoRE in RND Output