Context-dependent extinction learning emerging from raw sensory inputs

  • The context-dependence of extinction learning has been well studied and requires the hippocampus. However, the underlying neural mechanisms are still poorly understood. Using memory-driven reinforcement learning and deep neural networks, we developed a model that learns to navigate autonomously in biologically realistic virtual reality environments based on raw camera inputs alone. Neither is context represented explicitly in our model, nor is context change signaled. We find that memory-intact agents learn distinct context representations, and develop ABA renewal, whereas memory-impaired agents do not. These findings reproduce the behavior of control and hippocampal animals, respectively. We therefore propose that the role of the hippocampus in the context-dependence of extinction learning might stem from its function in episodic-like memory and not in context-representation per se. We conclude that context-dependence can emerge from raw visual inputs.

Download full text files

Export metadata

Additional Services

Share in Twitter Search Google Scholar
Metadaten
Author:Thomas WaltherGND, Nicolas DiekmannGND, Sandhiya VijayabaskaranGND, José Ramón Donoso LeivaGND, Denise Manahan-VaughanORCiDGND, Laurenz WiskottORCiDGND, Sen ChengORCiDGND
URN:urn:nbn:de:hbz:294-96605
DOI:https://doi.org/10.1038/s41598-021-81157-z
Parent Title (English):Scientific reports
Subtitle (English):a reinforcement learning approach
Publisher:Macmillan Publishers Limited, part of Springer Nature
Place of publication:London
Document Type:Article
Language:English
Date of Publication (online):2023/02/16
Date of first Publication:2021/02/01
Publishing Institution:Ruhr-Universität Bochum, Universitätsbibliothek
Volume:11
Issue:Article 2713
First Page:2713-1
Last Page:2713-14
Note:
Dieser Beitrag ist auf Grund des DEAL-Springer-Vertrages frei zugänglich.
Institutes/Facilities:Institut für Neuroinformatik
Medizinische Fakultät, Abteilung für Neurophysiologie
Institut für Neuroinformatik, Research Group Computational Neuroscience
Dewey Decimal Classification:Technik, Medizin, angewandte Wissenschaften / Medizin, Gesundheit
open_access (DINI-Set):open_access
faculties:Medizinische Fakultät
Licence (English):License LogoCreative Commons - CC BY 4.0 - Attribution 4.0 International

OPUS4 Logo