Emergence of complex dynamics of choice due to repeated exposures to extinction learning

  • Extinction learning, the process of ceasing an acquired behavior in response to altered reinforcement contingencies, is not only essential for survival in a changing environment, but also plays a fundamental role in the treatment of pathological behaviors. During therapy and other forms of training involving extinction, subjects are typically exposed to several sessions with a similar structure. The effects of this repeated exposure are not well understood. Here, we studied the behavior of pigeons across several sessions of a discrimination-learning task in context A, extinction in context B, and a return to context A to test the context-dependent return of the learned responses (ABA renewal). By focusing on individual learning curves across animals, we uncovered a session-dependent variability of behavior: (1) during extinction, pigeons preferred the unrewarded alternative choice in one-third of the sessions, predominantly during the first one. (2) In later sessions, abrupt transitions of behavior at the onset of context B emerged, and (3) the renewal effect decayed as sessions progressed. We show that the observed results can be parsimoniously accounted for by a computational model based only on associative learning between stimuli and actions. Our work thus demonstrates the critical importance of studying the trial-by-trial dynamics of learning in individual sessions, and the power of "simple" associative learning processes.

Download full text files

Export metadata

Additional Services

Share in Twitter Search Google Scholar
Metadaten
Author:José Ramón Donoso LeivaGND, Julian PackheiserORCiDGND, Roland PuschORCiDGND, Zhiyin LedererGND, Thomas WaltherGND, Metin ÜngörGND, Harald LachnitGND, Onur GüntürkünORCiDGND, Sen ChengORCiDGND
URN:urn:nbn:de:hbz:294-98198
DOI:https://doi.org/10.1007/s10071-021-01521-4
Parent Title (English):Animal cognition
Publisher:Springer
Place of publication:Berlin
Document Type:Article
Language:English
Date of Publication (online):2023/04/13
Date of first Publication:2021/05/12
Publishing Institution:Ruhr-Universität Bochum, Universitätsbibliothek
Tag:ABA renewal; Decision-making; Operant conditioning; Pigeons; Trial-by-trial dynamics
Volume:24
First Page:1279
Last Page:1297
Note:
Dieser Beitrag ist auf Grund des DEAL-Springer-Vertrages frei zugänglich.
Institutes/Facilities:Institut für Neuroinformatik
Dewey Decimal Classification:Naturwissenschaften und Mathematik / Biowissenschaften, Biologie, Biochemie
open_access (DINI-Set):open_access
Licence (English):License LogoCreative Commons - CC BY 4.0 - Attribution 4.0 International