Premium
SITUATIONAL DESCRIPTIONS OF BEHAVIORAL PROCEDURES: THE IN SITU TESTBED
Author(s) -
Kemp Steven M.,
Eckerman David A.
Publication year - 2001
Publication title -
journal of the experimental analysis of behavior
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.75
H-Index - 61
eISSN - 1938-3711
pISSN - 0022-5002
DOI - 10.1901/jeab.2001.75-135
Subject(s) - testbed , computer science , reinforcement , reinforcement learning , artificial intelligence , interval (graph theory) , test (biology) , machine learning , psychology , mathematics , social psychology , computer network , combinatorics , biology , paleontology
We demonstrate the In Situ testbed, a system that aids in evaluating computational models of learning, including artificial neural networks. The testbed models contingencies of reinforcement using an extension of Mechner's (1959) notational system for the description of behavioral procedures. These contingencies are input to the model under test. The model's output is displayed as cumulative records. The cumulative record can then be compared to one produced by a pigeon exposed to the same contingencies. The testbed is tried with three published models of learning. Each model is exposed to up to three reinforcement schedules (testing ends when the model does not produce acceptable cumulative records): continuous reinforcement and extinction, fixed ratio, and fixed interval. The In Situ testbed appears to be a reliable and valid testing procedure for comparing models of learning.