Computational explorations of the evolution of artificial neural networks in Pavlovian environments

1996 1996

Other formats: Order a copy

Abstract (summary)

The present work initiates a research line in the study of artificial life, through a preliminary characterization of a computational approach to evolutionary interpretations of Pavlovian-conditioning phenomena. The approach was implemented through a Neuro-Computational/Genetic-Algorithm (or NC-GA) hybrid model. The NC model described the fimctioning of neuron-like processing elements that were interconnected forming artificial neural networks (ANNs). The GA consisted of a set of rules for selecting ANNs for mating and reproduction. ANNs were developed from virtual chromosomes encoding variables determining the course of a neurodevelopmental program motivated by general concepts from developmental neuroscience. All chromosomes had a fixed length and encoded for the same set of variables. Also, that program involved a one-many relation, for most of the variables encoded by the chromosomes were probabilistic.

The NC-GA model was characterized through computer simulations. Four simulation experiments were performed, each consisting of two kinds of simulations, evolution and test. In the evolution simulations, the GA was used to evolve ANNs that were trained in a Pavlovian procedure. ANNs with higher conditional-response proportions had a higher probability of being selected for mating and reproduction. In the test simulations, the behavioral competence of the evolved ANNs was determined by exposing them to conditions different from the ancestral ones.

In general, the results from the evolution simulations demonstrated that the mean chromosomic overlap and the mean population fitness increased as negatively accelerated functions of generations. Also, most ANNs at the beginning of evolution showed no learning, whereas ANNs by the end of evolution showed learning.

In Experiment 1, ANNs were selected for increased responding under forward-delay procedures in which the interstimulus interval (ISI), and the kind of CS were manipulated. After evolution, ANN sizes increased as a function of ISIs, and ANN performances in the test simulations were consistent with ISI functions, optimal-ISI noninvariance, and CS nonequipotentiality. In Experiment 2, two CSs were independently paired with the US. After evolution, ANN sizes increased as a nonmonotonic function of the ISI, and ANN performances in the test simulations showed generalization, discrimination, and blocking. In Experiments 3 and 4, ANNs were selected for orthogonal and nonorthogonal discrimination, respectively. Performances in the test simulations of both experiments also showed generalization, discrimination, and blocking. Collectively, these results are consistent with the pursuit of general-process approaches to learning. However, such approaches also allow for interpretations in which biological constraints on learning are seen as emerging from variations in general neurobiological processes, and as imposing limits on the range of variation of general biobehavioral processes.

Indexing (details)

Behaviorial sciences;
Computer science;
Artificial intelligence
0384: Behaviorial sciences
0984: Computer science
0800: Artificial intelligence
Identifier / keyword
Psychology; Applied sciences
Computational explorations of the evolution of artificial neural networks in Pavlovian environments
Burgos, Jose Enrique
Number of pages
Publication year
Degree date
School code
DAI-B 57/07, Dissertation Abstracts International
Place of publication
Ann Arbor
Country of publication
United States
9780591048032, 0591048035
Donahoe, John W.
University of Massachusetts Amherst
University location
United States -- Massachusetts
Source type
Dissertations & Theses
Document type
Dissertation/thesis number
ProQuest document ID
Database copyright ProQuest LLC; ProQuest does not claim copyright in the individual underlying works.
Document URL
Access the complete full text

You can get the full text of this document if it is part of your institution's ProQuest subscription.

Try one of the following:

  • Connect to ProQuest through your library network and search for the document from there.
  • Request the document from your library.
  • Go to the ProQuest login page and enter a ProQuest or My Research username / password.