Effect of telencephalic ablation on appetitive instrumental learning in the goldfish (Carassius auratus)

Experimental lesions of the teleost telencephalon impair associative learning in a variety of training situations. In the goldfish (Carassius auratus), for example, bilateral ablations disrupt the acquisition of appetitive visual conditional discriminations (Onishi, 1997), complex spatial learning (Salas et al., 1996), the acquisition of avoidance behavior (Heinsworth et al., 1967), and the retention of preoperatively trained avoidance behavior (Overmier and Papini, 1986). Interestingly, bilateral lesions of the telencephalon do not lead to measurable disruption of learning in relatively simpler situations, such as brightness discriminations (Onishi, 1997), escape conditioning (Heinsworth et al., 1967), and aversive Pavlovian conditioning (Overmier and Curnow, 1969). Research on learning in animals suggests that often variables that have little or no effects on the acquisition of new behaviors in simple situations, lead to significant effects when animals are shifted to extinction. This is particularly noticeable when practice is administered at a rate of a single trial per day. For example, lesions of the hippocampus in rats (Jarrad et al., 1964) or of the medial pallium (the amphibian homologue) in toads (Muzio et al., 1993; Papini et al., 1995) have no consequences for the acquisition of simple running responses reinforced in all trials (i.e., continuous reinforcement, CR). However, lesioned animals from both species show abnormally high levels of persistence during the extinction of instrumental behavior. Interestingly, the same lesion has opposing effects on extinction when the instrumental behavior was acquired under partial reinforcement (PR). In rats, the hippocampal lesion decreases resistance to extinction (Jarrad et al., 1964; Jarrad and Isaacson, 1965; Winocur and Mills, 1969), whereas in toads, lesions of the medial pallium increase resistance to extinction (Muzio et al., 1993). An interesting corollary of this pattern of results is that it suggests that PR training engages different brain processes in rats and toads. Hence, the lesion manipulation has opposing effects on extinction after CR vs. PR training in rats (increased persistence after CR, but decreased persistence after PR), whereas an equivalent lesion manipulation has the same effect on extinction in toads (persistence increased after both CR and PR). Such differences in the effects of physiological manipulations are consistent with the hypothesis, suggested by purely behavioral experiments, that CR and PR training engage different learning processes in mammals, but the same underlying learning process in other vertebrates (Papini et al., 1995; Papini, 1997). One candidate mediational process in mammalian learning is provided by the hypothesis that partial Effect of telencephalic ablation on appetitive instrumental learning in the goldfish (Carassius auratus) Emilio Durán, Juan P. Vargas, Cosme Salas and Mauricio R. Papini* Universidad de Sevilla, * Texas Christian University Goldfish received either bilateral ablation of the telencephalon or a sham operation, followed by instrumental training under widely-spaced conditions (one trial per day). Animals were trained to swim in a runway for either continuous reinforcement or 50% partial reinforcement. Thirty-two daily acquisition sessions were followed by 32 daily extinction sessions during which food was withheld. Telencephalic lesions disrupted early acquisition performance, but lesioned animals achieved an asymptotic performance similar to that of sham controls. Extinction was facilitated by the lesions, independently of the schedule of reinforcement used during acquisition. The results are interpreted in relation to comparative research on spaced-trial appetitive instrumental learning in vertebrates. Efectos de la ablación telencefálica sobre el aprendizaje apetitivo instrumental en la carpa dorada (Carassius auratus).En este experimento se emplearon carpas doradas (Carassius auratus) con ablación bilateral del telencéfalo o con operación de control en un procedimiento de entrenamiento instrumental con distribución de ensayos ampliamente espaciados (un ensayo por día). Los animales fueron entrenados a nadar en un corredor bajo condiciones de reforzamiento continuo o reforzamiento parcial al 50%. Se realizaron 32 sesiones diarias de adquisición seguidas de 32 sesiones diarias de extinción en las que la comida fue suprimida. La lesión telencefálica afectó a la adquisición durante los primeros ensayos aunque, al final, los animales lesionados alcanzaron una ejecución asintótica similar a la de los animales controles. La extinción se vio facilitada por las lesiones, independientemente del programa de reforzamiento usado durante la adquisición. Los resultados se interpretan en relación a los estudios comparativos de aprendizaje instrumental apetitivo con ensayos espaciados realizados en otros vertebrados. Correspondencia: Emilio Durán García Departamento de Psicología Experimental Facultad de Psicología 41005 Sevilla (Spain) E-mail: [email protected] Psicothema ISSN 0214 - 9915 CODEN PSOTEG 2000. Vol. 12, nº 4, pp. 520-524 Copyright © 2000 Psicothema reinforcement induces the activation of an emotional reaction of frustration elicited by the surprising omission of an appetitive reinforcer (Gray, 1987; Amsel, 1992; Papini and Dudley, 1997). The present experiment was designed to determine if a global lesion of the fish telencephalon affects the extinction of widely-spaced instrumental learning in the same direction (as in amphibians), or in opposite direction (as in mammals), as a function of whether acquisition involved CR or PR. Method Subjects The subjects were 32 experimentally naive goldfish (Carassius auratus) purchased from a local aquarium in Seville. Goldfish were 12-15 cm in body length and lived in pairs in tanks measuring 42 x 26 x 15 cm. Tanks were cleaned every 2 days. Water was kept at a constant temperature of 21°C and continuously aerated. The aquarium room was kept under a 14:10 hr light: dark cycle (light from 07:00 hr to 21:00 hr). Extensive handling experience was administered during the 60 days prior to the initiation of the training sessions. Goldfish were individually handled on a daily basis. Beginning 3 weeks before the experiment, a daily feeding routine was introduced. Each goldfish was given 3 pellets of Tetra-pond (Ulrich Baensch GmbH, Germany) fish food (a total of about 0.08 g of food per day). Apparatus Animals received training in a conventional runway made out of white acrylic plates. The runway was 150 cm long X 10 cm wide X 15 cm high, and was divided into three sections. The start and goal boxes were 25 cm long. Manually-operated guillotine doors separated the start and goal boxes from the main section of the runway. A tube measuring 8-mm in diameter was located in the goal box and used to manually deliver the food on reinforced trials. The runway was filled with water up to a level of 12 cm. Water was constantly circulating from the start to the goal box. Opening of the start door activated a digital counter (incrementing in 0.01 s units) that was stopped when the animal activated a photocell located inside the goal box. The latency to traverse the runway was the primary dependent measure. Surgical and Histological Procedures Animals were anesthetized by immersion in a solution of tricaine methanosulfonate (1:20,000). When movement ended, the animal was placed in the surgical chamber where it remained partially bathed in water at a constant concentration of anesthetic (1:20,000). The animal was fixed into position by lateral holders that maintained the body still during surgery. An adjustable tube was inserted into the animal’s mouth and connected to a pump that provided a constant flow of water. The concentration of anesthesia was kept constant during surgery. The dorsal skin and skull were carefully removed and the underlying fatty tissue removed by aspiration. The exposed telencephalon was aspirated with a micropipette connected to a manual vacuum system. Surgery was performed under visual inspection by means of a binocular microscope. Following the ablation, the piece of skull was replaced in its original position, fixed with cyanocrilate glue, and covered with dental cement. The fish was then returned to its home tank for a recovery period of 6 days. Sham operations were performed exactly as described, except that the nervous tissue was not injured. At the end of the experiment, fish were deeply anesthetized (1:5,000) and perfused with 50 ml of 0.9% saline solution, followed by 125 ml of fixative solution (10% formalin in phosphate buffer 0.1 M, pH 7.4). The brains were removed from the skull, inspected for a preliminary evaluation of the ablation, and cut in 50-mm thick transversal sections for histological analysis. Training Procedure All fish received 7 daily sessions of pretraining immediately after the 6 days of post-surgical recovery. During the initial 5 sessions, each animal was exposed to the runway apparatus with the doors raised and without any food for a total of 5 min per session. During sessions 6 and 7, each goldfish was confined for 5 min to the goal box of the runway where it received a total of 6 pellets of Tetra-pond fish food (approximately 0.15 g). Training begun on day 8. Sham-operated and ablated animals were randomly assigned to one of two groups. Groups C/S and P/S included sham-operated (S) animals that received either continuous reinforcement (C) or 50% partial reinforcement (P) training. Groups C/L and P/L included lesioned (L) animals receiving the same training schedule. Acquisition lasted 32 daily trials and the intertrial interval was approximately 24 hr. All the trials in the C groups ended in reinforcement, with the delivery of 6 pellets of Tetra-pond fish food (about 0.15 g). For the groups receiving 50% partial reinforcement, 16 trials ended in reinforcement, while the rest ended in nonreinforcement. The sequence of reinforced (R) and nonreinforced (N) trials was the following: RNRRN RNRNN RNNRN RNRRN RNNRR NNRNR RN. Extinction begun the day after the last acquisition trial and lasted another 24 daily trials, all nonreinforced. Animals were transported from their home tank into the start box of the runway. After 20 s, the start door was raised and the trial started. The trial ended when the fish interrupted the photocell located in the goal box. If the trial was reinforced, the food was administered immediately after the photocell was activated and the animal was given 20 s to consume the food. In a non-reinforced trial, animals were left in the goal box during 20 s after the photocell was activated. Animals were returned to their home tanks immediately at the end of each trial. Post-trial supplementary feeding (6 pellets, about 0.15 g) was provided for those animals exposed to an N trial, either during partial reinforcement training or during extinction, 30 min after the end of the trial. The order in which animals received training in any given day was determined as follows: squads of 4 goldfish, one from each group, were run always in the same order, but the order of training within a particular squad was changed randomly across days. Results Th ree lesioned animals died in the course of the ex p e ri m e n t . In addition, one fish in Group P/S failed to complete 5 of the last 8 acquisition trials and exhibit no clear evidence of acquisition. G iven the emphasis on extinction perfo rm a n c e, this animal with a poor acquisition re c o rd was discarded from the study. Only three other go l d fish failed to finish a trial (one animal in Group C/S EFFECT OF TELENCEPHALIC ABLATION ON APPETITIVE INSTRUMENTAL LEARNING IN THE GOLDFISH… 521 failed in two trials, and two animals in Group P/L failed in one t rial each, out of a total of 32 acquisition trials). Because these we r e isolated fa i l u res, these animals we re kept in the analy s e s . Th e r e we re, thus, 4 fa i l u res out of a total of 896 acquisition tri a l s ( o n ly 0.4% disruption). The final group sizes we re the fo l l ow i n g : G roup C/S, n=8; Group C/L , n=7; Group P/S, n=7, and Gro u p P/L, n=6. Fi g . 1 shows the extent of the telencephalic tissue re m oval in rep re s e n t at ive brains. The lesion resulted in the complete re m oval of the telencephalic lobes. The preoptic area and the optic t racts we re not injured in any of the animals subjected to surge ry. None of the sham operated go l d fish exhibited damage to the b ra i n . L at e n cy scores obtained for each animal, in each trial, we re t ra n s fo rmed to the log 1 0 for the purpose of improving norm a l i t y and allowing for para m e t ric analysis of the results. The re s u l t s a re shown in Fi g. 2. Early acquisition perfo rmance was poorer in both lesioned groups than in the sham controls, but the lesioned animals eve n t u a l ly re a ched a similar (P/L) or better (C/L) behav i o ral level than their re s p e c t ive sham controls. Th e re was a small but consistent decrease in latencies in the two sham-operated groups. Howeve r, there was no obvious effect of the sch e d ule of re i n fo rcement. A Schedule (C, P) x Lesion (L, S) x 4-Tri a l B l o ck analysis of va riance on the tra n s fo rmed latencies yielded a significant acquisition effect [F(7, 168) = 5.339, p < 0.001], a s i g n i ficant Lesion x Trial interaction [F(7, 168) = 5.835, p < 0.001], and a significant main effect for lesion [F(1, 24) = 4.845, p < 0.04]. Further pairwise comparisons with the error term and df derived from the main analysis (Howell, 1992) were computed over the last two 4-trial blocks of acquisition in order to determine whether the group differences were significant. Non-significant differences were found in Blocks 7 and 8 between Groups C/S and C/L [Fs(1, 87) < 3.851, all p > 0.05] and between Groups P/S and P/L [Fs(1, 87) < 1, all p > 0.05]. Fi g. 2 also shows that both lesioned groups exhibited less p e rsistence in extinction than each of their re s p e c t ive sham cont r ols. This pat t e rn suggests that the telencephalic lesion affe c t e d extinction in the same manner whether the response was acquired via continuous or partial re i n fo rcement tra i n i n g. Th e re wa s also a tendency for the two groups trained under partial re i n fo rcement to exhibit higher latencies than those of the groups tra i - ned under continuous re i n fo rcement. A Schedule (C, P) x Lesion (L, S) x 4-Trial Block analysis of va riance on the tra n s fo rmed latencies confi rmed both observations. Th e re was a significant lesion by bl o ck interaction [F(7, 168) = 2.292, p < 0.03], and a significant main effect of schedule [F(1, 24) = 4.349, p < 0 . 0 5 ] . Although the asymptotic acquisition perfo rmance of these groups was stat i s t i c a l ly similar, it is obvious that the go l d f ish in G roup C/L started extinction at lower lat e n cy levels than the other groups. In order to assess extinction rate indep e n d e n t l y of the starting point, the extinction latencies we re re - c a l c u l a ted by using a re l at ive measure. The log1 0 l at e n c y score of each animal, in each extinction trial, was tra n s fo rmed according to the fo r mula: (trial / asymptote) x 100, wh e r e asymptote was the mean log1 0 s c o r e of that animal during the last 8 acquisition t rials. Tra n s fo rmed scores we re ave raged in bl o cks of 4 tri a l s for each animal. Thus, scores ab ove 100 rep r esent an incre a s e in lat e n cy during extinction, re l at ive to asymptotic acquisition p e r fo rm a n c e. The results are presented in Fig. 3. There was substantially more change in behavior during extinction, relative to the last 8 acquisition trials, in Groups C/L and P/L than in their relative sham controls, C/S and P/S. There was also a greater average change in the partial reinforcement groups than in the groups that had received continuous reinforcement training. A Schedule (C, P) x Lesion (L, S) x 4-Trial Block analysis of variance on the transformed scores yielded a significant lesion by block interaction [F(7, 168) = 2.307, p < 0.03], confirming that the extinction performance of the lesioned groups extinguished significantly faster than that of the sham controls. There was also a borderline lesion effect [F(1, 24) = 4.072, p = 0.0549]. All other effects were non-significant, including the schedule effects. EMILIO DURÁN, JUAN P. VARGAS, COSME SALAS AND MAURICIO R. PAPINI 522 Figure 1. Transverse postcommissural section of a normal brain (A) and a telencephalon-ablated brain (B). DC, central area of the dorsal telencephalon; DD, dorsal area of the dorsal telencephalon; DL, lateral area of the dorsal telencephalon; DM, medial area of the dorsal telencephalon; OC, optic chiasm; PO, preoptic nucleus; PP, periventricular preoptic nucleus; tc, tela choroidea; V, ventricle. Discussion Wi d e ly-spaced ex p e riments on instrumental learning with go l d fish suggest that behavior is strengthened by re i n fo rc e m e n t and we a kened by nonre i n fo rcement (Lowes and Bitterm a n , 1967). Unlike it is the case with mammals, go l d fish data, as we l l as the results of analogous ex p e riments with toads and turt l e s ( Pe rt and Bitterman, 1970; Muzio et al., 1993; Papini and Ishida, 1994 ), do not re q u i re the assumption that the surp rising omission or reduction in rewa rd quantity or quality induces an emotional reaction of fru s t ration (Gray, 1987; Amsel, 1992; Pap i n i and Dudley, 1997). In agreement with previous ex p e riments, there was no evidence of gre ater resistance to extinction after PR acquisition, rather than CR acquisition, in the sham groups. Th i s was the case whether extinction was assessed in terms of ab s o l ute or tra n s fo r med latencies. The absence of a marked perfo rm a nce ch a n ge during extinction in the sham groups may appear unusual. Howeve r, it is not uncommon for go l d fish trained under wid e ly-spaced conditions to exhibit substantial persistence of inst r umental behavior during extinction (Boitano and Fo s kett, 1968; S c hutz and Bitterman, 1969). Lesion ex p e riments can contri bute to determine whether beh av i o ral diffe rences across species re flect diffe r ences in the und e rlying processes of instrumental learn i n g. If CR and PR tra ining lead to the same underlying type of learn i n g, as it is hy p o th e s i zed to be the case in the go l d fish, then abl ation of a part i c ular area known to be invo l ved in learning should lead to the same extinction effect in both training conditions. The present results demonstrate that the complete abl ation of the telencep h alon, a stru c t u re known to be invo l ved in learning in teleost fi s h ( O ve rmier and Hollis, 1990), leads to reduced resistance to extinction indep e n d e n t ly of whether the response was acquired under CR or under PR tra i n i n g. Conclusions (1) Partial reinforcement training does not increase resistance to extinction in the goldfish. (2) A bilateral lesion of the telencephalon does not affect acquisition performance, but it reduces resistance to extinction similarly in animals trained under partial or continuous reinforcement. Acknowledgments The research reported here was supported in part with grants from the DGES PB96-1334 and Junta de Andalucía CVI-242. The authors wish to thank Gerardo Labrador for his technical help in preparing the microphotographs. EFFECT OF TELENCEPHALIC ABLATION ON APPETITIVE INSTRUMENTAL LEARNING IN THE GOLDFISH… 523 4-Session Blocks 1,8 1,6 1,4 1,2 1,0 0,8 0246810 12 14 16 Acquisition Extinction CL CS PL PS Figure 2. Performance of groups of goldfish trained under either conti - nuous (C) or partial (P) reinforcement during acquisition, and subject to telencephalic lesion (L) or sham operation (S) before the start of training. Experimento 2 Causas A 64,54 39,76 B 68,72 35,54 D 74,06 30,1 C 65,38 45,1 Usual Rara 100 80 60 40 20 0 Figure 3. Extinction performance of groups trained under continuous (C) or partial (P) reinforcement during acquisition, and subject to a telencep - halic lesion (L) or a sham operation (S) before training. Latencies (s) from each trial were transformed to their log10 value before computing the per - centage of change. The log10 value of each extinction trial was divided by the average log10 value of the last 8 sessions of acquisition and the ratio multiplied by 100. Change above 100 implies longer latencies in extinction than during asymptotic acquisition. R e fe re n c e s Amsel, A. (1992). Frustration theory. Cambridge: Cambridge University Press. Boitano, J. J.; Foskett, M. D. (1968). Effects of partial reinforcement on speed of approach responses in goldfish (Carassius auratus). Psycho - logical Reports,22, 741-744. Gray, J. (1987). The psychology of fear and stress.Cambridge: Cambridge University Press. Heinsworth, F. R.; Overmier, J. B.; Snowdon, C. T. (1967). Specific and permanent deficits in instrumental avoidance responding following forebrain ablation in the goldfish. Journal of Comparative and Physiolo - gical Psychology. 63, 111-116. Howell, D. C. (1992). Statistical methods for psychology. Third Edition. Boston: PWS-Kent. EMILIO DURÁN, JUAN P. VARGAS, COSME SALAS AND MAURICIO R. PAPINI 524 Jarrard, L. E.; Isaacson, R. L. (1965). Hippocampal ablation in rats: Effects of intertrial interval. Nature,207, 109-110. Ja r ra rd, L. E.; Isaacson, R. L.; Wi cke l g ren, W. O. (1964). Effects of hippocampal abl ation and intert r ial interval on ru n way acquisition and extinction. Jo u rnal of Comparat i ve and Phy s i o l ogy Psych o l o gy, 5 7 , 442-444. Lowes, G.; Bitterman, M. E. (1967). Reward and learning in the goldfish. Science,157, 455-457. Muzio, R. N.; Segura, E. T.; Papini, M. R. (1993). Effects of lesions in the medial pallium on instrumental learning in the toad (Bufo arenarum). Physiology &. Behavior,54, 185-188. Onishi, K. (1997). Effects of telencephalic ablation on short-term memory and attention in goldfish. Behavioral and Brain Research,86, 191-199. Overmier, J. B.; Curnow, P. (1969). Classical conditioning, pseudoconditioning, and sensitization in «normal» and forebrainless goldfish. Jour - nal of Comparative and Physiological Psychology,68, 193-198. Overmier, J. B. y Hollis, K. L. (1990). Fish in the think tank: Learning, memory, and integrated behavior. En: R. Kesner y D.S. Olton (eds). Neu - robiology of comparative cognition. (pp. 205-236). Hillsdale: Erlbaum. Overmier, J. B.; Papini, M. R. (1986). Factors modulating the effects of teleost telencephalon on retention, relearning, and extinction of instrumental avoidance behavior. Behavioral Neuroscience,100, 190-199. Papini, M. R. (1997). Role of reinforcement in spaced-trial operant learning in pigeons (Columba livia). Journal of Comparative Psychology, 111, 275-285. Papini, M. R.; Dudley, R. T. (1997). Consequences of surprising reward omissions. Review of General Psychology, 1, 175-197. Papini, M. R.; Ishida, M. (1994). Role of magnitude of reinforcement in spaced-trial instrumental learning in turtles (Geoclemys reevesii). Quarterly Journal of Experimental Psychology,47B, 1-13. Papini, M. R.; Muzio, R. N.; Segura, E. T. (1995). Instrumental learning in toads (Bufo arenarum): Reinforcer magnitude and the medial pallium. Brain, Behavior and Evolution,46, 61-71. Pert, A.; Bitterman, M. E. (1970). Reward and learning in the turtle. Lear - ning and Motivation,1, 121-128. Salas, C.; Rodríguez, F.; Vargas, J. P.; Durán, E.; Torres, B. (1996). Spatial learning and memory deficits after telencephalic ablation in goldfish trained in place and turn maze procedures. Behavioral Neuroscience, 110, 965-980. Schutz, S. L.; Bitterman, M. E. (1969). Spaced-trials partial reinforcement and resistance to extinction in the goldfish. Journal of Comparative and Physiological Psychology,68, 126-128. Winocur, G.; Mills, J. A. (1969). Hippocampus and septum in response inhibition. Journal of Comparative and Physiological Psychology,67, 352-357. Aceptado el 18 de abril de 2000