Perceptual learning has been used to probe the mechanisms of cortical plasticity in the adult brain. Feedback projections are ubiquitous in the cortex, but little is known about their role in cortical plasticity. Here we explore the hypothesis that learning visual orientation discrimination involves learning-dependent plasticity of top-down feedback inputs from higher cortical areas, serving a different function from plasticity due to changes in recurrent connections within a cortical area. In a Hodgkin-Huxley-based spiking neural network model of visual cortex, we show that modulation of feedback inputs to V1 from higher cortical areas results in shunting inhibition in V1 neurons, which changes the response properties of V1 neurons. The orientation selectivity of V1 neurons is enhanced without changing orientation preference, preserving the topographic organizations in V1. These results provide new insights to the mechanisms of plasticity in the adult brain, reconciling apparently inconsistent experiments and providing a new hypothesis for a functional role of the feedback connections.
The specificity of visual perceptual learning suggests the primary visual cortex, area V1, is the site of neural plasticity that underlies learning. However, V1 does not exhibit topographic changes observed in other sensory cortices with learning, and changes observed in V1 following perceptual learning are contradictory. In a spiking neuronal model of cortical network, we show that feedback inputs to V1 can change the response properties of V1 neurons without changing the topographic organization in V1. The feedback model reconciles previous experiments and provides a new hypothesis for a functional role of the feedback connections.
Citation: Moldakarimov S, Bazhenov M, Sejnowski TJ (2014) Top-Down Inputs Enhance Orientation Selectivity in Neurons of the Primary Visual Cortex during Perceptual Learning. PLoS Comput Biol 10(8): e1003770. doi:10.1371/journal.pcbi.1003770
Editor: Wolfgang Einhäuser, Philipps-University Marburg, Germany
Received: January 8, 2014; Accepted: June 26, 2014; Published: August 14, 2014
Copyright: © 2014 Moldakarimov et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was supported in part by Howard Hughes Medical Institute (TJS), ONR MURI (N000141010072) to SM and (N000141310672) to MB, NINDS (R01 NS060870) and NIDCD (R01 R01DC006306) to MB and NIBIB (R01 EB009282) to MB and TJS. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
The adult brain remains plastic long after the developmental period . This ability to remain plastic is fundamental for the adult brain to be able to learn and adapt in the ever-changing sensory environment. However, we do not fully understand the limits and mechanisms of the adult brain plasticity . Perceptual learning – improvement in perception due to experience with stimuli – has been used to explore plasticity in sensory cortices . In particular, stimulus specificity of the improvements of orientation discrimination – suggests that the primary visual cortex, area V1, where neurons have small receptive fields, is the site for cortical changes that underlie the improvement of orientation discrimination. However, it is still unclear what cellular and synaptic changes in V1 are responsible for such perceptual learning.
Reports of learning-dependent changes of V1 neurons are inconsistent: Learning to discriminate orientations of visual stimuli in one study resulted in sharpening orientation tuning curves in a subgroup of V1 neurons  (Fig. 1A–D); others found instead that responses to the trained orientation reduced in V1 neurons  (Fig. 1E,F). In both studies, V1 neurons responded preferably to the same orientations as they did before learning, thus preserving the topographic organization in V1.
Figure 1. Effect of training on orientation discrimination in V1 neurons.
A. Orientation discrimination task. Subjects reported whether the test orientation was tilted clockwise or anticlockwise with respect to the trained orientation (from ). B. Performance in orientation discrimination task (from ). C. Orientation tuning curves of five sample V1 neurons (from ). D. Slope measured at the trained orientation for trained neurons (solid red line) and naïve neurons (dashed blue line) (from ). E. Performance in orientation discrimination task in another experiment (from ). F. Neural responses in V1 in the trained location (grey line) and an untrained location (black) (from ).doi:10.1371/journal.pcbi.1003770.g001
Previous models of visual perceptual learning based on plasticity of the recurrent and feedforward connections – could neither explain the observed stability of orientation preferences of V1 neurons nor reconcile the findings of the aforementioned experiments.
Here we suggest that learning-dependent changes in V1 cortex involve top-down projections into V1 from higher cortical areas. In a spiking neural network model of visual cortex (Fig. 2), we showed that repeated stimulus presentations resulted in strengthening the feedforward connections from V1 neurons to neurons in a higher visual area (such as area V2). Greater activity in V2 in turn led to strengthening the feedback connections from V2 to V1 neurons, which helped to maintain the stability of the V1–V2 network through shunting inhibition –. As a consequence of the shunting inhibition, V1 neurons had enhanced orientation selectivity and responded to a narrower range of orientations. The diffuse nature of the feedback inputs to V1 neurons allowed improvement of orientation selectivity in V1 neurons without changing their orientation preferences, thus preserving the map of orientation representations in V1.
Figure 2. Model of visual cortex.
Layer one represented layer 2/3 of V1 and contained excitatory and inhibitory neurons. Layer two represented V2 area and contained excitatory neurons. V1 neurons were connected through recurrent (excitatory and inhibitory) connections. V1 neurons received bell-shaped input, which mimicked orientation-tuned input from layer 4 neurons of V1. V1 excitatory neurons sent convergent feedforward projections to excitatory V2 neurons. V2 neurons projected back to all V1 neurons. Stimuli of different orientations were modeled by shifting the center of the input along one-dimensional network.doi:10.1371/journal.pcbi.1003770.g002
The feedback model reproduced both the previously observed sharpening and reduction of neural responses, but not in the same V1 neurons. We assume that previous studies might have recorded from different populations of V1 neurons. We suggest that the stability of cortical representations in V1 may be critical for normal visual processing, and learning-dependent plasticity of visual cortex could be based on mechanisms that preserve the topography of cortical maps.
Shunting inhibition of V1 neurons
To explore mechanisms of learning-induced changes in V1 we designed a simple network model consisting of two cortical areas (V1 and V2) and including plastic feedforward and feedback connections (Fig. 2; see also Models). In the model, a stimulus was presented to V1 neurons on many repetitions, which resulted in strengthening the feedforward connections from V1 to V2 neurons (Fig. 3A). Higher levels of activity in V2 neurons in turn led to strengthening the feedback connections from V2 back to V1 neurons. The excitatory feedbacks targeted both the excitatory and inhibitory neurons in V1 (Fig. 3B) and resulted in balanced recurrent excitatory and inhibitory currents in V1, which canceled each other at the resting potential of V1 neurons leading to shunting inhibition of V1 neurons (Fig. 3C). Strengthening the feedback inputs with learning did not change the balance but increased the amplitudes of both the recurrent excitatory and inhibitory currents (Fig. 3D). Thus, although the feedback inputs were excitatory, they suppressed activity in V1 neurons through shunting inhibition mechanism, thus maintaining stability of the network.
Figure 3. Shunting inhibition of V1.
A. With learning, feedforward connections from a population of V1 neurons to a population V2 neurons strengthened. B. The excitatory V2 neurons projected to both the excitatory and inhibitory neurons in V1. C. Top. Membrane potential of a V1 neuron before training. Bottom. Excitatory and inhibitory input currents to the V1 neuron before training. D. Top. Membrane potential of the V1 neuron after training. Bottom. Excitatory and inhibitory currents to the V1 neuron after training. E. Response function (f-I curve) of a V1 neuron. The neuron did not respond to the trained stimulus, and the response function was tested by injecting current to the neuron.doi:10.1371/journal.pcbi.1003770.g003
Due to the diffuse nature of the feedback inputs in the model, the shunting inhibition affected responses of all V1 neurons. By applying a range of input stimuli, we tested f-I curve in a V1 neuron that did not respond to the trained stimulus but received the modified feedback input. After training, the f-I curve of the V1 neuron shifted to the right, resulting in a subtractive effect on neural responses (Fig. 3E). This was because the strong feedback inputs resulted in stronger recurrent excitatory and inhibitory input currents, which decreased input resistance at the resting potential of the neuron. As we the depolarized membrane potential by applying a direct current to the V1 neuron, the driving force of the inhibitory current increased and the driving force of the excitatory current to the neuron decreased causing shunting inhibition in the neuron. Thus, shunting inhibition can reduce neural responses by counteracting the driving stimulus, as was previously predicted .
Different enhancement of orientation selectivity in V1 neurons after learning
After training the model with a stimulus, we observed that both amplitude and width of tuning curve of a V1 neuron that preferred the trained orientation reduced due to the shunting inhibition (Fig. 4A,B). However, slope of the neuron's tuning curve did not change significantly (Fig. 4D). We refer to this change in the tuning curve as “reduction” of the response. In another V1 neuron, for which the trained orientation was not the preferred one, reduction of the width of the tuning curve was greater than reduction of the response amplitude (Fig. 4B,C), which steepened the slope of the tuning curve (Fig. 4D). We refer to this change as “sharpening” the tuning curve.
Figure 4. Enhancement of stimulus selectivity.
A. Tuning curve of a V1 neuron that preferred the trained orientation; before (black) and after (green) training. B. Amplitude-to-width ratio (R) of the tuning curve before (black) and after training (green) in a neuron that preferred the trained orientation, and in a neuron that preferred different orientation (blue). C. Tuning curve of a V1 neuron that preferred orientation different than the trained one; before (black) and after (blue) training. D. Slope change of the tuning curve of the V1 neuron the preferred the trained orientation (green) and another V1 neuron that preferred another orientation (blue line with filled circles).doi:10.1371/journal.pcbi.1003770.g004
Thus, the reduction of responses was observed in V1 neurons that preferred the trained orientation, and sharpening of tuning curves was observed in V1 neurons that responded to the trained orientation but preferred orientations different from the trained one.
Stimulus specificity of tuning curve changes
To understand causes of different changes of the tuning curves of V1 neurons (Fig. 4), we explored stimulus dependence of neural changes in V2. Learning resulted in strengthening connections from excitatory neurons representing the trained stimulus in V1 to excitatory neurons representing the trained stimulus in V2 (Fig. 5A). Higher activity in those V2 neurons resulted in strong feedback inputs to all V1 neurons (Fig. 5D), which led to overall reduction of neural responses in V1 due to shunting inhibition (Fig. 5E, red lines). A novel stimulus activated a population of V2 neurons that included some V2 neurons with previously modified connections and other V2 neurons with unmodified connections (Fig. 5B). Hence, the feedback inputs from the experienced V2 neurons were combined with feedback inputs from naïve V2 neurons, which resulted in a lesser increase of the overall feedback inputs to V1 neurons (Fig. 5D) and led to a sharper tuning curve (Fig. 5E, green lines). Finally, a stimulus that activated V2 neurons with unmodified synapses (Fig. 3C) did not change the feedback inputs to V1 (Fig. 5D), therefore, no changes of tuning curves were observed in V1 neurons (Fig. 5E, purple lines). Thus, after learning, strength of the feedback input depended on orientation of a stimulus: The feedback inputs were the strongest for the trained orientation and weakened as stimulus orientation moved away from the trained orientation.
Figure 5. Stimulus specificity of tuning curve changes.
A. Training the model with stimulus A strengthened the feedforward and feedback connections between stimulus-specific populations of V1 and V2 neurons. B. A test stimulus B (green) activated population of neurons in V1 and V2 that included some neurons with the modified synapses. The red circle shows where the trained stimulus A was presented to the model. C. Another test stimulus C (purple) activated populations of V1 and V2 neurons that did not include neurons with modified synapses. D. Before training, the strength of the feedback inputs was equal for any applied stimulus (grey dashed line). After training, the strength of feedback inputs depended on the applied stimulus (black solid line). E. Stimulus specificity of changes to tuning curves. Peaks of tuning curves did not change, but amplitudes and widths of the tuning curves changed depending on the distance from the trained orientation.doi:10.1371/journal.pcbi.1003770.g005
Effect of feedbacks on response functions in V1
To understand how varying strength of the feedback inputs led to either firing rate reduction or sharpening of the tuning curves of V1 neurons (Fig. 4A and 4C), we analyzed how recurrent interactions within V1 network change response properties of V1 neurons by comparing the responses of two V1 neurons positioned at different locations with respect to the stimuli.
In agreement with experimental data from V1 –, recurrent interactions among V1 neurons increased responses of strongly responding V1 neurons and suppressed responses of weakly responding V1 neurons (Fig. 6A). This occurred because recurrent interactions effectively increased nonlinearity of input-output relations in V1 neurons (Fig. 6B). The new input-output function had an intermediate area where the slope changed most strongly. We refer to this region as an area of strong nonlinearity.
Figure 6. Effect of feedbacks on population response in V1.
A. Population response in V1 to a stimulus before training, with (black) and without (grey) recurrent connections among V1 neurons. B. Input-output function in V1 neurons, with (black) and without (grey) recurrent connections among V1 neurons. C. Population response in V1 to the trained stimulus (preferred stimulus for neuron A) before and after training. D. Responses of neurons A and B to the trained stimulus (preferred for neuron A) changed due to feedback. Black line indicates input-output relation in V1. Blue arrows indicate the strength of feedback inputs. Black and grey filled circles represent neural response of neurons A and B to the trained stimulus before and after training. E. Population response in V1 to a novel stimulus (preferred for neuron B), before and after training with the stimulus preferred for neuron A. F. Responses of neurons A and B to the novel stimulus (preferred for neuron B) changed due to feedback. Black line indicates input-output relation in V1. Blue arrows indicate feedback inputs. Black and grey filled circles represent neural responses to stimulus preferred for neuron B before and after training.doi:10.1371/journal.pcbi.1003770.g006
The trained stimulus, which was the preferred stimulus for neuron A (Fig. 6C), evoked strong feedback inputs and resulted in proportional reduction of neural responses in both strongly (e.g. neuron A) and weakly (e.g. neuron B) responding V1 neurons (Fig. 6C). This proportional reduction was because the strong feedback equally affected neurons A and B by shifting responses in both neurons beyond the area of strong nonlinearity (Fig. 6D).
A novel stimulus, which was the preferred for neuron B, evoked weaker feedback inputs and led to the sharpening of V1 neural responses (Fig. 6E). This sharpening was because not-so-strong feedback affected neurons A and B differently. The feedback shifted the response of neuron A beyond the area of strong nonlinearity, which led to a strong reduction of its response. In contrast, the response of neuron B remained outside the area of strong nonlinearity and displayed only a minor decrease (Fig. 6F). This difference in the firing rate change of different V1 neurons resulted in sharpening of the population response (Fig. 6E).
Thus, the strong nonlinearity of the input-output function of V1 neurons and the varying strength of the feedback inputs produced different changes in the neural population, reducing the responses of some neurons and sharpening the tuning curves of others. These changes of the population responses observed in our model were similar to the reported changes of the tuning curves in V1 neurons following perceptual learning –.
In the primary auditory, somatosensory, and motor cortices, learning leads to dramatic increases in the number of neurons that represent the trained stimuli –. In the primary visual cortex (V1), topographic reorganization was observed following severe sensory changes –, which raised the question of whether such changes in V1 can also occur during normal perceptual learning . Topographic reorganization in V1 have not been reported in any study following perceptual learning. Here we have shown cellular and synaptic mechanisms of cortical plasticity that can preserve the topographic organization in area V1 while allowing changes to the properties of V1 neurons. These results suggest that learning to discriminate simple visual stimuli may evoke changes that are different from the topographic reorganization observed in other sensory cortices. The feedback mechanism for learning proposed here may not, however, be limited to the visual system. Other sensory modalities may share similar mechanisms, depending on the particular learning task.
Scope of the model
Our model pertains to experiments that involve learning to discriminate low-level features of visual stimuli presented at a particular location within receptive field of V1 neurons. We explored here if learning-induced changes in V1 were not due to synaptic plasticity of short-range recurrent connections among nearby V1 neurons within a hypercolumn but instead were due to changes in feedback inputs to V1 neurons from neurons in higher visual areas. There may be other types of plasticity in the long-range horizontal connections between distant hypercolumns that can explain other types of learning experiments involving complex tasks and large stimuli –.
Robustness of the model
Reduction of neural responses and sharpening of tuning curves in our model resulted from strong nonlinearity of input-output relations in V1 neurons and varying strengths of stimulus evoked feedback inputs to V1 neurons. The intrinsic nonlinearity of input-output relations in V1 neurons was further amplified by recurrent interactions. The variation of strengths of the feedback inputs resulted from the assumption that a population of V2 neurons representing a stimulus had a finite size. Therefore, the trained and novel stimuli evoked responses in an overlapping but different neuronal populations, which resulted in different feedback inputs to V1 neurons upon presentation of the trained vs. novel stimuli. Thus, both reduction of the neural responses and sharpening were observed in V1 network but in different populations of V1 neurons with respect to the location of stimulation. The learning process in the model was incremental: More training resulted in stronger feedforward and feedback connections, and therefore led to stronger reduction and sharpening. Robustness of the results was tested by varying the synaptic weights in the model, which produced consistent behavior over a range of parameter values. Other aspects of the model were based on neural data and did not affect the conclusions.
Shunting inhibition and gain modulation
In a previous study, driving a spiking neuron with balanced excitation and inhibition currents changed the slope of the gain function (input-output function) . The changes of the gain functions were caused by shunting inhibition due to balanced excitation and inhibition and noise in the input currents. However, in perceptual learning experiments analysis of noise in V1 neural responses before and after learning did not show any change in the noise level . In the current model, input noise did not change with training because the firing rates in V1 did not increase with learning, and firing rates in V2 were maintained through the feedback mechanism. Thus, in the model, balanced excitatory and inhibitory feedback currents were solely responsible for the subtractive inhibition in V1 neurons, in agreement with the experiments.
Learning and adaptation
In our model, the feedback mechanism of learning resulted in symmetric changes of the tuning curves in V1. However, tuning curves of V1 neurons can in fact adapt and become asymmetric in response to repeated stimulus presentation . This adaptation may be due to short-term synaptic depression and facilitation in the recurrent connections, which can result in asymmetric changes of the tuning curves. In contrast, the changes in V1 discussed in our study are due to long-term changes in the feedforward and feedback connections.
Both adaptation and learning could take place during stimulation and two processes could interact with each other –. The critical distinction between adaptation and learning is that learning, unlike adaptation, is task dependent. Both adaptation and learning can take various forms due to diversity of plasticity mechanisms (Hebbian, homeostatic, reinforcement, etc) that could be evoked by the stimulus . However, with learning to perform a task, changes that enhance performance are reinforced, and changes that do not improve performance are suppressed, a distinction that may depend on a reinforcement signal. We have not included a reinforcement signal in our model, and instead assumed that plasticity of feedforward and feedback connections somehow depended on the task. Although recurrent connections did not contribute to learning in our model, they could be the basis for adaptation. Thus, both learning and adaptation can occur simultaneously and their relative contribution can be context specific.
Specificity of perceptual learning
In many experiments on visual perceptual learning, the improvements of perception were stimulus specific –, suggesting that early visual areas were possible sites for the changes underlying visual perceptual learning. However, under some conditions learning can be generalized to other locations in the visual field , . These observations can be explained by stimulus-invariant changes occurring in higher decision-making cortical areas that augment those in lower visual areas.
In our model of learning-induced plasticity of V1, we did not consider if/how changes in V1 could improve perception. In order to understand how perceptual learning could be generalized to other stimuli and locations, we would need to expand the model to include read-out decision-making circuits. However, modeling plasticity in the higher cortical areas, in addition to the changes in V1, is beyond the scope of this study, which is focused on changes that have been observed in V1.
Our study suggests that two previously reported inconsistent experimental results – may represent recordings from two different populations of V1 neurons: One population of neurons that prefer the trained stimulus, and another that prefer different stimuli but still respond to the trained stimulus.
Our model also predicts that learning results in strengthening feedback inputs into V1, which cause shunting inhibition in V1 neurons. This novel mechanism of learning can be tested by measuring input resistances in relevant V1 pyramidal cells during in vivo stimulation before and after learning.
Despite of limited nature of learning-induced changes in V1, these changes could contribute to other learning-dependent changes in visual cortex, because of the hierarchical organization of the visual system –. Indeed, a learning-induced sharpening of orientation tuning curves was observed in an extrastriate visual area V4 , which could be at least partially due to more sharply-tuned inputs from V1.
Feedback projections are ubiquitous in cortex –, but despite recent progress –, little is known about functional roles of feedback connections in cortical plasticity. Our work presents a new hypothesis for the role of the feedback connections in cortical plasticity. We propose that top-down inputs are plastic and involved in perceptual learning. This prediction can be tested by blocking synaptic plasticity in extrastriate visual cortical areas and observing whether this would diminish learning-induced improvement of behavior.
Spiking neuron network model of visual cortex
We explore the feedback hypothesis in a spiking neural network model of the visual cortex (Fig. 2). The model consisted of two layers. Layer one represented the primary visual cortex V1 and layer two represented a higher cortical area V2.
In the biological visual cortex, feedforward inputs from V1 drive activity in V2 neurons, but feedback inputs from V2 neurons back to V1 do not drive but modulate activity in V1 –, thus avoiding a strong positive feedback loop that could lead to uncontrolled epileptic-like oscillations . In the model, V1 neurons activated V2 neurons through the convergent feedforward connections (Fig. 2). The diffuse feedback inputs from V2 did not drive V1 neurons, but altered their response functions through shunting inhibition mechanism –. Shunting inhibition in the model was due to the balanced excitatory and inhibitory to the excitatory V1 neurons, which modulated neural responses in V1 neurons by subtracting neural responses to driving stimuli.
In the primary visual cortex, orientation selectivity of layer 2/3 neurons are formed by orientation-tuned feedforward inputs from layer 4 neurons, and by recurrent interactions among layer 2/3 neurons . Orientation selectivity of layer 4 simple cells in turn is formed by feedforward inputs from arranged LGN cells . In this model, we did not model LGN and layer 4 neurons. Layer 2/3 neurons receive a bell-shaped input, which represented orientation tuned inputs from layer 4 cells. The neurons in V1 layer were organized with preferred orientations evenly spaced along one-dimensional network. Stimuli of different orientations were modeled by shifting the center of the input along one-dimensional V1 network.
V1 layer contained 100 excitatory and 25 inhibitory neurons, which represented layer 2/3 of V1. Both the excitatory and inhibitory neurons were simulated using Hodgkin-Huxley type neuron model with sets of parameters resulting in regular spiking activity .
where Ve is membrane potential of an excitatory neuron, m, h, n are the gating variables of voltage-gated sodium and potassium channels, gL is maximum conductance of the leak current, gNa is maximum conductance of sodium current, gK is maximum conductance of potassium current, VL is reversal potential of the leak current, VNa is reversal potential for sodium currents, VK is reversal potential for potassium currents, [Ca] is the intracellular concentration of free calcium ions, and gAHP is the maximum conductance of the calcium-dependent potassium current.
Model parameters were chosen to fit the spike properties of regular spiking pyramidal neurons: gLe = 0.05, gNa = 100, gK = 40, gCa = 0.9, gAHP = 0.05, VL = −65, VNa = 55, VK = −80, VCa = 120, τCa = 100.
The membrane potential of the inhibitory neurons was indicated as follows(14)
where Vi is membrane potential of an inhibitory neuron, and m, h, n are the gating variables for the ionic currents. The dynamics of the gating variables m, h, n were the same as for the excitatory neuron, the only differences between excitatory and inhibitory neurons were, first, that the inhibitory neurons lacked the IAHP current and, second, in the inhibitory interneurons membrane, time constants were shorter. Since the membrane time scale τmem is related to the membrane leak conductance gL as τmem~1/gL, we have chosen in the inhibitory cells gLi = 0.1 and in the excitatory cells gLe = 0.05. Thus, the dynamics of the inhibitory cells was faster compared to the dynamics of the excitatory cells.
Synaptic currents to an excitatory neuron were then calculated according to(15)
Synaptic current to an inhibitory neuron:(16)
where Ve is membrane potential of an excitatory neuron, Vi is membrane potential of an inhibitory neuron, se is synaptic gating variables of AMPA currents, si is synaptic gating variable of GABAa current, fe, fi are synaptic depression factors, and Vie = 80, Vee = 0, Vei = 0.
Models for the AMPA receptor and GABA receptor were applied to simulate excitatory connections and inhibitory connections, respectively(17)
where se is a synaptic gating variable of AMPA current, and si is a synaptic gating variable of GABAa current, τAMPA = 2 and τGABAa = 2.
The V2 layer contained 100 excitatory neurons. To model the excitatory neurons in V2, we used Hodgkin-Huxley equations with the same parameters as those used for layer one excitatory neurons.
Connections within layers.
The excitatory and inhibitory neurons in V1 were connected through recurrent connections. Weights of the recurrent connections were distance-dependent and followed Gaussian distributions with s.d. = 10 neurons. The ratio between excitatory and inhibitory weights were chosen to balance recurrent excitation and inhibition in V1 neurons. The recurrent connections did not change with learning. There were no recurrent connections among V2 neurons.
Connections between layers.
The excitatory neurons in V1 layer projected to the excitatory neurons in V2 layer through convergent feedforward connections. Probability of feedforward connections depended on corresponding locations of neurons in V1 and V2, and were randomly selected from Gaussian distributions with s.d. = 5 neurons, which resulted in a compact stimulus representation in V2 layer. The feedback connections from excitatory V2 neurons projected uniformly to all (excitatory and inhibitory) neurons in V1.
We simulated stimulus learning in the model by repeatedly presenting a stimulus with a particular orientation. Training the model strengthened excitatory feedforward connections from neurons representing the trained stimulus in V1 to neurons representing the trained stimulus in V2. Strong feedforward connections increased activity in V2 neurons, which in turn triggered plasticity of feedback connections.
Plasticity of feedforward connections.
Feedforward connections from the excitatory V1 neurons to V2 neurons were adjusted according to a Hebbian learning rule. In the learning rule, we used intracellular calcium concentration as an indicator of a neural activity (19)
where τHebb = 100 msec is time scale of Hebbian learning, is the strength of a feedforward connection from an excitatory V1 neuron j to V2 neuron i, is intracellular calcium concentration in the excitatory V1 neuron i, is intracellular calcium concentration in the excitatory V2 neuron j.
Plasticity of feedback connections.
The feedback projections allowed V2 neurons to decrease activity in V1 when neurons in V2 were activated strongly by feedforward inputs from V1. In order to achieve this modulatory effect in the model, the strength of the feedback connections were adjusted according to a plasticity rule(20)
where τFB = 500 msec is a time scale of feedback plasticity, is the strength of the feedback connection from V2 neuron i to the excitatory and inhibitory V1 neurons, is an intracellular calcium concentration in the excitatory V2 neuron i, is a homeostatic value of the intracellular calcium concentration in the excitatory V2 neurons, which was calculated as a time averaged value of the intracellular calcium concentration in the excitatory V2 neurons.
We would like to thank Thomas Albright for comments on the manuscript, and Catarina Fernandes for help with figure preparation.
Conceived and designed the experiments: SM TJS. Performed the experiments: SM. Analyzed the data: SM MB. Contributed reagents/materials/analysis tools: SM. Wrote the paper: SM MB TJS. Supervised the research: TJS.
- 1. Buonomano DV, Merzenich MM (1998) Cortical plasticity: from synapses to maps. Annu Rev Neurosci 21: 149–186. doi: 10.1146/annurev.neuro.21.1.149
- 2. Sereno MI (2005) Neuroscience: plasticity and its limits. Nature 435: 288–289. doi: 10.1038/435288a
- 3. Gilbert CD, Sigman M, Crist RE (2001) The neural basis of perceptual learning. Neuron 31: 681–697. doi: 10.1016/s0896-6273(01)00424-x
- 4. Fiorentini A, Berardi N (1980) Perceptual learning specific for orientation and spatial frequency. Nature 287: 43–44. doi: 10.1038/287043a0
- 5. Karni A, Sagi D (1991) Where practice makes perfect in texture discrimination: evidence for primary visual cortex plasticity. Proc Natl Acad Sci USA 88: 4966–4970. doi: 10.1073/pnas.88.11.4966
- 6. Fahle M (2005) Perceptual learning: specificity versus generalization. Curr Opin Neurobiol 15: 154–160. doi: 10.1016/j.conb.2005.03.010
- 7. Schoups A, Vogels R, Qian N, Orban G (2001) Practising orientation identification improves orientation coding in V1 neurons. Nature 412: 549–553. doi: 10.1038/35087601
- 8. Ghose GM, Yang T, Maunsell JH (2002) Physiological correlates of perceptual learning in monkey V1 and V2. J Neurophysiol 87: 1867–1888.
- 9. Teich AF, Qian N (2003) Learning and adaptation in a recurrent model of V1 orientation selectivity. J Neurophysiol 89: 2086–2100. doi: 10.1152/jn.00970.2002
- 10. Roelfsema PR, van Ooyen A (2005) Attention-gated reinforcement learning of internal representations for classification. Neural Comput 17: 2176–214. doi: 10.1162/0899766054615699
- 11. Chance FS, Abbott LF, Reyes AD (2002) Gain modulation from background synaptic input. Neuron 35: 773–782. doi: 10.1016/s0896-6273(02)00820-6
- 12. Holt GR, Koch C (1997) Shunting inhibition does not have a divisive effect on firing rates. Neural Comput 9: 1001–1013. doi: 10.1162/neco.19188.8.131.521
- 13. Callaway EM (1998) Local circuits in primary visual cortex of the macaque monkey. Annu Rev Neurosci 21: 47–74. doi: 10.1146/annurev.neuro.21.1.47
- 14. Douglas RJ, Koch C, Mahowald M, Martin KA, Suarez HH (1995) Recurrent excitation in neocortical circuits. Science 269: 981–985. doi: 10.1126/science.7638624
- 15. Ferster D, Miller KD (2000) Neural mechanisms of orientation selectivity in the visual cortex. Annu Rev Neurosci 23: 441–471. doi: 10.1146/annurev.neuro.23.1.441
- 16. Recanzone GH, Merzenich MM, Jenkins WM, Grajski KA, Dinse HR (1992) Topographic reorganization of the hand representation in cortical area 3b owl monkeys trained in a frequency-discrimination task. J Neurophysiol 67: 1031–1056.
- 17. Recanzone GH, Merzenich MM, Schreiner CE (1992) Changes in the distributed temporal response properties of SI cortical neurons reflect improvements in performance on a temporally based tactile discrimination task. J Neurophysiol 67: 1071–1091.
- 18. Recanzone GH, Schreiner CE, Merzenich MM (1993) Plasticity in the frequency representation of primary auditory cortex following discrimination training in adult owl monkeys. J Neurosci 13: 87–103.
- 19. Nudo RJ, Milliken GW, Jenkins WM, Merzenich MM (1996) Use-dependent alterations of movement representations in primary motor cortex of adult squirrel monkeys. J Neurosci 16: 785–807.
- 20. Moldakarimov S, McClelland JL, Ermentrout GB (2006) A homeostatic rule for inhibitory synapses promotes temporal sharpening and cortical reorganization. Proc Natl Acad Sci USA 103: 16526–16531. doi: 10.1073/pnas.0607589103
- 21. Kaas JH, Krubitzer LA, Chino YM, Langston AL, Polley EH, Blair N (1990) Reorganization of retinotopic cortical maps in adult mammals after lesions of the retina. Science 248: 229–231. doi: 10.1126/science.2326637
- 22. Gilbert CD, Wiesel TN (1992) Receptive field dynamics in adult primary visual cortex. Nature 356: 150–152. doi: 10.1038/356150a0
- 23. Karmarkar UR, Dan Y (2006) Experience-dependent plasticity in adult visual cortex. Neuron 52: 577–585. doi: 10.1016/j.neuron.2006.11.001
- 24. Wandell BA, Smirnakis SM (2009) Plasticity and stability of visual field maps in adult primary visual cortex. Nat Rev Neurosci 10: 873–884. doi: 10.1038/nrn2741
- 25. Herzog MH, Fahle M (1998) Modeling perceptual learning: difficulties and how they can be overcome. Biol Cybern 78: 107–117. doi: 10.1007/s004220050418
- 26. Tsodyks M, Gilbert C (2004) Neural networks and perceptual learning. Nature 431: 775–781. doi: 10.1038/nature03013
- 27. Moldakarimov S, Bazhenov M, Sejnowski TJ (2010) Perceptual priming leads to reduction of gamma frequency oscillations. Proc Natl Acad Sci USA 107: 5640–5645. doi: 10.1073/pnas.0907525107
- 28. Dragoi V, Rivadulla C, Sur M (2001) Foci of orientation plasticity in visual cortex. Nature 411: 80–86. doi: 10.1038/35075070
- 29. Harris H, Gliksberg M, Sagi D (2012) Generalized perceptual learning in the absence of sensory adaptation. Curr Biol 22: 1813–1817. doi: 10.1016/j.cub.2012.07.059
- 30. McGovern DP, Roach NW, Webb BS (2012) Perceptual learning reconfigures the effects of visual adaptation. J Neurosci 32: 13621–13629. doi: 10.1523/jneurosci.1363-12.2012
- 31. Bazhenov M, Huerta R, Smith BH (2013) A computational framework for understanding decision making through integration of basic learning rules. J Neurosci 33: 5686–97. doi: 10.1523/jneurosci.4145-12.2013
- 32. Feldman DE (2009) Synaptic mechanisms for plasticity in neocortex. Annu Rev Neurosci 32: 33–55. doi: 10.1146/annurev.neuro.051508.135516
- 33. Xiao LQ, Zhang JY, Wang R, Klein SA, Levi DM, et al. (2008) Complete transfer of perceptual learning across retinal locations enabled by double training. Curr Biol 18: 1922–1926. doi: 10.1016/j.cub.2008.10.030
- 34. Felleman DJ, Van Essen DC (1991) Distributed hierarchical processing in the primate cerebral cortex. Cereb Cortex 1: 1–47. doi: 10.1093/cercor/1.1.1
- 35. Lamme VA, Supèr H, Spekreijse H (1998) Feedforward, horizontal, and feedback processing in the visual cortex. Curr Opin Neurobiol 8: 529–535. doi: 10.1016/s0959-4388(98)80042-1
- 36. Yang T, Maunsell JH (2004) The effect of perceptual learning on neuronal responses in monkey visual area V4. J Neurosci 24: 1617–1626. doi: 10.1523/jneurosci.4442-03.2004
- 37. Salin PA, Bullier J (1995) Corticocortical connections in the visual system: structure and function. Physiol Rev 75: 107–154.
- 38. Bullier J (2003) What is fed back? In: van Hemmen JL, Sejnowski TJ, editors. 23 problems in systems neuroscience. New York: Oxford UP. pp. 103–132.
- 39. Li W, Piëch V, Gilbert CD (2004) Perceptual learning and top-down influences in primary visual cortex. Nat Neurosci 7: 651–657. doi: 10.1038/nn1255
- 40. Sillito AM, Cudeiro J, Jones HE (2006) Always returning: feedback and sensory processing in visual cortex and thalamus. Trends Neurosci 29: 307–316. doi: 10.1016/j.tins.2006.05.001
- 41. Ramalingam N, McManus JN, Li W, Gilbert CD (2013) Top-down modulation of lateral interactions in visual cortex. J Neurosci 33: 1773–1789. doi: 10.1523/jneurosci.3825-12.2013
- 42. Gilbert CD, Li W (2013) Top-down influences on visual processing. Nat Rev Neurosci 14: 350–363. doi: 10.1038/nrn3476
- 43. Sherman SM, Guillery RW (1998) On the actions that one nerve cell can have on another: distinguishing “drivers” from “modulators”. Proc Natl Acad Sci USA 95: 7121–7126. doi: 10.1073/pnas.95.12.7121
- 44. Abbott LF, Chance FS (2005) Drivers and modulators from push-pull and balanced synaptic input. Prog Brain Res 149: 147–155. doi: 10.1016/s0079-6123(05)49011-1
- 45. Crick F, Koch C (1998) Constraints on cortical and thalamic projections: the no-strong-loops hypothesis. Nature 391: 245–250.
- 46. Hubel DH, Wiesel TN (1962) Receptive fields, binocular interaction and functional architecture in the cat's visual cortex. J Physiol 160: 106–154.
- 47. Moldakarimov S, Rollenhagen JE, Olson CR, Chow CC (2005) Competitive dynamics in cortical responses to visual stimuli. J Neurophysiol 94: 3388–3396. doi: 10.1152/jn.00159.2005
- 48. Helmchen F, Imoto K, Sakmann B (1996) Ca2+ buffering and action potential-evoked Ca2+ signaling in dendrites of pyramidal neurons. Biophys J 70: 1069–1081. doi: 10.1016/s0006-3495(96)79653-4