A neural field model is presented that captures the essential non-linear characteristics of activity dynamics across several millimeters of visual cortex in response to local flashed and moving stimuli. We account for physiological data obtained by voltage-sensitive dye (VSD) imaging which reports mesoscopic population activity at high spatio-temporal resolution. Stimulation included a single flashed square, a single flashed bar, the line-motion paradigm – for which psychophysical studies showed that flashing a square briefly before a bar produces sensation of illusory motion within the bar – and moving squares controls. We consider a two-layer neural field (NF) model describing an excitatory and an inhibitory layer of neurons as a coupled system of non-linear integro-differential equations. Under the assumption that the aggregated activity of both layers is reflected by VSD imaging, our phenomenological model quantitatively accounts for the observed spatio-temporal activity patterns. Moreover, the model generalizes to novel similar stimuli as it matches activity evoked by moving squares of different speeds. Our results indicate that feedback from higher brain areas is not required to produce motion patterns in the case of the illusory line-motion paradigm. Physiological interpretation of the model suggests that a considerable fraction of the VSD signal may be due to inhibitory activity, supporting the notion that balanced intra-layer cortical interactions between inhibitory and excitatory populations play a major role in shaping dynamic stimulus representations in the early visual cortex.
Understanding the functioning of the primary visual cortex requires characterization of the non-linear dynamics that underlie visual perception and of how the cortical architecture gives rise to these dynamics. Recent advances in real-time voltage-sensitive dye (VSD) imaging permit recording of cortical population activity with high spatial and temporal resolution. This wealth of data can be related to cortical function, dynamics, and architecture by computational modeling. Here we used a mesoscopic neural field model to describe brain dynamics at the population level as measured by VSD imaging. Introduced in 1972 by Wilson and Cowan, these models are derived from statistical mechanics to analyze the collective properties of large numbers of neurons. For simplicity, the cortical planar tissue is assumed to contain only two types of homogeneously distributed neurons (excitatory and inhibitory) that interact via recurrent lateral connections. This study shows 1) how a concise neural field model can simulate VSD data quantitatively in space and time by identifying the underlying non-linear dynamics, 2) how such a model can support hypotheses about visual information processing, and 3) how the model can be linked to the neuronal architecture.
Citation: Markounikau V, Igel C, Grinvald A, Jancke D (2010) A Dynamic Neural Field Model of Mesoscopic Cortical Activity Captured with Voltage-Sensitive Dye Imaging. PLoS Comput Biol 6(9): e1000919. doi:10.1371/journal.pcbi.1000919
Editor: Olaf Sporns, Indiana University, United States of America
Received: August 20, 2009; Accepted: August 4, 2010; Published: September 9, 2010
Copyright: © 2010 Markounikau et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: The authors acknowledge support from the German Federal Ministry of Education and Research (BMBF) within the Bernstein group “The grounding of higher brain function in dynamic neural fields”, project number 01GQ0704. The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Visual cortical activity does not exclusively mirror visual input but rather reflects the contribution of additional recurrent processes involving lateral and local feedback couplings. Understanding cortical processing requires a theoretical understanding of the underlying activity dynamics, which can be attained by modeling at various levels of abstraction. Naturally, the chosen level should match the level at which neuronal recordings are made . The activity patterns observed using voltage-sensitive dye (VSD) imaging reflect population activity at the mesoscopic (intra-areal) level , . This suggests the application of mean-field models in which large numbers of neurons are averaged. Moreover, we are interested in the relation of neuronal dynamics to the spatial dimensions of the cortical sheet (and more generally to metric embeddings spanned by more abstract parameters, see , ). Neural field (NF) models , –, in which the efficacy of synaptic coupling depends on the notion of distance between neurons or ensembles of neurons, are therefore our preferred choice. Here, we show that a minimalistic multiple-layer NF models can simulate mean VSD data in space and time with high accuracy. The model is an abstract functional description of VSD-recorded dynamics. Thus, it is in the first place phenomenological. However, its interpretation in biological terms allows to link its structure and parameters to the neuronal functional architecture.
The imaging data that we model showed: i) Two stationary stimuli (a square and an elongated bar) presented in rapid succession produce a pattern that signals propagation of activity across the bar's retinotopic representation in early visual cortex. ii) The obtained pattern was different from activity when the bar was flashed alone, and did not match the simple superposition of activities evoked by individually-presented square and bar stimuli. iii) Rather, we observed propagation of a wave front of activity that was also found when a square stimulus moved physically in visual space .
Based on the VSD imaging data , we hypothesized that a two-layer neural field – model can account for the findings i–iii. If so, this would imply that the feedback from higher brain areas is not a principal requirement to produce motion patterns across primary visual cortex upon presentation of a square and a bar flashed in rapid succession (as debated, e.g., in –).
Voltage sensitive dye imaging measures relative fluorescence changes that are linearly correlated to changes in membrane potentials ,). This technique currently allows recording of in vivo cortical activity at sub- as well as suprathreshold level with at least 10 ms temporal resolution and a spatial resolution of 50 m across several millimeters of cortex. Hence, it is well suited to capture the real-time dynamics of millions of neurons at once. However, the signal does not distinguish between excitatory or inhibitory contributions to the overall activity. Therefore, our model explicitly assumes that the VSD signal reflects a mixture of activity from excitatory and inhibitory neuronal populations, and thus contrasts with studies that interpret VSD data as mainly reflecting excitatory activity (e.g., –). We expect to gain insights about the relative contributions of excitatory and inhibitory activities in the VSD signal, because the model allows separate inspection of its inhibitory and excitatory layers.
In the following, we first describe the underlying data and its preprocessing, our model structure, and our parameter identification procedure. Then we present the results including the model fit in comparison to further simplified models, the model prediction regarding similar yet novel stimuli, and the results of a standard linear stability analysis of the homogeneous solution of the model. We then follow with a discussion of the findings in relation to alternative modeling approaches, the physiological interpretation of our model, and the role of excitation and inhibition in the model. Finally, we consider our results in the context of hypotheses concerning the cortical representation of motion and the origin of the line-motion illusion.
The data underlying this study were recorded by Jancke et al. at the Department of Neurobiology at the Weizmann Institute of Science in Israel using VSD imaging of cat visual cortex , , . Animals were initially anesthetized with a mixture of ketamine (15 mg ) and xylazine (1mg ). After tracheotomy, animals were respirated and anesthetized with 1.5% halothane (0.8% during recordings) in a 1:1 mixture of and O. The animals were paralyzed with pancuronium bromide (0.2 mg , intravenously). Area 18 was stained for 2.5–3 h with the voltage-sensitive dye RH-1691. Its molecules bind to the external surface of excitable membranes and transform changes in membrane potential into changes in fluorescence intensity, which is correlated linearly with membrane potentials of layer 2 and 3 cortical neurons , . Using a high-speed camera, the VSD signals were recorded with a temporal resolution of 9.6 ms. Stimuli were presented binocularly. The projection of the area centralis to the monitor screen was determined using a fundus camera. If necessary, projection of the eyes was converged using a prism in front of the eye that was ipsilateral to the recorded hemisphere. To control for possible eye drift during the experiment, the position of the area centralis and receptive field positions were measured repeatedly. The stationary stimuli were a square of and a bar of . Both stimuli were aligned with their upper edges. The line-motion (LM) stimulus consisted of a square briefly presented before the bar. Additionally, squares were moved vertically with 4, 8, 16, and 32 deg/s. Stimuli were placed at eccentricity. In the LM setting the square was presented for 50 ms followed by an inter-stimulus interval of 10 ms, after which the bar was presented for 130 ms. In single presentations the square and the bar were displayed with the same individual timings as in the LM condition.
The imaged signals () reflect relative changes in fluorescence compared to baseline: Imaging data were normalized by its DC level during pre-stimulus period (200 ms) for each pixel; heart-beat and respiration-related artifacts were removed by dividing by the average of “blank” signals recorded in absence of stimulation. For more details about the imaging methods we refer to .
We restrict our analysis to the first 250 ms of the VSD recordings during which propagation of activity was observed. The VSD data are sequences of frames that image 3 mm7 mm of cortex. This area was discretized into 2450 pixels (px). We denote the fluorescence change represented by a pixel at position at time by . As the stimulus representations in this study vary only along the posterior-anterior cortical axis we reduced the dimensionality of the data by averaging along the medial-lateral cortical axis (as done, e.g., in ), see Figure 1. For each vertical position and time step , we define , where () and (). To eliminate the low signal-to-noise at the border of the representations, activity was averaged across the central pixels 4–20. These values were defined as mean standard deviation of a Gaussian function fitted to the distribution of activity values across x-axis in the flashed bar condition (see Figure S1 in Text S1). However, the exact choice of these positions did not affect the results. Given this dimension reduction, the variable is from hereon referred to as for clarity. Finally, the VSD data were additionally normalized using the mean level of activity when no stimulus was presented as reference. That is, for each stimulus condition the activity was averaged over the first 20 ms and all and the result was subtracted from the data.
Figure 1. Deriving a space-time diagram of the VSD signals.
The two-dimensional VSD image frames were averaged along the horizontal axis (thin vertical lines highlight the spatial region considered for averaging) to reduce the data to one spatial dimension. The vertical axis of the camera frame corresponds to the visual field azimuth representation in the cortex, where stimuli in the lower visual field are represented in anterior direction . The exact position of the optical chamber was guided by the layout of cat area 18 retinotopic map around the trepanation site (Horsley-Clarke A0–A10, 1–5 mm from midline) and verified through sampling of several receptive field locations prior to and partly during imaging sessions. The fact that the bar representation is drawn-out towards anterior (see upper black arrows), starting from the square representation (frames 48–58 ms) is interpreted as a motion signal. It also supports the correct settings as the square was presented at the upper end of the bar in visual field coordinates. In this study, we used the space-time activity patterns for modeling, with the spatial dimension on the ordinate and time on the abscissa. The colorbar indicates levels of activity (, see “Methods”), A = anterior, M = medial.doi:10.1371/journal.pcbi.1000919.g001
We aimed for a model that quantitatively captures the spatio-temporal cortical dynamics observed by VSD imaging in response to the stimuli described above. The model should have as few parameters as possible, and these parameters should allow for functional interpretations (e.g., in terms of lateral interactions and time constants). The model should be at the same level of abstraction as the neuronal data. As our data reflect the dynamics of neuronal populations and describe the spread of activity across the cortical sheet, NF models are an appropriate choice , , , , .
The model is one-dimensional as the dynamics of interest evolve in one dimension along the (apparent) movement direction as described above. Our two-layer NF is governed by the following system of integro-differential equations:(1)
where and denote the mean membrane potentials of model neurons at cortical position and time in the excitatory and inhibitory layer, respectively, and and are the corresponding time constants. The resting potentials are determined by and . The transfer functions (or axonal response functions) and are represented by sigmoidal functions of the membrane potential, which relates depolarization to firing rate. For instance, is given by(3)
The parameter describes the slope of the response function and its threshold value. The transfer function is parameterized analogously. The efficacy of the synaptic connectivity between two positions and is assumed to be translation invariant and isotropic. It is given by gain factors , , and synaptic strength (weight) functions and of Gaussian shape. For example, the coupling from the excitatory to the inhibitory layer is modeled by(4)
The parameter controls the width and controls the strength of the interactions. Eccentricity in the imaged region of area 18 (see legend Figure 1) is approximately linear along the vertical meridian ,  mapping one degree of the visual field to mm of cortex. The external visual stimulus mapped accordingly to cortical coordinates is denoted by , and the afferent input is computed by smoothing the stimulus by convolution with a Gaussian function . The afferent input couples only into the excitatory layer, and the inhibition is coupled into the excitatory layer locally.
There are several reasons for the local coupling from the inhibitory to the excitatory layer. From a technical point of view, we want our model to have as few parameters as possible. Equations 1 and 2 can be viewed as the minimal extension of the original Amari neural field model  to distinct dynamics for excitatory and inhibitory neurons (see also Eqn 10), allowing for different time constants and making it consistent with Dale's law (we added the response function such that all communication between neurons can be interpreted as being encoded by mean firing rates). The resulting model is similar to the dynamics considered in , and it can be argued that the local coupling resembles physiology because the majority of interneurons projects locally .
The presented NF model is parameterized by 15 values. However, because all model neurons communicate only through the transfer function (see Eqns 1 and 2), shifting of resting potentials and can be compensated by changing the transfer function thresholds and in Eqn 3 such that the dynamics are not affected. Thus the parameters and are redundant.
The VSD data reflect the activity of both excitatory and inhibitory populations of neurons. Accordingly, we define the modeled VSD signal to be a combination of the field's excitatory and inhibitory activities. We assume an affine linear mixture(5)
with the non-negative coefficients and controlling how strongly excitatory and inhibitory activity is reflected in the dye signal, and is some offset , . We do not explicitly consider units of measurement to keep the notation uncluttered. Formally, the dye signal is measured in change of fluorescence intensity and the potentials in mV. Therefore, and have units and is measured in .
The time delay between the stimulus presentation and the response onset in the VSD data is a sum of the time the neuronal signal needs to travel from the retina to the primary visual cortex and the time the neuronal populations in the primary visual cortex need to build up a detectable activity. A fixed retino-cortical time delay of two time frames (19.2 ms) was used in our model to align the response onsets of the model and the VSD data.
In our numerical experiments, we iterated the dynamical systems defined by Eqns 1 and 2 starting from the initial conditions and for all . Then we let the system relax for some time period in the absence of afferent input. When we present our results, the time is after this relaxation phase. In our model, we had to discretize the spatial dimension. We simulated 150 spatial positions. The center 50 positions were mapped to the 50 pixels of the VSD image data. The other positions were added to avoid boundary effects and are not shown in the results.
Model parameters identification procedure
In order to explore the system parameter space we adopted a grid search procedure on a reduced parameter set. The reduced set contained 10 parameters , , , , , , , , and , where the excitatory and inhibitory resting potentials were assumed to be equal (i.e., ). We defined a grid with 3 points (chosen by educated guess, see Table 1, third column) for each parameter, which results in total to parameter configurations. The remaining parameters , , and were fixed to physiologically plausible values. The transfer function thresholds and were both set to −40 mV (see discussion of parameter redundancy in the previous section). The feed-forward gain was set to 70 to yield maximal amplitude of the input signal of about 60 mV. According to the literature, one retinal position is represented in our region of interest by a population of cortical neurons distributed around the mean position with a standard deviation of approximately 0.6 mm . The parameter , determining the feed-forward smoothing of the input (as parameter of , see Eqns 1 and 4), was therefore fixed to 4 pixels in the discretized model, which corresponds to a value of 0.51 mm.
Table 1. Summary of the model parameters.doi:10.1371/journal.pcbi.1000919.t001
After we have simulated our NF model with a given set of model parameters and obtained the spatio-temporal patterns of the excitatory and inhibitory layer in response to the stimuli used for system identification, we can compute the values , , and , see Eqn 5, using the ordinary least-squares (OLS) method under the constraints . That is, we solve(6)
where (with a slight abuse of notation) , , and refer to the concatenated signals of all stimulus configurations considered in the optimization procedure. This yields the optimal values for , , and in terms of the mean squared error between aggregated model signal and observed dye patterns for the given spatio-temporal patterns of the excitatory and inhibitory layer. From the solution, we get the aggregated signal(7)
and obtain the mixture coefficient(8)
of excitation and inhibition. The coefficient indicates that the simulated signal is comprised of excitation and inhibition (under the assumption that the values of and vary in the same interval). For optimization of the system, only four of the seven available stimulus configurations were used, namely the flashed square, the flashed bar, the LM stimulus, and a square moving at 32 deg/s. The other three stimulus conditions, squares moving at different speeds, were used to test whether the model generalizes to unseen, but related stimuli.
We selected parameter configurations from the sets produced by the grid search procedure according to the following criteria: (1) the system with given parameters is stable (see section “Analysis of Stability”); (2) after stimulus presentation, the simulated activity eventually decays to zero; (3) the correlation coefficient between the dye and the simulated data is larger than 0.8; (4) the rate of activity change during the onset period (20–70 ms for the flashed square, LM and moving square stimuli; 80–130 ms for the flashed bar stimulus) is similar in the modeled and measured responses.
In order to show that the model fit can be considerably improved by fine-tuning, we adjusted some model parameters using a randomized direct optimization algorithm. We used the selected parameter set from the grid search procedure (see Table 1) as starting point. We defined an objective function that quantifies the correlation coefficients between dye and simulated data as well as inhibition/excitation ratio:(9)
The correlation coefficients were computed between the dye and the simulated data for each stimulus configuration considered in the optimization and the trade-off parameter is set to .
This objective function is non-convex and multi-modal (i.e., there are undesired local optima). Our method of choice for such problems is the covariance matrix adaptation evolution strategy (CMA-ES) , . The CMA-ES is an iterative, direct, stochastic optimization method and one of the most efficient biologically inspired search heuristics for real-valued optimization . It has been successfully used to adapt neural field models – and is explained in detail in Text S1, section A.
VSD imaging of cortical responses to the line-motion paradigm
The imaged visual cortical area included the complete retinotopic representation of the applied stimuli. Figure 1 shows the observed evolution of activity in response to the LM paradigm within single time frames as originally recorded (upper row). After the square was presented (frame zero), activity emerged and reached suprathreshold amplitudes around the thalamic input location (see region colored yellow/red in frames 48–58 ms; verified through spike recordings at various electrode positions ). After 60 ms the bar was presented, giving rise to activity that was gradually drawn-out (68–116 ms) along the retinotopic bar representation in the anterior cortical direction (see upper arrows and legend for more details). In contrast, the lower part of the responses showed no propagation (see lower row of arrows). The anteriorly propagating activity was interpreted as a motion signal that correlates to the perceived illusory line-motion as found in psychophysical studies . Thus, instead of representing the bar at once, activity propagated across the retinotopic map. As shown in the original data, the same characteristics were obtained in multiple other experiments . Since this effect occurred along the posterior-anterior cortical y-axis, we averaged each camera frame along the x-axis (see Figure 1) to enable a one-dimensional model approach (see 2nd row of Figure 1). Using these 1D frames, we depict activity in space-time diagrams that allow inspection of entire time courses (3rd row).
Aggregated activity dynamics of both excitatory and inhibitory layers – emergence of propagating activity
The NF parameters found by grid search are summarized in Table 1. Figure 2 shows both the data and the NF responses. Activity in the model started with a delay of 19.2 ms (two time frames, see section “Model parameters identification procedure”), following low amplitude activity (light blue-green colors) that spread rapidly across several millimeters of cortex. With increasing amplitudes (yellow, red), the speed of the spread gradually decreased.
Figure 2. Visual inputs, modeled, and VSD responses.
Visual stimuli mapped on cortical coordinates are shown in the first column: (A) moving square, (B) flashed square, (C) flashed bar, and (D) LM stimulus (square followed by bar). Second column: neural field responses to the respective stimuli for a mixing ratio (see text) and the model parameters given in Table 1. Third column: corresponding dye signals. Vertical axes depict cortical coordinates, horizontal axes indicate time. Colors show response amplitudes as fractional changes in fluorescence. Rectangles in the space-time plots emphasize the region of interest. Here, a gradual propagation of high-level activity – from the lower left to the upper right – can be observed for both the model responses and the VSD data for real motion (A) and the LM condition (D) (see also Figure S2 in Text S1). The grid search procedure revealed one parameter configuration that satisfied the selection criteria (see “Methods”). The overall correlation coefficient between simulated and measured data was 0.85. The individual correlation coefficients computed between the simulated and measured responses to particular stimulus conditions were 0.83 for the square moving at 32 deg/s, 0.46 for the flashed square, 0.93 for the flashed bar and 0.93 for the LM stimulus condition.doi:10.1371/journal.pcbi.1000919.g002
For the flashed square (Figure 2B), activity spread symmetrically around the stimulus input location. With either the flashed bar (Figure 2C) or LM stimulus (Figure 2D), nearly identical responses were found in the lower part (0–3 mm) of the space-time diagram, as there were no differences in stimulus inputs in this direction. In the upper part, however, as outlined by rectangles, there were crucial differences between these conditions around the elongated bar input location. In this region, we observed a gradual propagation of high-amplitude activity – from the lower left to the upper right for the LM stimulus but not for the single flashed bar (Figure 2C, a more detailed analysis is provided in Figure S2 in Text S1). Note that such propagation of high-amplitude activity was also observed both in the VSD and modeled responses to a moving square (Figure 2A). Thus, similarly to the LM stimulus, real moving input gave rise to a propagating wave front of cortical activity reporting physical motion across the retinotopic map (see Figure S2 in Text S1). In the model the LM effect results from the following mechanism: The activity in response to the flashed square is sustained after the stimulus offset and serves as a starting point for the response to the flashed bar. The bar-evoked excitation then propagates from this region producing a gradual spread of activity, drawn-out from the highest activity amplitudes. Hence, the LM effect persists in the model as long as the inter-stimulus interval is in the range of activity decay times after the square stimulus presentation.
Figure 3 shows the evolution of activity at the center of the cortex image (the model responses are given by dashed lines). Although the response to the square stimulus was sustained longer than the measured dye signal and the maximum amplitude was not fully reached in the NF, the model in general captured the time courses of the cortical responses to the different stimuli used. Moreover, a small adjustment of the parameters removed these discrepancies: Using evolutionary optimization (see “Methods” and Text S1, section A) the duration of the model response to the flashed square was greatly reduced (Figure 3, red lines), and the correlation coefficient for this single configuration increased to 0.81. The evolutionary optimization changed the parameters to mV, mV, , , , , (see Text S1, Table S1).
Figure 3. Time courses of aggregated activity of a single model neuron.
Example traces were calculated around the input location of the single square (spatial coordinate 3 mm, see Figure 2). Solid black lines represent VSD data, shaded curves depict standard error, = 24 trials. Dashed lines represent modeled activity with parameters produced by grid search, red lines represent optimized modeled responses. The optimized parameter configuration can be found in Text S1, Table S1; see also Figures S3 and S4. Vertical lines indicate stimulus duration: square 20–70 ms, bar 80–210 ms.doi:10.1371/journal.pcbi.1000919.g003
Nonlinear space-time interactions
We next analyzed whether nonlinear interactions are required to explain our findings to explain the space-time responses of the LM condition. The superposition of the responses to the single square and the bar alone differed from the response to their combined presentation in the LM stimulus (Figure 4). Note that the superposition also gave rise to propagation of activity as can be seen by the temporal offsets between the time courses at different locations (compare stippled red and green curves, Figure 4). However, there were marked deviations from linearity. The VSD LM response (Figure 4A) exhibited facilitation (around ms) and suppressive effects (around ms) as compared to the superposition of the single square and the bar alone. The significance of these effects was tested as follows. We defined three consecutive time intervals. The pre-stimulus interval, frames 1–4, the “facilitatory” interval, frames 5–12, and the “suppressive” interval, frames 13–20. First, we found no significant difference between all pixel values of the LM and the superposition in the pre-stimulus interval (Mann-Whitney U = 19808, = = 200, , two-tailed). Second, we showed that the difference between the LM and the superposition is significant in the “facilitatory” interval (Mann-Whitney U = 64195, = = 400, P, two-tailed) as well as in the “suppressive” interval (Mann-Whitney U = 64369, = = 400, P, two-tailed). These effects are emphasized by thin red lines showing the difference of the LM response and the superposition (positive values indicate facilitation, negative values suppression). The model (Figure 4B) showed both of these effects, although the facilitatory effect (blue ellipse) was considerably smaller than in the measured data and was not observed at the center of the pattern (green line). We conclude that non-linear dynamics are necessary to explain the deviation from a simple superposition of the single square and bar representations.
Figure 4. Comparison of the LM condition to the superposition of responses to the square and the bar alone.
(A) VSD data, (B) Model. First column: time courses of activity at two single pixels at the center of the image (green line), and in the direction of activity propagation (red line). The superposition (dashed lines) differed from the corresponding response to the LM paradigm (solid lines) both for the recorded data and the model (see second and third column for entire space-time diagrams). In particular, the superposition showed a stronger response to the bar (from ms,314% (mean s.d.; n = 4) in the VSD data, 3414.7% (n = 800 pixels) in the model). Responses to the bar were also delayed in the superposition, revealing a facilitatory effect in the beginning of the response (around ms, VSD data: 2410% (n = 4), model: 53.7% (n = 16, statistics computed with respect to the pixels that show this effect)). Note that the color code in this figure differs to the other figures as the superposition reached higher values than the single conditions.doi:10.1371/journal.pcbi.1000919.g004
Comparison to reduced models
In order to verify that the different components of our model are necessary to reproduce the VSD-recorded dynamics, we tested several simplified models. We asked whether the spatio-temporal patterns could be simulated by a simple feed-forward model without lateral interactions, in which Gaussian smoothing of the input stimulus and low pass filtering produce the spread of activity (similar to the “G-waves” of Baloch and Grossberg ). It turned out that switching off lateral couplings and optimizing the parameters of the reduced model did not give satisfactory results.
Next, to investigate the role of inhibition and the necessity of different time constants for inhibition and excitation, we considered a single layer Amari-type NF ,(10)
where the kernel function was either purely excitatory (Gaussian) or had a Mexican-hat shape. The latter models excitation and inhibition as the difference between two Gaussian kernels. Applying the grid search procedure to the reduced Mexican-hat model produced fairly good fits to the data with correlation values of up to 0.75 (compared to 0.85 for the full two-layer model), the individual correlation coefficients computed between the simulated and measured responses to particular stimulus conditions were: 0.55 for the square moving at 32 deg/s, 0.51 for the flashed square, 0.81 for the flashed bar, and 0.86 for the LM stimulus condition. The amplitudes of activity in response to smaller sized stimuli (i.e., flashed and moving squares) were too low. Testing this model on the moving stimuli produced responses that were too weak and too prolonged. The overall correlation coefficient between simulated and measured data for the four conditions with moving squares was 0.70. The individual correlation coefficients computed between the simulated and measured responses to particular stimulus conditions were 0.78 for the square moving at 4 deg/s, 0.84 for 8 deg/s, 0.69 for 16 deg/s, and 0.55 for 32 deg/s. As indicators for the goodness-of-fit, we computed the AIC (Akaike information criterion ) for the two-layer and the single layer NF. The AIC is given by , where denotes the residual sum of squares, the number of data points (4 stimulus configurations, 50 spatial positions, and 25 time steps), and the number of parameters . Note that the absolute values of the AIC cannot be interpreted. Although the two-layer model has more parameters, its AIC is smaller ( compared to ) indicating a better fit. These results were obtained using the Mexican-hat kernel, the results for the simple Gaussian kernel were even worse.
In addition to the coarse grid search, we performed global optimization of the Amari-type field model using the CMA-ES (see Text S1, section A) without coming close to the fit quality of our two-layer model. Clearly, the fact that the system identification procedure did not find suitable parameters for a different model class does not prove that no suitable parameters for these alternative models exist (as such, non-existence proofs can be regarded as a general challenge in computational neuroscience). However, we regard the failure to fit the reduced models as a strong indication that lateral “intracortical” interactions and inhibition evolving with independent time constants are indeed necessary for the best fit of our data.
Decomposing the model aggregated activity: Separate inspection of layers reveals their high correlation
In Figure 5 the decomposed excitatory and inhibitory NF responses showed the observed gradual spread in both components.
Figure 5. Decomposing NF activity into excitatory and inhibitory components.
Columns from left to right: excitatory activity, inhibitory activity, aggregated signal (see Eqn 5). Stimulus conditions, rows A–G, as denoted on the left. Left colorbar applies to excitatory and inhibitory layers and indicates the modeled membrane potentials and , respectively. Right colorbar depicts response amplitudes as fractional changes in fluorescence intensity. The excitatory and inhibitory activity patterns were highly similar with correlation coefficients 0.79 (A), 0.81 (B), 0.81 (C), 0.84 (D), 0.84 (E), 0.86 (F), and 0.87 (G).doi:10.1371/journal.pcbi.1000919.g005
The parameter , which reflects the mixing ratio of excitatory to inhibitory signals, was optimal for a value of 0.54 as revealed by our fitting procedure. This suggests that the aggregated signal was caused to a large extent by inhibitory processes. If we used for this parameter configuration either only (or only ) in the regression Eqn 6 (i.e., set or , respectively), the quality of the fit significantly declined compared to the use of both layers' aggregated activities and (verified by Wald-test , . This indicated that elimination of the variable had a significant impact on the goodness-of-fit, ). We computed the residuals and , see section “Model identification procedure”. Let be the number of data points used for fitting the models (4 stimulus configurations, 50 spatial positions, and 25 time steps). We compared to the distribution , . When interpreting this result one has to keep in mind that the residuals of our models are correlated because of the spatio-temporal structure of the data and their variances are not homogeneous.
However, the choice of the mixing ratio could vary over a wide range without a considerable decrease in fit quality as indicated by the high correlation coefficients for different mixing ratios (see Figure 6). This result was on the one hand surprising as we expected to reveal a critical value for this parameter. Consequently, we cannot estimate directly the relative fraction of excitatory and inhibitory signals in the VSD data. On the other hand, our results strongly suggest that both inhibitory and excitatory activity contribute significantly to the measured VSD responses as demonstrated by our statistical goodness-of-fit analysis. Moreover, our control experiments with simpler single layer models (see “Comparison to reduced models”) indicated that balanced interactions of the strongly coupled excitatory and inhibitory layer are required to produce the high correlation between the model aggregated spatio-temporal patterns and the VSD dynamics.
Figure 6. Different mixing ratios of excitatory and inhibitory activity.
Aggregated model responses to the LM stimulus with (A) , (B) , (C) . The value of could vary over a wide range without considerably impairing the fit, i.e. decreasing the correlation coefficient. All mixing ratios of in the interval [0.3, 0.7] resulted in correlation coefficients larger than 0.8. The maximum was obtained with (B).doi:10.1371/journal.pcbi.1000919.g006
Generalization to moving squares with different speeds
We finally tested the derived model using different stimuli that were similar to those used in the grid search procedure. Novel square stimuli moving at different speeds (4, 8, 16 deg/sec; the 32 deg/s stimulus was used for optimization) were fed into the model. The results, summarized in Figure 7, revealed that our model also reproduced these new spatio-temporal patterns. The correlation coefficient between simulated and measured data for the four moving square conditions was on average 0.79.
Figure 7. Model and VSD responses to moving squares with different speeds.
Same conventions as in Figure 2. Stimulus speeds were: (A) 4, (B) 8, (C) 16, and (D) 32 deg/s. At lower levels of activity the spread of activity was uniform across all conditions (greenish colors). In contrast, at high-amplitudes (80% of maximal activation, red colors), the speed of propagation increased linearly with speeds: 0.004, 0.009, 0.02, 0.04 m/s. The individual correlation coefficients computed between the simulated and measured responses were 0.83, 0.92, 0.82, 0.83 for the square moving at 4, 8, 16, and 32 deg/s, respectively.doi:10.1371/journal.pcbi.1000919.g007
Analysis of stability
For a better understanding of the dynamics of our model, we performed a standard linear stability analysis in the absence of afferent input (e.g., see ). We linearized the system governed by Eqns 1 and 2 near its homogeneous solution, which is described by with scalars and .
The spatial dimension is considered in frequency space. The analysis yields two constraints that have to be met for the linearized system to be asymptotically stable:(11)
for all spatial frequencies , where and are the spatial Fourier transforms of the weight functions and (e.g., ) and and are the derivatives of the transfer functions. Substituting the parameters listed in Table 1 into the Inequalities 11 and 12 reveals that the homogeneous solution of our model is indeed asymptotically stable, which is a minimal requirement (for detailed derivation of Inequalities 11 and 12 see Text S1, section B).
This is the first time in vivo VSD patterns have been modeled quantitatively in space and time on a mesoscopic population level. Our proposed dynamical system is an abstract functional description of in vivo recorded VSD dynamics that correlate with changes in potentials across neuronal membranes and reflect the mass activity of a large pool of neurons.
Despite its rather few degrees of freedom, the NF model matches the VSD activity patterns evoked by briefly flashed visual stimuli including the LM paradigm. Our statistical analysis indicate that the two-layer structure of our model as well as the assumption that both excitatory and inhibitory activity contribute to the dye signal are necessary to obtain a fit with the highest correlation to the VSD imaging data.
The question arises whether our model is realistic in the sense that it could be implemented by the cortical network. We argue that the relevant model parameters are indeed within physiologically plausible ranges (see “Physiological interpretation of the model”). In this context, we suggest a significant contribution of inhibitory activity to the VSD dynamics.
Finally, the here presented modeling of V1 implies that feedback from higher brain areas is not necessary to produce activity patterns resembling the percept of illusory motion.
Relation to alternative large-scale model
First, we compare our model to other in silico simulations that addressed the same experimental findings. Rangan et al.  simulated the VSD data from Jancke et al.  using a large-scale integrate-and-fire model, which consists of neurons modeling three types of channel conductances (NMDA, GABA, AMPA) and two types of connections (isotropic short-range and orientation-specific long-range connections) . Importantly, both their model and ours simulate the LM effect without additional modeling of higher brain areas . While our NF model was specifically designed to capture the LM data, the large-scale network developed by Rangan et al.  incorporated additional aspects of cortical processing on a different level of abstraction, as their large-scale model accounts for further experimental observations (for instance correlations between spontaneous activity and stimulus orientation , ) that cannot be addressed by our model, which is only as complex as needed to match our data. Therefore, it is not surprising that our model allowed a better fit per se.
Comparing the simulations in Rangan et al.  with our study, it becomes apparent that both approaches have a spatial and temporal integration problem: activity in response to the square stimulus is much less integrated over space and time than for the longer bar stimulus. The large-scale model  therefore included additional pre-processing in the lateral geniculate nucleus (LGN). Using such an LGN model that implements normalization, as proposed by several authors , , –, may indeed help to enhance our fits but was not explicitly tested here.
In the large-scale model, the response following the bar arises about 20 ms earlier than the VSD-recorded responses. In contrast, the response to the square stimulus was ms delayed. Using the constant retino-cortical time delay in our model, the simulated and measured signal onsets were aligned in all stimulus conditions. Our model thus has the advantage of capturing the timing of VSD signal onsets more accurately (see Figure 3).
Possible extensions of our NF model
The model responses to both the flashed bar and LM condition fitted the observed VSD measurements. In contrast, for the single flashed and the moving squares the model revealed a discrepancy to the VSD data in the extent of lateral spread. One reason for this effect is our simple Gaussian smoothing that we used as a model for the retino-cortical processing. Increasing the kernel width resulted indeed in a wider activity spread, but the tested widths were inappropriately large to match the common experimental findings. As another straightforward solution, we increased the widths of the coupling kernels and , however, the grid search did not find models with an accurate fit for such wider kernels.
For the flashed square, prolonged activity was observed compared to the data. Importantly, tuning the gains , , and , the resting potentials and , and the steepness of the transfer function and using evolutionary optimization eliminated the discrepancy (see Figure 3).
Finally, the flashed and moving square stimuli evoked model responses that were lower in amplitude than that measured. As stated in “Relation to alternative large-scale model”, using a normalization method , , – in the retino-thalamic processing step could be a suitable solution to adjust the amplitudes of the responses to the small- and large-sized stimuli. As we aimed at capturing essential nonlinear activity dynamics with the simplest form of our NF model, we also neglected further specific mechanisms of cortical processing like short-term synaptic plasticity and did not parameterize axonal propagation speed (see, e.g., , ). It should be noted that increasing the model complexity by introducing more parameters would certainly enhance the fit to the data. For instance, in a comparable version of the model, to account for spiking population data , we added a “shunting inhibition” term that allowed to produce a rapid spread of activity ahead of a moving square without pushing the model into the active mode . However, the ability of the present model with its minimal complexity to fit and generalize suggests that the principles of two-layered architecture with lateral connectivity are sufficient to account for VSD-recorded dynamics.
Physiological interpretation of the model
Our model is functional in the sense that it characterizes the dynamics of the VSD signal. Still, the model must also be plausible from a physiological point of view in the sense that it can be implemented by the underlying brain structures. In the following, we therefore discuss the ability of the cortical architecture to give rise to the model dynamics.
The NF model is a graded response mean-field approximation. As shown in the work of Eggert and van Hemmen , graded response models are able to describe the evolution of a population of spiking neurons in the case of slow dynamics. The VSD data used in this study lack these very fast ms-dynamics due to the frame duration and averaging and therefore, fulfills this requirement. The model accounts for the neuronal activity measured in cortical layers 2/3 and ignores other cortical structures. Furthermore, as it matches averages over several trials and numerous cell types with different connectivities and different neuronal response profiles, the neglected details affect the obtained model parameters. In this sense the model dynamics implicitly simulate all the factors that influence VSD-recorded dynamics.
The parameters mV and mV in the model can be associated with the mean resting membrane potentials of excitatory and inhibitory neurons, respectively. The physiological values reported in the literature span from mV to mV with a standard deviation of about 10 mV – for excitatory and inhibitory neurons in the cat primary visual cortex. Our modeled membrane potentials are in this range. However, it should be noted that since all model neurons communicate only through the transfer function (see Eqns 1 and 2), shifting of resting potentials and can be compensated by simply changing the transfer function thresholds such that the system dynamics are not affected, see section “Model”. In the model, the mean membrane time constants ms and ms are in agreement with experimental data , .
The lateral connectivity is determined in the model by the Gaussian interaction kernels and (see Eqn 4). As shown in Table 1, the values mm and mm were used. The absolute values of the axonal extension of excitatory cells found in the cat primary visual cortex have been reported to reach up to 3.5 mm  or even up to 6–8 mm . However, if our -values are interpreted as measures of lateral extent of axonal-dendritic connections, they can be compared with the results of a recent quantitative study that measured and modeled the spatial and orientation preference distribution of labeled axonal bouton density of excitatory neurons in area 18 of the cat . Modeling of the spatial distribution by a single Gaussian function revealed a -value of 0.6 mm, which is smaller than in our NF. However, their additional approach designed to differentiate between oriented and non-oriented components suggested values up to 1.1 mm for the non-oriented component, which is close to our results.
In contrast, inhibitory interneurons in the primary visual cortex act mostly locally , . These interneurons are activated by widely spreading lateral excitatory connections (see  and ,  for results for macaque and cat, respectively). This has been implemented in the NF by the local coupling of the inhibitory term into the excitatory field equation (see Eqns 1 and 2). Thus, although the coupling from the inhibitory to the excitatory layer is only local in our model, inhibition can act over a wide range.
Excitation and inhibition in the VSD signal
We considered a mixing ratio of , which stresses that the dye signal reflects both excitation and inhibition , . This is in contrast to studies in which the signal is interpreted as caused by excitation only, but also to studies that presume only 25% inhibition . The latter is based on the fact that about 25% of the neurons in the cat primary visual cortex are inhibitory (GABA-immunoreactive) . We cannot exclude the possibility that the dye binds more strongly to inhibitory neurons, the number of active cells however, does in any case not necessarily reflect their functional impact. The NF dynamics are the result of processing across the closely coupled excitatory and inhibitory layers. We showed that the resulting dynamics were only achievable if both layers interact.
For example, as summarized in their review article, Ferster and Miller  pointed to the discrepancy between the observed contrast invariance of orientation tuning curves of simple cells and the notion of only weak cortical inhibition. In fact, recent intracellular in vivo recordings in cat have demonstrated strong inhibitory input  that may counteract cortical excitatory inputs in a push-pull manner .
Relation to hypotheses of cortical representation of motion
Different amplitudes of the dye signal correspond to different levels of the degree of depolarization across the observed neural populations. Thus, with higher amplitudes, the probability rises that the signal reflects supra-threshold activity , . Information about the stimulus trajectory should essentially be encoded at high amplitudes of activation, most likely as a propagating wave of spiking activity , . In contrast, low amplitude activity may reflect initial passive spread  without a close coupling to the input speed of the stimulus. Therefore, we were particularly interested in the relationship between the speed of lateral propagation and the level of activity.
We found that the model did not reproduce cortical axonal conduction speeds of m/s , , . Part of the problem to measure speeds of lateral spread is due to the fact that in vivo VSD imaging (as well as in vivo intracellular recordings) must measure weak deviations from baseline levels to capture the earliest input and are therefore confronted with low signal-to-noise-ratios. These initially very low activity levels observed in the VSD experiments (see  and also ) were indeed not high enough in the data to significantly contribute to our simple grid-based search algorithms if not explicitly parameterized. As we tried to keep our model as simple as possible we therefore did not further optimize these lowest activity levels. However, it is crucial to note that the measured propagation speeds are of postsynaptic origin. Thus, propagation of activity signals integrative properties of the neurons and the surrounding network, rather than reporting true axonal conduction speeds . These network properties are reflected in the continuously rising VSD signal which we indeed captured in our NF model. Hence, in the model the speed of the initial low-amplitude activity spread (coded by the light blue color in Figure 7) demonstrates initially emerging activity within the network and shows only weak dependency on the stimulus speed as observed experimentally .
In conclusion, the model captures the main signatures of the spread of activity observed in the new data set including real motion. This generalization to novel stimuli similar to those used to determine the model parameters supports our choice of the neural field model architecture.
It remains an open question as to which neuronal mechanisms lead to the line-motion illusion. The dichoptic experiments of Hikosaka et al.  demonstrated that the retina and the LGN cannot be the processing stages where the LM effect arises. Instead, Hikosaka et al. argued that attentional effects are responsible for the line-motion sensation , . Another proposal was that since area MT plays a major role in motion integration in humans and monkeys, the LM effect should arise along the dorsal pathway. For instance, Baloch and Grossberg  discussed a number of processing steps in their model of the V1–V2–MT–MST pathway that could give rise to the LM illusion.
A recent human fMRI study by Larsen et al.  demonstrated that MT+ activation in response to true motion was similar to activation following the presentation of a corresponding illusory moving stimulus. The three-stage theory proposed by these authors suggests that in the first stage higher areas solve the “correspondence problem” (i.e., identify two images as two successive views of the same object), while in the second stage MT+ computes the motion trajectory between these two object representations, and finally the computed trajectory is back-projected to V1 and filled in by a sequence of visual representations of the object . Ahmed et al.  reported such feedback activation in area 17/18 from area 19/21 in ferrets using VSD imaging. The activation was motion-dependent and locked to the offset of the first stimulus in their apparent-motion paradigm. This feedback activated the path between subsequent retinotopic stimulus representations in area 17/18 and was interpreted as to play an important role in the computation of continuous motion.
In contrast, our model does not explicitly account for an impact of back projections from higher cortical areas. Nevertheless, these back propagating waves are slower than the initial LM effect characterized here by the immediate drawing-out of activity representing rapid motion . However, we cannot exclude that particularly later parts of the VSD responses may involve feedback from higher visual areas.
The study by Jancke et al.  suggested that bottom-up processes are the main source of the initial line-motion activity. Our model confirms that lateral interactions in primary visual cortex are sufficient to generate responses to the illusory LM stimulus that are nearly indistinguishable from the responses to true motion.
A) Covariance matrix adaptation evolution strategy; B) Linear stability analysis of the homogeneous solution.
(0.97 MB PDF)
The authors thank Jennifer Meyer for the implementation of a preliminary version of the model. We thank John Lipinski and Benedict Ng for helpful comments on the manuscript. We thank Gregor Schöner, Sebastian Schneegans, and Eray Basar for fruitful discussions. The authors are grateful to the three anonymous reviewers for useful remarks on the manuscript.
Conceived and designed the experiments: DJ. Performed the experiments: DJ. Analyzed the data: VM CI DJ. Contributed reagents/materials/analysis tools: VM CI AG. Wrote the paper: VM CI AG DJ.
- 1. Deco G, Jirsa VK, Robinson PA, Breakspear M, Friston K (2008) The dynamic brain: From spiking neurons to neural masses and cortical fields. PLoS Comput Biol 4: e1000092.
- 2. Freeman WJ (2000) Neurodynamics: an exploration in mesoscopic brain dynamics. Springer.
- 3. Dinse HR, Jancke D (2001) Time-variant processing in V1: From microscopic (single cell) to mesoscopic (population) levels. Trends Neurosci 24: 203–205.
- 4. Jancke D, Erlhagen W, Dinse HR, Akhavan AC, Giese M, et al. (1999) Parametric population representation of retinal location: Neuronal interaction dynamics in cat primary visual cortex. J Neurosci 19(20): 9016–9028.
- 5. Erlhagen W, Bastian A, Jancke D, Riehle A, Schöner G (1999) The distribution of neuronal population activation (DPA) as a tool to study interaction and integration in cortical representations. J Neurosci Methods 94: 53–66.
- 6. Beurle RL (1956) Properties of a mass of cells capable of regenerating pulses. Philos Trans R Soc Lond B Biol Sci 240: 55–94.
- 7. Wilson R, Cowan D (1972) Excitatory and inhibitory interactions in localized populations of model neurons. Biophys J 12: 1–24.
- 8. Wilson R, Cowan D (1973) A mathematical theory of the functional dynamics of cortical and thalamic nervous tissue. Kybernetik 13: 55–80.
- 9. Amari SI (1977) Dynamics of pattern formation in lateral-inhibition type neural fields. Biol Cybern 27: 77–87.
- 10. Jancke D (2000) Orientation formed by a spot's trajectory: A two-dimensional population approach in primary visual cortex. J Neurosci 20: RC86: 1–6.
- 11. Erlhagen W, Jancke D (2004) The role of action plans and other cognitive factors in motion extrapolation: A modelling study. Vis Cogn 11: 315–340.
- 12. Jancke D, Chavane F, Na'aman S, Grinvald A (2004) Imaging cortical correlates of illusion in early visual cortex. Nature 428: 423–426.
- 13. Hikosaka O, Miyauchi S, Shimojo S (1993) Focal visual attention produces illusory temporal order and motion sensation. Vision Res 33: 1219–1240.
- 14. Hikosaka O, Miyauchi S, Shimojo S (1993) Voluntary and stimulus-induced attention detected as motion sensation. Perception 22: 517–526.
- 15. Baloch A, Grossberg S (1997) A neural model of high-level motion processing: Line motion and formotion dynamics. Vision Res 37: 3037–3059.
- 16. Larsen A, Madsen KH, Lund TE, Bundesen C (2006) Images of illusory motion in primary visual cortex. J Cogn Neurosci 18: 1174–1180.
- 17. Ahmed B, Hanazawa A, Undeman C, Eriksson D, Valentiniene S, et al. (2008) Cortical dynamics subserving visual apparent motion. Cereb Cortex 18: 2796–2810.
- 18. Grinvald A, Lieke E, Frostig RD, Hildesheim R (1994) Cortical point-spread function and long-range lateral interactions revealed by real-time optical imaging of macaque monkey primary visual cortex. J Neurosci 14: 2545–2568.
- 19. Petersen CH, Grinvald A, Sakmann B (2003) Spatiotemporal dynamics of sensory responses in layer 2/3 of rat barrel cortex measured in vivo by voltage-sensitive dye imaging combined with whole-cell voltage recordings and neuron reconstructions. J Neurosci 23: 1298–1309.
- 20. Rangan AV, Cai D, McLaughlin DW (2005) Modeling the spatiotemporal cortical activity associated with the line-motion illusion in primary visual cortex. Proc Natl Acad Sci U S A 102: 18793–18800.
- 21. Blumenfeld B, Bibitchkov D, Tsodyks M (2006) Neural network model of the primary visual cortex: from functional architecture to lateral connectivity and back. J Comput Neurosci 20: 219–241.
- 22. Grimbert F, Chavane F (2007) Neural field model of VSD optical imaging signals. Technical Report 6398, INRIA.
- 23. Sharon D, Jancke D, Chavane F, Na'aman S, Grinvald A (2007) Cortical response field dynamics in cat visual cortex. Cereb Cortex 17: 2866–2877.
- 24. Sterkin A, Lampl I, Ferster D, Grinvald A, Arieli A (1998) Realtime optical imaging in cat visual cortex exhibits high similarity to intracellular activity. Neurosci Lett 51: 41.
- 25. Sit Y, Chen Y, Geisler W, Miikkulainen R, Seidemann E (2009) Complex dynamics of V1 population responses explained by a simple gain-control model. Neuron 64: 943–956.
- 26. Trappenberg T (2008) Tracking population densities using dynamic neural fields with moderately strong inhibition. Cogn Neurodyn 2: 1476–1492.
- 27. Tusa R, Rosenquist A, Palmer L (1979) Retinotopic organization of areas 18 and 19 in the cat. J Comp Neurol 185: 657–678.
- 28. Albus K (1975) A quantitative study of the projection area of the central and the paracentral visual field in area 17 of the cat. Exp Brain Res 24: 159–179.
- 29. Somogyi P, Freund TF, Cowey A (1982) The axo-axonic interneuron in the cerebral cortex of the rat, cat and monkey. Neuroscience 7: 2577–2607.
- 30. Meyer J, Igel C, Jancke D (2006) Modelling dynamic activity patterns in early visual cortex based on voltage sensitive dye experiments. In: Hossmann KA, editor. Symposium “Neuro-Visionen 3”, Perspektiven in Nordrhein-Westfalen. Verlag Ferdinand Schöningh. pp. 193–195.
- 31. Symes A, Wennekers T (2009) Spatiotemporal dynamics in the cortical microcircuit: A modelling study of primary visual cortex layer 2/3. Neural Netw 22: 1079–1092.
- 32. Hansen N, Ostermeier A (2001) Completely derandomized self-adaptation in evolution strategies. Evol Comput 9: 159–195.
- 33. Suttorp T, Hansen N, Igel C (2009) Efficient covariance matrix update for variable metric evolution strategies. Mach Learn 75: 167–197.
- 34. Beyer HG (2007) Evolution strategies. Scholarpedia J 2: 1965.
- 35. Igel C, Erlhagen W, Jancke D (2001) Optimization of dynamic neural fields. Neurocomputing 36: 225–233.
- 36. Igel C, von Seelen W, Erlhagen W, Jancke D (2002) Evolving field models for inhibition effects in early vision. Neurocomputing 44–46: 467–472.
- 37. Igel C, Glasmachers T, Heidrich-Meisner V (2008) Shark. J Mach Learn Res 9: 993–996.
- 38. Akaike H (1974) A new look at the statistical model identification. IEEE Trans Automat Contr 19: 716–723.
- 39. Wilks SS (1938) The large-sample distribution of the likelihood ratio for testing composite hypotheses. Ann Math Stat 9: 60–62.
- 40. Fan J, Zhang C, Zhang J (2001) Generalized likelihood ratio statistics and Wilks phenomenon. Ann Stat 29: 153–193.
- 41. von der Malsburg C, Cowan JD (1981) Theory of ontogenesis of orientation domains – Intracortical dynamics part. Technical Report 81–1, Department of Neurobiology, Max-Planck-Institut for Biological Chemistry, Göttingen.
- 42. Cai D, Rangan AV, McLaughlin DW (2005) Architectural and synaptic mechanisms underlying coherent spontaneous activity in V1. Proc Natl Acad Sci U S A 102: 5868–5873.
- 43. Kenet T, Bibitchkov D, Tsodyks M, Grinvald A, Arieli A (2004) Spontaneously emerging cortical representations of visual attributes. Nature 425: 954–956.
- 44. Heeger DJ (1992) Normalization of cell responses in cat striate cortex. Vis Neurosci 9: 181–97.
- 45. Carandini M, Heeger DJ, Movshon JA (1997) Linearity and normalization in simple cells of the macaque primary visual cortex. J Neurosci 17: 8621–8644.
- 46. Graham N, Sutter A (2000) Normalization: contrast-gain control in simple (fourier) and complex (non-fourier) pathways of pattern vision. Vision Res 40: 2737–2761.
- 47. Freeman T, Durand S, Kiper D, Carandini M (2002) Suppression without inhibition in visual cortex. Neuron 35: 759–771.
- 48. Jancke D, Erlhagen W, Schoner G, Dinse H (2004) Shorter latencies for motion trajectories than for flashes in population responses of cat primary visual cortex. J Physiol 556: 971–982.
- 49. Eggert J, van Hemmen JL (2000) Unifying framework for neuronal assembly dynamics. Phys Rev E Stat Nonlin Soft Matter Phys 61: 1855–1874.
- 50. Hirsch JA, Gilbert CD (1991) Synaptic physiology of horizontal connections in the cat's visual cortex. J Neurosci 11: 1800–1809.
- 51. Borg-Graham LJ, Monier C, Fregnac Y (1998) Visual input evokes transient and strong shunting inhibition in visual cortical neurons. Nature 393: 369–373.
- 52. Carandini M, Ferster D (2000) Membrane potential and firing rate in cat primary visual cortex. J Neurosci 20: 470–484.
- 53. Tamás G, Somogyi P, Buhl EH (1998) Differentially interconnected networks of GABAergic interneurons in the visual cortex of the cat. J Neurosci 18: 4255–4270.
- 54. Monier C, Chavane F, Baudot P, Graham LJ, Frégnac Y (2003) Orientation and direction selectivity of synaptic inputs in visual cortical neurons: A diversity of combinations produces spike tuning. Neuron 37: 683–680.
- 55. Hirsch JA, Alonso JM, Reid RC, Martinez LM (1998) Synaptic Integration in Striate Cortical Simple Cells. J Neurosci 18: 9517–9528.
- 56. Kisvárday ZF, Toth E, Rausch M, Eysel UT (1997) Orientation-specific relationship between populations of excitatory and inhibitory lateral connections in the visual cortex of the cat. Cereb Cortex 7: 605–618.
- 57. Gilbert CD, Wiesel TN (1989) Columnar specificity of intrinsic horizontal and corticocortical connections in cat visual cortex. J Neurosci 9: 2432–2442.
- 58. Buzás P, Kovács K, Ferecskó AS, Budd JM, Eysel UT, et al. (2006) Model-based analysis of excitatory lateral connections in the visual cortex. J Comp Neurol 499: 861–881.
- 59. LeVay S (1988) Patchy intrinsic projections in visual cortex, area 18, of the cat: Morphological and immunocytochemical evidence for an excitatory function. J Comp Neurol 269: 265–274.
- 60. Matsubara J (1988) Local, horizontal connections within area 18 of the cat. Prog Brain Res 75: 163–72.
- 61. McGuire BA, Gilbert CD, Rivlin PK, Wiesel TN (1991) Targets of horizontal connections in macaque primary visual cortex. J Comp Neurol 305: 370–392.
- 62. Kisvárday ZF, Martin KAC, Freund TF, Maglóczky Z, Whitteridge D, et al. (1986) Targets and quantitative distribution of GABAergic synapses in the visual cortex of the cat. Exp Brain Res 64: 541–552.
- 63. Beaulieu C, Somogyi P (1990) Targets and quantitative distribution of GABAergic synapses in the visual cortex of the cat. J Comp Neurol 2: 296–303.
- 64. Gabbott PLA, Somogyi P (1986) Quantitative distribution of GABA-immunoreactive neurons in the visual cortex (area 17) of the cat. Exp Brain Res 61: 323–331.
- 65. Ferster D, Miller K (2000) Neural mechanisms of orientation selectivity in the visual cortex. Annu Rev Neurosci 23: 441–71.
- 66. Troyer T, Krukowski A, Priebe N, Miller K (1998) Contrast-invariant orientation tuning in cat visual cortex: thalamocortical input tuning and correlation-based intracortical connectivity. J Neurosci 18: 5908–5927.
- 67. Bringuier V, Chavane F, Glaeser L, Frégnac Y (1999) Horizontal propagation of visual activity in the synaptic integration field of area 17 neurons. Science 29: 695–699.
- 68. Benucci A, Frazor R, Carandini M (2007) Standing waves and traveling waves distinguish two circuits in visual cortex. Neuron 55: 103–117.