In this paper we used a general stochastic processes framework to derive from first principles the incidence rate function that characterizes epidemic models. We investigate a particular case, the Liu-Hethcote-van den Driessche's (LHD) incidence rate function, which results from modeling the number of successful transmission encounters as a pure birth process. This derivation also takes into account heterogeneity in the population with regard to the per individual transmission probability. We adjusted a deterministic SIRS model with both the classical and the LHD incidence rate functions to time series of the number of children infected with syncytial respiratory virus in Banjul, Gambia and Turku, Finland. We also adjusted a deterministic SEIR model with both incidence rate functions to the famous measles data sets from the UK cities of London and Birmingham. Two lines of evidence supported our conclusion that the model with the LHD incidence rate may very well be a better description of the seasonal epidemic processes studied here. First, our model was repeatedly selected as best according to two different information criteria and two different likelihood formulations. The second line of evidence is qualitative in nature: contrary to what the SIRS model with classical incidence rate predicts, the solution of the deterministic SIRS model with LHD incidence rate will reach either the disease free equilibrium or the endemic equilibrium depending on the initial conditions. These findings along with computer intensive simulations of the models' Poincaré map with environmental stochasticity contributed to attain a clear separation of the roles of the environmental forcing and the mechanics of the disease transmission in shaping seasonal epidemics dynamics.
Nonlinearity in the infection incidence is one of the main components that shape seasonal epidemics. Here, we revisit classical incidence and propose a first principles derivation of the infection incidence rate. A qualitative analysis of the SIRS model with both the classical and the proposed incidence rate showed that the new model is physically more meaningful. We conducted a statistical analysis confronting the SIRS and SEIR models formulated using both incidence rate functions with four data sets of seasonal childhood epidemics. Two data sets were hospital records of cases of syncytial respiratory virus (RSV). The other two data sets were taken from the well-known UK measles epidemics database. We found that seasonal epidemics is better explained using our incidence rate model embedded in a Poisson sampling process. The results presented here are not by any means an exhaustive exploration of the interplay between nonlinear dynamics and stochasticity. Our results may be viewed as the starting point of multiple research avenues. Three such research topics could be: the first-principles derivation of non-linear incidence rate functions, the role of bistability and demographic stochasticity for disease persistence and the simulation of environmental and demographic stochasticity in the Poincaré map.
Citation: Ponciano JM, Capistrán MA (2011) First Principles Modeling of Nonlinear Incidence Rates in Seasonal Epidemics. PLoS Comput Biol 7(2): e1001079. doi:10.1371/journal.pcbi.1001079
Editor: Mercedes Pascual, University of Michigan and Howard Hughes Medical Institute, United States of America
Received: January 24, 2010; Accepted: January 12, 2011; Published: February 17, 2011
Copyright: © 2011 Ponciano, Capistrán. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: J.M. Ponciano was partially funded by CONCYTEG 09-02-K662-073 anexo 3 and M.A. Capistran by CONCYTEG 08-02-K662-119 anexo2. J.M. Ponciano would also like to acknowledge funding from the Starter's Package Grant provided by the College of Liberal Arts and Sciences at University of Florida. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
A plethora of deterministic epidemic models involving susceptible , infected and recovered individuals have been proposed , , carefully analyzed – and confronted with data sets in the biomathematics and ecology literatures –. A well defined topic within this mathematical ecology research area is the study of -type models with seasonal forcing –. These models have proved to be useful for understanding the observed patterns and the natural processes behind human and non-human epidemics –. Here, we restrict our attention to the and models in which we introduce seasonal forcing while varying the structural form of the incidence rates. Two hypotheses pertaining the RSV and the measles transmission mechanisms were modeled with two simple functional forms of the incidence rates. We show that in doing so, we are able to attain a clear separation of the roles of the environmental forcing and the mechanics of the disease transmission in shaping the epidemics dynamics.
The construction of deterministic incidence rates functions is a critical building block of epidemiological modeling. In a seminal paper, Hethcote  showed that because there are many choices for the form of the incidence, demographic structure and the epidemiological-demographic interactions, there really is a plethora of incidence rate functional forms to choose from. Not surprisingly, the biomathematics literature abound in qualitative mathematical analyses of many of these functional forms –. However, biological first principles derivations of incidence rate functional forms are not too common. As we show in this study, using such first principles derivations greatly enrich the reaches of the practice of confronting models with data while testing biological hypotheses. Thus, despite the big amount of available functional incidence rates forms , we believe that the set of models chosen to be confronted with data should be restricted to those forms derivable from first principles. To illustrate this argument, in this study we first show that a simple probabilistic setting wherein infectious encounters are modeled with a pure birth stochastic process leads to a general nonlinear incidence form proposed previously by Liu  and later analyzed by Hethcote and Van Den Driessche  (hereafter we refer to the Liu, Hethcote and Van Den Driessche incidence rate as the LHD incidence rate). The LHD incidence rate leads to models with qualitatively different dynamics compared with the ones obtained using the classical incidence rate.
In the SIRS model with either incidence rate and seasonal forcing, becomes a periodic function of time and the trajectory “pursuits” a moving target thus giving rise to limit cycles. That moving target is the former endemic equilibrium that bounces back and forth between two points. In either model, the target switches between that moving point and the disease free equilibrium when crosses 1, giving rise to a period doubling bifurcation. In the SIRS model with classical incidence rate this mechanism does not depend on the initial conditions. In this work we show that the disease free equilibrium (DFE) is unconditionally an attractor in the SIRS model with LHD incidence rate. This leads to a scenario where two regions of attraction can coexist. The trajectory will either reach the disease free equilibrium or have periodic solutions depending on the initial conditions. Furthermore, after carrying a formal model selection we show that the SIRS model with LHD incidence rate leads to a significant fit improvement over the classical SIRS model with the same seasonal forcing. Finally, we compared the applicability and generality of the classical and LHD incidence rates functions by fitting them to two measles time series data sets. Using the later function leads to a vast improvement of model fit in both cases. Since we were fitting a deterministic SEIR model, we chose to use the data from the two largest cities in the measles data set (London and Birmingham, see http://www.zoo.cam.ac.uk/zoostaff/grenfell/measles.htm), where the effects of demographic stochasticity are expected to be less influential in the dynamics of the epidemics .
Varying the form of the contact rate function while including environmental stochasticity in the SIRS and SEIR models leads to a better understanding of the dynamics of an infectious disease transmission. Depending on the model and contact rate, the disease free equilibrium (DFE) is either a saddle point or an attractor. In the first case, if a trajectory located originally in the basin of attraction of the endemic equilibrium (EE) basin of attraction is perturbed with environmental noise, it may transiently visit the DFE stable submanifold and then return to the EE basin of attraction. If however the DFE and the EE coexist as stable equilibria, a trajectory initially at the EE basin of attraction may end up in the DFE basin of attraction. The interaction between stochasticity and the different contact rate models was studied using computer intensive simulations of the Poincaré map .
The classical model has been extensively studied in order to predict and understand various disease dynamics behaviors, as well as their spread and persistence . For many infectious diseases, the pool of susceptible individuals is replenished due to the waning of immunity , . To account for the lost of immunity, the classical susceptible , infected and recovered model is adjusted by allowing a fraction of the recovered individuals to move back into the susceptible pool at a rate . This susceptible, infected, recovered and susceptible model is expressed as(1)
where is the rate of loss of infectiousness and the total population size remains constant (i.e. ). The constant represents both, the birth and mortality rates. Assuming that birth and mortality rates are equal is justified on the grounds that the annual infection rate is considerably higher than the population growth. The constant is the contact rate, the average number of individuals with whom one infected individual makes sufficient contact to pass on the infection . The fraction represents the average number of infections per susceptible individual and hence represents the expected number of infections when susceptible individuals are available . Note that the above definition of as a per individual constant leads to a consistency of the units within each of the model equations and assumes homogeneous mixing. In the following sections we will discuss different ways to model the incidence rate.
The equations for the classic SEIR (Susceptible-Exposed-Infectious-Recovered)model are as follows :(4)
where represents both, the birth and mortality rates per capita. The mean latent and infectious periods of the disease are and . As written, the SEIR model has a stable endemic equilibrium provided . Further biological realism to model recurrent epidemics can be incorporated to both this SEIR model and the SIRS model above by assuming that the transmission rate varies seasonally. Indeed, Earn et al  study the range of the dynamical behavior of the SEIR model with seasonality and find it useful for explaining the measles numerous transitions between regular cycles and irregular, possibly chaotic epidemics. Also, Alonso et al.  show that noise amplification provides a possible explanation for qualitative changes from regular to irregular oscillations of lower amplitude. In this paper, we follow the suggestion made by Hethcote  and couple Liu, Hethcote and Van Den Driessche's incidence rate with seasonal forcing in both the SIRS and SEIR models.
To incorporate the claim that epidemics of recurrent infections is driven by seasonality, it is customary to depart from the standard incidence rate by assuming that the average number of incidences sufficient for transmission per infected individual , is a periodic or quasi-periodic function of time (). Often, the incidence rate is assumed to have a sinusoidal form of the type(8)
where stands for the strength of the seasonality and year. Various authors have shown that such a generic description of the seasonal variation in transmission rates is not as revealing as a detailed description of the actual processes underlying the seasonal drivers of transmission through mechanistic seasonal forcing functions , , , , . However, as we show in the results section, in some cases this sinusoidal function may unequivocally represent a linear transformation of a weather covariate. Although other authors have used a more flexible Haar step function for the seasonal forcing (e.g. ), we restrict ourselves to the incorporation of the sinusoidal form above (eq. 8) as the seasonal forcing. This has the advantage of ease of interpretation and qualitative analysis. In any case, the main purpose of incorporating the forcing is to explore the main qualitative characteristics of coupling the seasonally varying disease transmission and different incidence rate functional forms.
First principles modeling of incidence rates
Brauer  generalizes the incidence rate definition in the following way: if the average member of the population makes contacts in one unit of time with , and if is the probability of choosing one infected individual from the population at random, then is the rate of new infections per unit of time. The mass-action incidence rate model is recovered using and the classic incidence rate is recovered by picking . A general incidence rate function was proposed by Hethcote and van den Driessche :
where and are constants. Consider the special case where and . Using Brauer's generalization and idea, Hethcote and van den Driessche's model is recovered using the function . Then, the incidence rate function becomes
where and . Although the mathematical properties of the general function are known in general , ,  a mechanistic, first principles derivation of it is still lacking. Such a derivation can be obtained using a probabilistic reasoning analogous to the argument used by  to model the Allee effect through stochastic mating encounters:
Through physical movement or any other means of dispersion, an infected individual will have contact with a given number of susceptible individuals in the population. The potential to effectively disperse the disease (virus) could be thought of as being proportional to that number of susceptibles with whom the infected individual makes contact: indeed, the more contact the infected individual has with susceptibles, the more likely he is to effectively transmit the disease. It then follows that the magnitude of the realized disease dispersion could be measured for example, in terms of the dispersion ability (i.e. vagility) of the infected individual. Accordingly, every infected individual will be expected to realize a certain virus (or micro-parasite) dispersion potential. Let the realized disease dispersion made by one infected individual be denoted by . Then, the number of successful transmission encounters per infectious individual can be modeled with a random variable . By writing , we are stressing the fact that the infection process is a function of the magnitude of the realized dispersion. Furthermore, we assume that the probability that an infected individual encounters and infects a susceptible individual given a realized change in dispersion is proportional to the previous number of successful infection encounters times a function of the number (or density) of the infected individuals in the population. Often , a non-linear function is chosen to account for factors such as crowding of infected individuals, multiple pathways to infection, stage of infection and its severity or protective measures taken by susceptible individuals. These assumptions allow us to specify a new infection event as the conditional probability(9)
where is a non-negative function such that is a constant. Towards the end of this section we discuss possible functional forms for . We remark that if counts the number of successful transmission encounters of an infected individual that recently invaded a population consisting only of susceptible individuals, then the expected value of is in fact equal to the mean number of secondary infections in the context of the SIRS model. If the SEIR model dynamics is in place, then, when there is only one infected individual in the population, . Assuming that the probability that more than one successful infectious encounter occurs after an extra dispersion amount is negligible, then can be modeled using a simple homogeneous birth process where the quantity being born is the number of successful virus transmission encounters. The probabilistic law of this stochastic process is completely defined by the terms . To solve for these terms, first note that according to eq. (9)
which leads to
In the limit when , the above equation leads in turn to the following system of differential equations:
Then, it is well known  that solving this system of equations leads to(10)
Furthermore, approximating using a Taylor series expansion around leads to specific quantitative definitions of the stochastic process . For example, if or if , the one-step transition probability mass function (pmf) of adopts the negative binomial and Poisson forms respectively . The Negative Binomial transition pmf would bring into the picture over-dispersion (higher variance to mean ratio) as a key qualitative property of the moments of the pure birth process describing the evolution of the number of successful transmission encounters. In any case however, the probability that one infected individual successfully passes on the infection is
This expression is readily interpretable: for a fixed value of , the probability of successfully passing on the infection converges to as the product grows large. Therefore, in this expression we are recovering the model property that the probability of successfully passing on the infection increases with the realized disease dispersion effort . Each individual's realized dispersion is in turn related to the individual's ‘effort’ to transmit the infection. In a given population, the magnitude of the realized disease dispersion for each infected individual can be expected to vary widely. Accounting for this demographic source of heterogeneity could be achieved by assuming that each individual's dispersion ability is drawn from a given probability distribution. That is, we would be modeling the variation in disease dispersion per infected individual with a random variable whose pdf has support on . Without loss of generality, here we model randomness in the product instead of just in the realized disease dispersion . Then, the probability that an infected individual chosen at random from the population realizes more than one successful secondary infection is found by averaging over all the possible realizations of . That is,
A suitable probabilistic model for with empirical and theoretical support can be difficult to find (see for instance the models in ). A flexible positive, continuous distribution such as the gamma distribution could therefore be used. Here, we assume that the magnitude of the disease dispersion brought about by an infected individual is distributed according to a special case of the gamma pdf, the exponential distribution. Accordingly, letting we get that the probability of successfully transmitting the infection is(12)
As mentioned before, various biological hypotheses pertaining the behavior of the transmission as a function of the abundance of infected individuals have been advanced to justify various functional forms of . Suitable candidates for should satisfy the conditions
These conditions guarantee the basic requirement that the probability of a new infective encounter (eq. 9) is null in the absence of infected individuals and that the overall chance that a new infection occurs increases proportionally with when is small. Furthermore, if such proportionality decreases in magnitude as grows large (that is, is concave down). Consider the following two functional forms:
- , where is a constant. This model whose second derivative is negative, was first proposed by Capasso and Serio  to account for saturation of infected individuals. Substituting this functional form in eq. (12) we get that
Note that here, the biological hypothesis of saturation is translated into a model using a phenomenological argument: the functional form of the model mimics a hypothesized pattern instead of modeling the biological process generating the pattern.
- . This function is the simplest way to satisfy the three conditions above without introducing an extra parameter and/or a phenomenological modeling approach. However simple, when substituted in eq. (12) we still recover the same functional form for the probability of at least one successful transmission encounter, that is
The exponential distribution parameter takes here an important meaning: it is the density of infected individuals at which the probability of successfully transmitting the infection is . It also follows from this argument that the incidence rate function can be modeled as a constant times the probability of picking an infected individual at random in the population times the probability that an infected individual successfully passes on the infection times the total number of available susceptibles in the population. That is,
which is Liu's and Hethcote and van den Driessche's model with and . This incidence rate function explicitly states that the transmission rate is proportional to the number of available susceptible individuals and that the constant of proportionality is a function of the number of infected individuals. Also, we would like to stress that, by taking into account the per-individual variability in dispersion abilities, this formulation of the incidence rate function goes from individual-based processes to population-wide patterns in disease transmission. The effect of different hypotheses pertaining individual-based contagion processes into the population-level disease transmission processes could be tested by proposing different -biologically meaningful- probability distributions of the infected individuals potential to disperse the disease.
Many other functional forms for the incidence rate could be derived using the above arguments. If for instance other heavy-tailed distributions are used instead of the exponential distribution, other incidence rate functional forms will arise and this could certainly be the topic of further research. However, in this work we limit ourselves to the exploration of the reaches of using the LHD model because it explicitly incorporates heterogeneity in transmission potential, because of its bi-stability properties (see “qualitative analysis of the SIRS models” section) and to formally test if it arises as a better explanation for bi-annual epidemic patterns using data from different localities and diseases. Thus, from this point on, in this work we will only consider the LHD incidence rate function and the classical incidence rate . In his seminal paper, Hethcote  also mentions that the LHD general incidence rate function could be eventually coupled with any seasonal forcing function. Motivated by this comment, in the results section we explore the reaches of doing so.
Materials and methods
RSV data analysis.
The parameters for the SIRS model with two different incidence rate functions were estimated via maximum likelihood  using time series data from two localities in Gambia and in Finland (Figure 1, data kindly provided by Prof. A. Weber, see also ). For each geographical locality, the data consists of the pairs , where denote the reported number of cases (i.e. incidence) at time , for a total of time steps. In both localities the size of the time step is a month. Because the data of infected individuals consists of counts, a natural and simple statistical sampling model is the Poisson distribution , –. Heterogeneity in sampling effort or other sources of heterogeneity in the sampling scheme could be accounted for using the negative binomial distribution, but we consider that the Poisson model is a fairly robust description of the situation faced with this data sets (see , sub-section “Observation error models” in the “Discussion”). Therefore, we assumed that the observations are independent realizations of a Poisson distribution whose mean changes according to the deterministic model predictions. Let be the predicted number of new cases between times and by a SIRS model evaluated at the vector of parameters , that is:
for the classic SIRS model and
for the LHD SIRS model. For the SEIR model with either incidence rate functions, the model predicted number of new cases was computed as . To carry the numerical integrations, we used Romberg's method (see  and links to programs in Supporting Information). We assumed that the first observation arose from the process at stationarity, that is, once the limit cycles predicted by both models had been reached. The biological reasoning behind this assumption is the fact that the infectious process of interest is a well-established disease that has evolved a stable dynamics and is under the influence of a stationary climatic process. The above assumptions allow us to adopt the Poisson sampling model
where the constant of proportionality involves the infected individuals' detection probability (see  p. 10).
Figure 1. Observed time series of infected individuals in Gambia and Finland.
Plotted are the monthly number of reported syncytial virus cases in two cities: Banjul in Gambia (from October 1991 to September 1994) and Turku in Finland (from October 1981 to March 1990). Plotted also is the mean monthly temperature range for both localities, for the same time spans.doi:10.1371/journal.pcbi.1001079.g001
Assuming that the observations are independent between them, the joint distribution of the observed infected individual abundances is a good approximation to the likelihood function , which would simply be defined by the product of the individual pdf's of the observations:(13)
The maximum likelihood (ML) parameter estimates for , denoted are the values of that jointly maximize . That is, the ML estimates are the solution to
which is equivalent to solving . Accordingly, the parameter values that minimized the negative log-likelihood
were taken to be the ML parameter estimates. The minimization was carried using the L-BFGS algorithm of Zhu et al . The computer code written in Python 2.6.1 used in this work can be found as a supplement under the title “Dataset S1”.
Additional information about the weather was also incorporated in the parameter estimation process. In particular, the mean monthly temperature range data available at , meteorologic stations and were used as weather covariates to find the ML estimates of the models parameters. This weather variable has a strikingly strong sinusoidal pattern that has the same periodicity than the time series of infected individuals. Also, as shown in Figure 1 the mean monthly temperature range (hereafter simply referred to as “the weather covariate”) and the time series of infected individuals appear to be exactly out of phase: a lower mean monthly temperature range is accompanied by a high reported number of infected cases for the same month. Therefore, to include the weather data in the parameter estimation and modeling processes, we assume that the cosine function (8) denotes the effect of the mean monthly temperature range in the number of infected individuals for the same months. The data to be used for parameter estimation when both, the weather and the weather effects are modeled is composed of the triplets , where denotes the observed mean monthly temperature range for month . Denote with the mean of the cosine incidence rate function (8) and with the average of the mean monthly temperature range stationary time series. We assume that the incidence rate can be modeled with a deterministic linear function of the true weather covariate :(14)
where is a factor transforming temperature in incidence rates and is a reference incidence rate at zero temperature. Solving for in the above eq. (14) yields(15)
where the RHS is derived by noting that by construction, the independent term is the average monthly temperature . Also, we remark that using the empirical assumption that incidence rates and temperature are exactly out of phase implies that .
To connect the time series of observed weather values , to the model above, we adopt a Normal statistical sampling model. In particular, we assume that these observations are Normal deviates with mean given by (eq. 15) and constant variance . Let denote the weather model prediction from eq.15 corresponding to the weather observation . The negative log-likelihood function derived from such statistical sampling model then becomes the score function that is minimized using a numerical algorithm. The likelihood function for the weather data is
Maximizing this likelihood function to find the ML parameter estimates for the vector is equivalent to minimize the sum of squares
The ML estimate of is found in turn by plugging the ML estimates of in the likelihood function and solving
Accordingly, we find that
More complex stochastic continuous models that not only model the sampling error (under and over reporting for instance) but also the stochasticity inherent to the weather process will be treated in a future paper. Because information about and is also conveyed by the time series of infected cases, we maximized the joint likelihood of the time series of infected cases and of the weather data which, from independent sampling is taken to be the product of the individual likelihoods . We maximized this likelihood which amounted to jointly minimize the sums of squares and the negative log-likelihood (see eq. 13). The results of the parameter estimation process with and without covariates are reported in the results section.
Finally, previous information about the value of the model parameters , and was available in Weber et al. . We fixed these parameters at the values for Finland and for Gambia. Also, the total population sizes was taken to be in Finland and in Gambia. This population sizes are the scaling factors reported in the unit based model of Weber et al. . Once the ML estimates for the two SIRS models and the two localities were found, we proceeded to carry a model selection process using Akaike's information criterion . This procedure allowed us to select amongst the two models at hand (the SIRS model with classical and LHD incidence rate functions) which one appeared to represent a better explanation of the epidemic patterns seen in the time series data. The use of AIC for model selection has a strong theoretical rooting in information theory. For a given data set, the AIC gives an estimate of the expected, relative, directed distance between the fitted models and the unknown true mechanism that generated the data . Thus, the decision rule for model selection is to choose the model with the lowest AIC. Let denote the likelihood function for model evaluated at the ML estimates and let denote the number of parameters used by model . Then, the AIC statistic of model is simply:
Often, model selection exercises are carried using two or more information criteria. Here, we relied on AIC and on the Bayesian information Criterion (BIC)  to simultaneously assess the quality of each model to explain the data at hand. We note that Schwarz  showed for a large lass of models that if the true model is among the suite of competing explanations, then the BIC will choose the true model in the limit, as sample size increases, with probability approaching 1 (that is, the BIC is statistically consistent if the true model is in the candidate pool). In real situations, the BIC will select the model in the pool that best approximates the true model. The BIC is calculated with:
where is the total number of data points used in the parameter estimation process. When we used the weather time series besides the time series of infected individuals for parameter estimation we took . For the models fitted using the simple Poisson likelihood we used . The resulting AIC and BIC values for each model and each locality is shown in the results section. A disagreement between the two statistics would indicate that there is not enough evidence in the data to support the best model, and a decision would have to be taken after investigating the type I error rates of each model using extensive simulations.
Measles data analysis.
Two time-series from the UK data set (http://www.zoo.cam.ac.uk/zoostaff/grenfell/measles.htm) were chosen: the data for London and Birmingham. According to previous research efforts , these UK cities have a population size well above the critical community size, the effects of demographic stochasticity are not expected to be large and the disease was endemic from 1944 to 1966. Further, it has been established that measles in the UK reveals a well defined biennial pattern of major and minor epidemics after the baby boom of 1947 and before the national immunization program started in 1968 . We estimated the parameters of the SEIR model with two different incidence rates with data from London and Birmingham from 1950 to 1959. While analyzing these measles data, other authors have included as seasonal forcing the effect of school terms by means of a term-time forcing function , . Although we are aware that this approach leads to more realistic predictions, we constrain ourselves to a simple sinusoidal function since it constitutes a low dimensional approximation amenable to bifurcation analysis.
For each city, the data consists of pairs , where denote the number of reported cases at time , for a total of time steps. In both localities the size of the time step is two weeks. To connect the time series data with the SEIR model we used the same approach as with the RSV data set: we assumed that the true infectious process is deterministic and that the observed deviations from the model predictions were due to Poisson sampling error. The minimization of the negative log-likelihood function eq. (13) was again carried using the L-BFGS algorithm. We note that not all the model parameters were estimated. The values for the mean latent and infectious periods were taken to be and respectively .
Assessing the effects of environmental stochasticity.
A common way to investigate the range of possible dynamic behaviors exhibited by a model is by means of bifurcation diagrams. Kuznetsov  and Earn et al  for instance, illustrate how varying the value of the seasonality and/or the mean contact rate gives rise to saddle-node and period doubling bifurcations. A trajectory that switches between multiple basins of attraction can result from the interaction between stochasticity and complex deterministic dynamics . To assess the effects of environmental stochasticity in the SIRS and SEIR models' dynamics we simulated stochastic dynamics from the associated Poincaré map in the following way :
Consider the discrete map that results from recording the same day every year the solution of the continuous SEIR or SIRS models. Denote this discrete map by , where is the vector denoting the recorded solution at year . The discrete map was perturbed with environmental noise by multiplying by normal random variables , where for the SIRS model and for the SEIR model. With such a perturbation, the growth rate of the discrete map becomes
It is well known that a discrete map with environmental and demographic stochasticity is characterized by a growth rate whose variance is , where and are constants. The signature of environmental noise is that its variance is independent of the size of the state variables . In this case, including the environmental noise according to  results in a perturbation in the growth rate with mean and a variance approximately equal to .
Parameter estimation and model selection
The two different SIRS models were fitted to time-course data of reported cases of syncytial virus infections. The data come from Gambia and Finland (Figure 1). Two ML formulations were used. The first one consisted of a Poisson likelihood that only required the available observed counts of infected individuals (eq. 13). The second formulation consisted of the joint likelihood of the counts and of the observed weather covariate and thus used information present on the time series of reported cases and on the corresponding time series of mean monthly temperature range for both locations. The ML estimates according to the first formulation for each model and data set combination are displayed in Table 1. Both information criteria used indicate that for Finland, the best model was the SIRS model with LHD incidence rate function. For Gambia, both information criteria for the SIRS model with classic incidence rate function are lower by three points approximately. This implies that given the data and the two information criteria ways of penalizing the likelihood score, both models are nearly indistinguishable for any practical purpose . In Gambia, the extra parameter introduced by the LHD model is penalized: given the data set at hand, incorporating one extra parameter does not lead to a clear improvement In Figure 2 we plotted the model predicted number of infected individuals versus the observed values for the classical and the LHD SIRS model respectively. Note that, even though the best model is deterministic, the dynamics displayed by the data (small epidemics followed by a big epidemic peak) is very well recapitulated by the predicted solutions.
Figure 2. Predicted vs. observed time series of infected individuals.
Using the ML estimates in Table 1, the predicted infected dynamics of the classical SIRS model was compared against number of infected individuals reported in Gambia and in Finland. Panels A and B show the predictions for the Classical SIRS model and panels C and D show the predictions for the LHD SIRS model.doi:10.1371/journal.pcbi.1001079.g002
Table 1. RSV-SIRS model parameter estimates and model selection using a Poisson sampling model.doi:10.1371/journal.pcbi.1001079.t001
The results of the second ML formulation are qualitatively identical to the results with the Poisson likelihood (see table in the Text S1). For Finland, the BIC statistic for the classical model was 10376.2000 and for the LHD model 9893.5780. For Gambia, the BIC for the classical model was 729.1133 whereas the LHD model had a BIC of 733.2750. Hence, here again, for Finland the LHD is the best model whereas for Gambia, the classic model is better. Because the BIC can be used only to compare models for which the numerical values of the dependent variable are identical for all estimates being compared, it cannot be used to select between the two ML formulations. Indeed, in the second likelihood formulation the data fitted consist not only of the time series of infected counts but also of the monthly temperature range, thus it uses twice as much data for parameter estimation. Zeng et al  mention that an indication of which likelihood formulation is better can be obtained by comparing the per datum BIC score. Take for instance the BIC for the LHD model for Finland, 9893.5780. Dividing that BIC by the total number of data points used (, we get a per datum BIC of 48.4979. Now, the BIC for the LHD model for the Poisson likelihood formulation is (Table 1) 3196.9330. Dividing that number by the number of data points used () we get 31.34248. Thus, the Poisson likelihood formulation yields a better per datum BIC for Finland. For Gambia, the Poisson likelihood formulation seems to be better than the Poisson-Normal sampling model: for the classic model with Poisson likelihood this statistic is , whereas for the classic model with Poisson-Normal likelihood it is .
The SEIR model with classic and LHD incidence rate were fitted to measles time series data from London and Birmingham. In both cities, the SEIR-LHD model was selected as best (see Table 2). Notably, the difference in AIC and BIC is at least 2000 points in each case. The predictions for each model and city combination are shown in Figure 3. We remark that assessing and comparing the quality of the model predictions visually may be misleading. Indeed, according to our likelihood formulation, the parameter estimation process does not weight equally a deviation from the model prediction at low and high infected counts. In fact, the variance of the Poisson sampling error varies according to the mean predictions .
Figure 3. Predicted vs. observed time series of infected individuals.
Using the ML estimates in Table 2, the predicted infected dynamics of the SEIR model was plotted against the number of infected individuals reported in London and Birmingham. Panels A and B show the predictions for the classical SEIR model and panels C and D show the predictions for the LHD SEIR model.doi:10.1371/journal.pcbi.1001079.g003
Table 2. Measles SEIR model parameter estimates and model selection using a Poisson sampling model.doi:10.1371/journal.pcbi.1001079.t002
Qualitative analysis of the SIRS models
In this section we discuss the differences in the qualitative behavior of the SIRS model (1)–(3) with both classical and LHD incidence rates with and without seasonal forcing. We refer the interested reader to the Text S1 for proofs of the following claims. By construction, the set is a positively invariant set of the SIRS model (1)–(3). If we set the coefficients constant, the Dulac criterion guarantees that the SIRS model with neither the classic nor the LHD incidence rate function has periodic solutions in . Regarding the classical incidence rate, the SIRS model has two stationary solutions: a disease free equilibrium () and an endemic equilibrium (). It is well known that is a threshold for this model: If the disease remains endemic, while implies that the disease dies out. On the other hand, the SIRS model with LHD incidence rate has one disease free equilibrium and two endemic equilibria and . The is unconditionally a local attractor. However, only one of the endemic equilibria denoted as , lies inside the positively invariant set . If the endemic point is locally an attractor. Thus, when the LHD model exhibits bi-stability.
Introducing seasonal forcing has the following effects on the SIRS dynamics with classic incidence: first, it is well known that by letting the contact rate to be a periodic function of the form (8) where is small, the SIRS model with classical incidence rate has a periodic solution with period . This behavior is shown in Figure 4 A and B. Also, when seasonal forcing is introduced, the basic reproductive number becomes a periodic function of time, , that oscillates between the values and . The endemic point also becomes a periodic function of time that bounces back and forth between two extreme points, and . The expressions for and are given in the Text S1. The associated limit cycle of the model's solution inherits the stability behavior of the endemic point: if , then the limit cycle is asymptotically stable. A stable limit cycle is displayed in Figure 4 C. Because the function can cross the boundary of periodically depending on the value of , the dynamic behavior of the model's trajectory with respect to the nature of the endemic point (stable/unstable) can be described with a race analogy: The model's solution can be thought of as a hopeless ‘pursuer’ engaged in a race against the endemic solution who plays the role of the fast ‘leader’ that cannot be caught upon. Just as in a cycling race, as soon as the leader changes its strategy, so does the pursuer behind the leader. In that way, if is such that and only while , the leader () is deemed as stable and the solution's trajectory pursues the endemic point . As soon as becomes less than , the leader ‘changes its strategy’ and is deemed unstable whereas the becomes stable. At that moment, the trajectory switches its objective and pursues the and keeps doing so while . That sudden change of objective gives rise to a period doubling bifurcation of the limit cycle as seen in Figure 4 D. This change of objective (period doubling bifurcation) happens as grows large. We remark that at least one route to chaos in the associated Poincaré map of this model when is taken as the bifurcation parameter has been shown , , .
Figure 4. Predicted model dynamics by the classical SIRS model.
Using the ML estimates in Table 1, the predicted dynamics of the classical SIRS model was plotted without seasonal forcing for both localities, Gambia and Finland (subplots A and B respectively). When seasonal forcing is added (subplots C and D), a limit cycle arises and the endemic equilibrium becomes a function of time (see “Qualitative analysis of the fitted SIRS models”). If the strength of seasonality is large enough as it is the case in Finland, the limit cycle undergoes a period doubling bifurcation creating a small loop in the phase plane. This loop corresponds to the alternating small epidemic outbreaks observed in the predicted and recorded time series of infected individuals for Finland.doi:10.1371/journal.pcbi.1001079.g004
Finally, in the SIRS model with LHD incidence rate (see Figure 5 A and B), if we let the contact rate to be a periodic function of the form (8), a limit cycle also arises (see Figure 5 C). Here again, as increases, the trajectory engages in the same pursuer/leader dynamics and the limit cycle undergoes a period doubling bifurcation (Figure 5 D). However, contrary to what happens in the classical SIRS model with seasonal forcing, periodicity or extinction of the epidemics depends also on the initial conditions: if the initial proportion of infected individuals is too high, the disease will die from a subsequent depletion of the susceptible pool of individuals. Only if the epidemic begins with a small number of individuals will it slowly work its way up and attain a persisting limit cycle.
Figure 5. Predicted model dynamics by the nonlinear LHD SIRS model.
Using the ML estimates in Table 1, the predicted dynamics of the nonlinear SIRS model with the LHD incidence rate function was plotted without seasonal forcing for both localities, Gambia and Finland (subplots A and B respectively). When seasonal forcing is added (subplots C and D), a limit cycle arises and the endemic equilibrium becomes a function of time (see “Qualitative analysis of the fitted SIRS models”). If the strength of seasonality is large enough as it is the case in Finland, the limit cycle undergoes a period doubling bifurcation creating a small loop in the phase plane. This loop corresponds to the small alternating epidemic outbreaks observed in the predicted and recorded time series of infected individuals for Finland.doi:10.1371/journal.pcbi.1001079.g005
Multiple lines of evidence show that the forced SIRS and SEIR models with LHD incidence rate function constitute a better explanation of the seasonal epidemic patterns than the corresponding classical models with seasonal forcing, for the data sets and cases explored here. The first line of evidence is statistical in nature: when confronted with different time series of seasonal epidemics, the LHD model was selected as best in three out of four cases and in the fourth case, the LHD model was nearly indistinguishable from the classic model. By formulating the fitting and the model selection problems using likelihood-based inference and information theoretic model selection criteria we were able to conclude that given the data and the models at hand our model embodies the most likely explanation of how the observed data arose. Our model's nonlinear incidence rate takes into account heterogeneity in the ability to transmit the infection while modeling the infectious process as a pure birth stochastic process and hence, it is a more realistic model formulation. This new level of model complexity was achieved by incorporating only one extra parameter. The emphasis we give to a first principles derivation that hinges on interpretability and simplicity is not always sought in other SIR-type model formulations and modeling exercises , , , , . Hence, our results show that a careful exploration of other incidence rate functions before resorting to mathematically more complex, high-dimensional models may bring new insights into the current understanding of the functioning of epidemics.
Another line of evidence in favor of the LHD model comes from its qualitative predictions. The classical SIRS model without the seasonal forcing predicts somewhat artificially that regardless of the initial proportion of infected and susceptible individuals, provided , the endemic equilibrium will be reached . On the other hand, the LHD model without seasonal forcing predicts that the disease-free equilibrium is always an attractor, thus exhibiting bi-stability (see qualitative analysis section). Hence, if the initial proportion of infected individuals is too high, the disease will die from a subsequent depletion of the susceptible pool of individuals, contrary to what the classical model predicts. For the disease to persist in the population, the initial proportion of infected individuals has to be very low. Only then the infection process will proceed steadily to the endemic solution. This qualitative prediction matches the virus transmission strategy that the syncytial virus seems to have evolved: recall that in our model the extra parameter is the density of infected individuals at which the probability of successfully transmitting the infection is . In every locality, the ML estimates of were in the order of to , thus indicating that a very low density of infected individuals is needed in order to maximize the transmission rate of the measles and RSV diseases.
Incorporating weather covariates to our nonlinear SIRS model further improves the biological insights that can be concluded from the parameter estimation and model analysis exercises. A simple look at the strong auto-covariation patterns and at the pure weather trends, in particular for Gambia (Figure 1) indicate that modeling weather and weather effects with a sinusoidal function seems a natural add-on to the classic SIRS model, for this data set. For Gambia, the fact that the per datum BIC for the LHD model with the joint Poisson-Normal likelihood is very similar to the per datum BIC for the classic model indicates that the weather can indeed be viewed as a simple rotation and translation (eq. 15) of the weather effects (eq. 8). Thus eq. 15 may not always be viewed only as a phenomenological artifact . For Finland, however, this was not the case. The per datum BIC favors much more clearly the Poisson likelihood formulation. Hence, we consider that in Finland the weather effects model (eq.8) would be better expressed as some unknown nonlinear transformation of the weather. In other words, in this country with more extreme weather, a change in the temperature range of a certain size is not translated as an equivalent change in the weather effects in the transmission rate. Also embedded within our weather effects model formulation (eq.8) is the hypothesis that weather affects incidence rates in a nonlinear fashion. In particular, when the strength of seasonality is high enough, the limit cycles predicted by both weather forced models undergo a period doubling bifurcation such that relatively small epidemic outbreaks are followed by big ones. Notably, these effects of the strength of seasonality were detected in Finland, the locality where the amplitude of the relative weather oscillation is larger.
The model selection exercise should by no means be the ending point of the analysis. Instead, if appropriateness of one model vs. the other cannot be resolved, a near-tie in a model selection situation should lead to the search and reformulation of each model's scientific predictions in a way that can be clearly tested in further experiments. Hence, the model selection results presented here should be rather viewed as the starting point of further analyses (see ).
Even for simple deterministic models, parameter estimation for dynamic data can be non-trivial. Dynamic models often present multimodal likelihoods thus complicating the parameter estimation process . In these cases, the type of inferences possible is limited due to the presence of wide confidence sets that include parameter values with different qualitative predictions. If for instance the ML estimate of a bifurcation parameter is in a 2 limit-cycles region but its confidence interval includes parameter values for which these cycles do not appear, then there is not enough evidence in the data at hand to properly infer something about the size of the parameter of interest and hence, about the dynamic properties displayed by the data. In our case however, the precision of our parameter estimates and in particular, of the bifurcating parameter (Tables 1 and 2) is enough to identify the bifurcation region where the strength of seasonality lies for the data at hand.
Although in the two models studied here a period doubling bifurcation appears in the limit cycle, the LHD incidence rate model still provides very different qualitative predictions. In the classical model, the value of the basic reproduction number as a function of time acts as a stability switch for the DFE, so that any trajectory that begins with biologically realistic initial conditions will eventually enter the limit cycle. This is not the case for the LHD model, for which the periodicity or extinction of the epidemics depends very naturally on the initial conditions. Other studies have incorporated seasonal forcing in SIRS-type models , , , but since all have used the classical incidence rate function, they constrain their disease persistence and epidemics predictions to whether the basic reproductive number can or cannot be periodically above 1.
Nonlinear incidence rate forms derived from first principles constitute a promising starting point to review the interaction between demographic and environmental stochasticity and nonlinear seasonal effects. Indeed, recent studies have considered including in the classic SIRS model stochasticity in the seasonal process, besides sampling and/or observation error . After showing that a simple pure observation error fit of our LHD model brings about a considerable fit improvement, we explored the qualitative differences between the models by coupling the deterministic skeletons with environmental noise. In Figure 6, the depicted stochastic trajectories show that in the classical model increasing the environmental noise results in transient visits to the disease free equilibrium stable submanifold (panel c)), whereas in the LHD model, with a large enough perturbation the trajectory visits the disease free equilibrium basin of attraction and remains there. Hence, the fact that regardless of the value of the basic reproduction number the DFE is always an attractor opens the door to stochastic phenomena whereby the trajectory exits the endemic solution basin of attraction and hits just by chance the DFE basin of attraction, only when the LHD incidence rate is used. By the same token, the trajectory periodically wanders in the direction of the DFE stable submanifold (similar to the “saddle fly-by” reported by Cushing et al ).
Figure 6. Numerical evaluation of the Poincaré map for the SIRS model with environmental stochasticity.
The stationary state was initially perturbed with environmental stochasticity (green diamond). Subsequently, the map was iterated and plotted 3000 times, and at each time, environmental stochasticity was incorporated in the mapping function. The final location of the trajectory was plotted as a red diamond. In panels A and B the environmental stochasticity noise was and both the initial and final states of the trajectory are in a neighborhood of the attractor. In panels C and D was . Note that in the classical model increasing the environmental noise results in transient visits to the disease free equilibrium stable submanifold (panel C), whereas in the LHD model, with a large enough perturbation the trajectory visits the disease free equilibrium basin of attraction and remains there.doi:10.1371/journal.pcbi.1001079.g006
The results presented here are not by any means an exhaustive exploration of the interplay between nonlinear dynamics and stochasticity, both critical factors shaping seasonal epidemic patterns. However, our results may be viewed as the starting point of multiple research avenues. Three such research topics could be: first-principles derivation of non-linear incidence rate functions, the role of bi-stability and demographic stochasticity for disease persistence and the simulation of environmental and demographic stochasticity in the Poincaré map.
Dataset and Python program files. In this directory you will fine all the python code needed to reproduce the calculations in the paper, including the figures.
(2.90 MB ZIP)
(0.21 MB PDF)
We thank Andreas Weber for the access granted to the data sets and Brian Dennis, Mark L. Taper, Jorge Velasco-Hernández, Mercedes Pascual and three anonymous reviewers for useful comments and insights.
Conceived and designed the experiments: JMMP MAC. Performed the experiments: JMMP MAC. Analyzed the data: JMMP MAC. Contributed reagents/materials/analysis tools: JMMP MAC. Wrote the paper: JMMP MAC.
- 1. Hethcote H (1994) A thousand and one epidemic models. In: Levin S, editor. Frontiers in Mathematical Biology. Lecture Notes in Biomathematics 100. Berlin: Springer. pp. 504–515.
- 2. Hethcote H (2000) The mathematics of infectious diseases. SIAM rev 42: 599–653.
- 3. Hethcote H, Driessche P (1991) Some epidemiological models with nonlinear incidence. J Math Biol 29: 271–287.
- 4. Allen L (1994) Some Discrete-Time SI, S/R, and S/S Epidemic Models. Math Biosci 124: 83–105.
- 5. Allen L, Burgin A (2000) Comparison of deterministic and stochastic SIS and SIR models in discrete time. Math Biosci 163: 1–33.
- 6. Ruan S, Wang W (2003) Dynamical behavior of an epidemic model with a nonlinear incidence rate. J Differ Equations 188: 135–163.
- 7. Alexander M, Moghadas S (2006) Bifurcation Analysis of an SIRS Epidemic Model with Generalized Incidence. SIAM J App Math 65: 1794–1816.
- 8. Korobeinikov A, Maini P (2005) Non-linear incidence and stability of infectious disease models. Math Med Biol 22: 113–128.
- 9. Weber A, Weber M, Milligan P (2001) Modeling epidemics caused by respiratory syncytial virus (RSV). Math Biosci 172: 95–113.
- 10. Bjørnstad O, Finkenstädt B, Grenfell B (2002) Dynamics of measles epidemics: estimating scaling of transmission rates using a time series SIR model. Ecol Monogr 72: 169–184.
- 11. Bolker B, Grenfell B (1995) Space, persistence and dynamics of measles epidemics. Philos Trans R Soc Lond B Biol Sci 348: 309–320.
- 12. Cattadori I, Boag B, Bjørnstad O, Cornell S, Hudson P (2005) Peak shift and epidemiology in a seasonal host–nematode system. Proc R Soc Lond B Biol Sci 272: 1163.
- 13. Dietz K (1976) The incidence of infectious diseases under the influence of seasonal fluctuations. In: Berger J, Bühler W, Repges R, Tautu P, editors. Proceedings of a Workshop on Mathematical Models in Medicine, Mainz. Lecture Notes in Biomathematics 11. Berlin: Springer-Verlag. pp. 1–15.
- 14. Greenman J, Kamo M, Boots M (2004) External forcing of ecological and epidemiological systems: a resonance approach. Physica D 190: 136–151.
- 15. Keeling M, Rohani P, Grenfell B (2001) Seasonally forced disease dynamics explored as switching between attractors. Physica D 148: 317–335.
- 16. Stone L, Olinky R, Huppert A (2007) Seasonal dynamics of recurrent epidemics. Nature 446: 533.
- 17. King A, Ionides E, Pascual M, Bouma M (2008) Inapparent infections and cholera dynamics. Nature 454: 877–U29.
- 18. Pascual M, Dobson A (2005) Seasonal patterns of infectious diseases. PLoS Med 2: 18–20.
- 19. Altizer S, Dobson A, Hosseini P, Hudson P, Pascual M, et al. (2006) Seasonality and the dynamics of infectious diseases. Ecol Lett 9: 467–484.
- 20. Altizer S, Hochachka W, Dhondt A (2004) Seasonal dynamics of mycoplasmal conjunctivitis in eastern North American house finches. Ecology 73: 309–322.
- 21. Pascual M, Rodó X, Ellner S, Colwell R, Bouma M (2000) Cholera dynamics and El Nino-southern oscillation. Science 289: 1766.
- 22. Capasso V, Serio G (1978) A generalization of the kermack-mckendrick deterministic epidemic model. Math Biosci 42: 41–61.
- 23. Hethcote H, Driessche P (1991) Some epidemiological models with nonlinear incidence. J Math Biol 29: 271–287.
- 24. Liu W, Hethcote H, Levin S (1987) Dynamical behavior of epidemiological models with nonlinear incidence rates. J Math Biol 25: 359–380.
- 25. Wang W, Ruan S (2004) Bifurcations in an epidemic model with constant removal rate of the infectives. J Math Anal and Appl 291: 775–793.
- 26. Jin Y, Wang W, Xiao S (2007) An SIRS model with a nonlinear incidence rate. Chaos Solitons Fractals 34: 1482–1497.
- 27. Billings L, Schwartz I (2002) Exciting chaos with noise: unexpected dynamics in epidemic outbreaks. J Math Biol 44: 31–48.
- 28. Keeling M, Rohani P (2008) Modeling infectious diseases in humans and animals. Clin Infect Dis 47: 864–6.
- 29. Allen L (2008) An introduction to stochastic epidemic models. In: Brauer F, Van den Driessche P, Wu J, editors. Mathematical Epidemiology. Lecture Notes in Mathematics. Berlin: Springer. pp. 81–130.
- 30. Earn D, Rohani P, Bolker B, Grenfell B (2000) A simple model for complex dynamical transitions in epidemics. Science 287: 667.
- 31. Alonso D, McKane A, Pascual M (2007) Stochastic amplification in epidemics. J R Soc Interface 4: 575.
- 32. Bolker B, Grenfell B (1993) Chaos and biological complexity in measles dynamics. Proc R Soc Lond B Biol Sci 251: 75–81.
- 33. Hoshen M, Morse A (2004) A weather-driven model of malaria transmission. Malar J 3: 32.
- 34. Brauer F (2008) Compartmental models in epidemiology. In: Brauer F, Van den Driessche P, Wu J, editors. Mathematical Epidemiology. Lecture Notes in Mathematics. Berlin: Springer. pp. 19–80.
- 35. Derrick W, Driessche P (1993) A disease transmission model in a nonconstant population. J Math Biol 31: 495–512.
- 36. Hethcote H, Levin SA (1989) Periodicity in epidemiological models. In: Gross L, Hallam TG, Levin SA, editors. Applied Mathematical Ecology 18. Berlin: Springer. pp. 193–211.
- 37. Dennis B (1989) Allee effects: population growth, critical density, and the chance of extinction. Natural Resource Modeling 3: 481–538.
- 38. Karlin S, Taylor H (1975) A first course in stochastic processes. New York: Academic Press.
- 39. Orr H (2005) The genetic theory of adaptation: a brief history. Nat Rev Genet 6: 119–127.
- 40. Pawitan Y (2001) In all likelihood: statistical modelling and inference using likelihood. Oxford University Press, USA.
- 41. Lele S (2006) Sampling variability and estimates of density dependence: a composite-likelihood approach. Ecology 87: 189–202.
- 42. Dennis B, Ponciano J, Lele S, Taper M, Staples D (2006) Estimating density dependence, process noise, and observation error. Ecol Monogr 76: 323–341.
- 43. Van den Bos A (2007) Parameter estimation for scientists and engineers. Wiley-Interscience.
- 44. Dahlquist AG, Bjork A (1974) Numerical methods. Englewood Cliffs (NJ): Prentice-Hall.
- 45. Diekmann O, Heesterbeek J (2000) Mathematical epidemiology of infectious diseases: model building, analysis, and interpretation. Wiley.
- 46. Sprott D (2000) Statistical inference in science. Springer Verlag.
- 47. Zhu C, Byrd R, Lu P, Nocedal J (1997) Algorithm 778: L-BFGS-B: Fortran subroutines for large-scale bound-constrained optimization. ACM Trans Math Softw 23: 550–560.
- 48. Akaike H (1992) Information theory and an extension of the likelihood ratio principle. In: Kotz S, NL J, editors. Breakthroughs in Statistics I. Berlin: Springer. pp. 610–624.
- 49. Burnham K, Anderson D (1998) Model selection and inference: A practical information-theoretic approach. New York: Springer-Verlag.
- 50. Schwarz G (1978) Estimating the dimension of a model. Ann Stat 6: 461–464.
- 51. Fine P, Clarkson J (1982) Measles in England and Wales–I: An analysis of factors underlying seasonal patterns. Int J Epidemiol 11: 5.
- 52. Clark J, Bjørnstad O (2004) Population time series: process variability, observation errors, missing values, lags, and hidden states. Ecology 85: 3140–3150.
- 53. Kuznetsov Y, Piccardi C (1994) Bifurcation analysis of periodic SEIR and SIR epidemic models. J Math Biol 32: 109–121.
- 54. Cushing J, Costantino R, Dennis B, Desharnais R, Henson S (2002) Chaos in Ecology. San Diego: Academic Press.
- 55. Zeng Z, Nowierski R, Taper M, Dennis B, Kemp W (1998) Complex population dynamics in the real world: modeling the influence of time-varying parameters and time lags. Ecology 79: 2193–2209.
- 56. Glendinning P, Perry L (1997) Melnikov analysis of chaos in a simple epidemiological model. J Math Biol 35: 359–373.
- 57. Diallo O, Koné Y (2007) Melnikov analysis of chaos in a general epidemiological model. Nonlinear Anal Real World Appl 8: 20–26.
- 58. Alexander M, Moghadas S (2004) Periodicity in an epidemic model with a generalized non-linear incidence. Math Biosci 189: 75–96.
- 59. Tarantola A (2006) Popper, Bayes and the inverse problem. Nat Phys 2: 492–494.
- 60. Capistrán M, Moreles M, Lara B (2009) Parameter Estimation of Some Epidemic Models. The Case of Recurrent Epidemics Caused by Respiratory Syncytial Virus. Bull Math Biol 71: 1890–1901.
- 61. Weber M, Mulholland E, Greenwood B (1998) Respiratory syncytial virus infection in tropical and developing countries. Trop Med Int Health 3: 268–280.