A major goal of systems biology is to understand how organism-level behavior arises from a myriad of molecular interactions. Often this involves complex sets of rules describing interactions among a large number of components. As an alternative, we have developed a simple, macro-level model to describe how chronic temperature stress affects reproduction in C. elegans. Our approach uses fundamental engineering principles, together with a limited set of experimentally derived facts, and provides quantitatively accurate predictions of performance under a range of physiologically relevant conditions. We generated detailed time-resolved experimental data to evaluate the ability of our model to describe the dynamics of C. elegans reproduction. We find considerable heterogeneity in responses of individual animals to heat stress, which can be understood as modulation of a few processes and may represent a strategy for coping with the ever-changing environment. Our experimental results and model provide quantitative insight into the breakdown of a robust biological system under stress and suggest, surprisingly, that the behavior of complex biological systems may be determined by a small number of key components.
Dynamic response to changing conditions in the environment is an essential property of all biological systems. Whereas extensive research over the last several decades has elucidated numerous molecular responses to environmental stress, there is much less known how these translate into organismal-level responses. Two types of modeling approaches are often used to bridge this gap. Fine-grained models seek to explain phenomena as resulting from interactions of large numbers of individual components. This approach demands a highly detailed knowledge of the underlying molecular mechanisms and has an inherent difficulty in crossing spatial scales and organizational hierarchies. As an alternative, here we present a macro-level model of reproduction in C. elegans that uses fundamental engineering principles, together with a limited set of experimentally derived facts, to provide quantitatively accurate predictions of performance under a range of physiologically relevant conditions. One important finding is that individuals within a population display considerable heterogeneity in their response to heat stress. This could be a reflection of different strategies for coping with the ever-changing environment. Our study further demonstrates that dynamic behaviors of systems may be determined by a small number of key components that lead to the emergence of organismal phenomena.
Citation: McMullen PD, Aprison EZ, Winter PB, Amaral LAN, Morimoto RI, et al. (2012) Macro-level Modeling of the Response of C. elegans Reproduction to Chronic Heat Stress. PLoS Comput Biol 8(1): e1002338. doi:10.1371/journal.pcbi.1002338
Editor: Olaf Sporns, Indiana University, United States of America
Received: August 22, 2011; Accepted: November 17, 2011; Published: January 26, 2012
Copyright: © 2012 McMullen et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was made possible by grant support from NIH (P50 GM081892) to LANA, RIM, IR; the Rice Institute for Biomedical Research to RIM; by the Keck Foundation and the Howard Hughes Medical Institute to LANA. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Much of modern biology is inherently reductionist, seeking to enumerate interactions and components to elucidate the inner workings of cells and organisms. However, phenotypes often cannot be explained simply as the sum of the properties of the micro-components. Emergent phenomena  are not unique to biology; physical , , , chemical , and social , , ,  systems all have to contend with this challenge.
Over the last several decades, thousands of studies have employed genetic and biochemical approaches to reveal the components of biological processes. High-throughput technologies have greatly accelerated discovery, generating detailed parts lists for cellular systems , , . Such abundance of data facilitated development of fine-grained models that provided quantitatively accurate descriptions of signaling , transcriptional regulation , and the heat shock response .
Despite the success of this general approach, it cannot be used in circumstances when detailed understanding of molecules and processes is not available. While this limitation can be overcome by additional experimentation, fine-grained models have an intrinsic difficulty in connecting cellular phenomena to organismal behavior , , , , . An alternative is to use macro-level modeling, which although omitting many specific details, could if properly constructed, describe the overall performance of complex systems , , .
Due to its easily quantifiable output, the reproductive system offers an attractive opportunity to bridge the molecular biology of a process and the emergence of dynamic, organismal-level phenotypes. Reproduction in Caenorhabditis elegans has been extensively studied using genetic , , , , ,  and biochemical , , , ,  approaches. C. elegans hermaphrodites are self-fertile . They first produce a finite cache of sperm , and then irreversibly transition to oocyte production , , , which occurs continuously until reproductive senescence . The overall reproductive output is primarily determined by the availability of sperm , , because their number is set for the lifetime of an individual. Many of the specific molecular components involved in gametogenesis and later reproductive events have been characterized , , , , , , . For example, a signaling mechanism directly couples oocyte maturation and ovulation to the presence of sperm , , .
Although considerable information is available about the components of the reproductive system, we are interested not in specific molecular interactions, but rather in understanding how individual animals reproduce. The distinction between these two questions can be compared to the difference between studying the molecular biology of neurons and human behavior . Our goal here is to construct a parsimonious macro-scale model that is grounded in experimental data. If such a model could provide quantitatively accurate predictions, it would serve to identify a minimal set of biological components and processes necessary to endow the reproductive system with its characteristic dynamics.
A time-tested approach to investigating macro-level processes is to perturb the environment in a controlled way and to measure the system's subsequent response. Temperature has often been used to probe dynamic behavior, as well as components and organization of biological systems , , . This is because organisms are sensitive to environmental conditions and because temperature can be easily and precisely manipulated in the laboratory setting. Here, we analyzed the effects of chronic elevated temperatures on C. elegans reproduction to connect molecular processes to macroscopic phenotypes, particularly those involved in dynamic responses of organisms to a changing environment.
We sought to ensure that our model of C. elegans reproduction was biologically reasonable. Because sufficiently detailed experimental data were not available, we first collected extensive, time-resolved datasets on egg-laying performance under a variety of temperature regimes. Next we formulated a parsimonious model that incorporated several key elements of the reproductive system that were previously described in the literature and trained our model using a subset of the collected experimental data. Finally, we tested the performance of the model under different environmental conditions and in different genetic backgrounds.
C. elegans reproduction is exquisitely sensitive to temperature changes
Compared to the well-understood heat shock response, less is known about how organisms respond to chronic, moderate temperature stress. It is well established that the average number of eggs laid by C. elegans hermaphrodites is dependent on temperature . We asked whether reproduction is more temperature sensitive than other vital processes and how individual worms respond to temperature stress. We examined viability, movement, and reproductive output over a range of temperatures (Table 1, Table S1). We developed an experimental protocol in which nematodes were reared at the commonly used cultivation temperature of 20°C, and then, just prior to the onset of reproduction, individually shifted to various elevated temperatures. This treatment—chronically exposing worms to temperatures between 20°C and 30°C—is qualitatively different from the standard acute heat shock experiments, which involve brief exposure to nearly fatal temperatures (33°C) . Whereas the average number of eggs laid at 28°C was substantially reduced compared to temperatures at which worms are routinely raised (see below), at 30°C reproduction ceased completely (Figure 1A). In contrast, neither viability nor motility was comparably affected (Figure 1B).
Figure 1. Reproduction is sensitive to chronic temperature changes.
The average number of eggs laid by an individual hermaphrodite is substantially lower at 28°C (compared to ~300 at 20°C), and is nearly zero at 30°C (A). In contrast, at 30°C, animals exhibit considerably milder effects on motility and viability (B).doi:10.1371/journal.pcbi.1002338.g001
Table 1. Experiments performed to determine the dynamics of C. elegans reproductive behavior.doi:10.1371/journal.pcbi.1002338.t001
We documented the reproductive performance of 3,418 individual worms, which laid a total of 144,092 embryos (Table 1, Figure S1, Text S1). Importantly, we collected dynamic, time-resolved egg-laying curves, not simply overall brood sizes. The temperatures used in our studies (20–30°C) are likely to be physiologically relevant because C. elegans have been isolated from tropical and equatorial locales ,  where temperatures routinely exceed 30°C. Furthermore, nematodes appear to dwell in compost and rotting vegetable matter , , where temperatures can be even higher than in the ambient environment . Brood size of animals cultivated at 20 and 25°C were normally distributed (Figures 2A, B, S2, S3, Text S1). While the means of the brood size distributions varied with temperature, they had indistinguishable coefficients of variation (p = 0.58±0.01, permutation test). These results suggest that while the mean output of the reproductive system is temperature-dependent, increasing temperature does not lead to an appreciable increase in the individual-to-individual variability (Figure S4).
Figure 2. Chronic temperature stress exposes heterogeneous physiological response of the reproductive system in C. elegans.
The brood sizes for animals reproducing at 20 (A) and 25°C (B) are normally distributed. However, at higher temperatures, 28 (C) and 29°C (D), the distribution of brood sizes reflects a heterogeneous population. At these temperatures, the brood size distributions (solid lines) can no longer be approximated as single normal distributions. Instead, each is better explained as a mixture of two distinct components (dashed lines), the relative weight of which is dependent on temperature. Red boxes in the left panels highlight the data shown in the right panels.doi:10.1371/journal.pcbi.1002338.g002
At 28°C, however, we observed a qualitatively different behavior—there were more individuals laying low numbers of eggs than would be expected from a normally distributed population (Figure 2C). This was accompanied by a coefficient of variation (Figure S4) that was significantly higher at 28°C than at 25°C (p = 2×10−4, permutation test). Furthermore, these data could not be captured by a single normal distribution (p<10−4, Kolmogorov-Smirnov test), but could be well described by a mixture of two distributions (Figure 2C). The relative proportion of animals laying a lower than expected number of eggs increased at higher temperatures (Figure 2D), as evidenced by the increase in the coefficient of variation (Figure S4). These results suggest that whereas across a range of lower temperatures reproductive systems of all worms are robust, at higher temperatures, only a fraction of individuals continue to act in a robust manner, revealing an inherent heterogeneity in physiological response.
Simple macro-level model closely reproduces experimental results
We developed a macro-level model of the C. elegans reproductive system. Our model is both simple (it includes a small set of essential features and parameters) and falsifiable (designed to be experimentally testable). The reproductive system (Figure 3A) can be abstracted as a pipeline for the serial maturation and subsequent fertilization of oocytes. We conceptualized it as a series of interconnected compartments—the gonad (which is encapsulated by the gonadal sheath), spermatheca, and uterus—through which gametes flow (Figure 3B). This process can be likened to a chemical reaction because transitions between compartments can be modeled as the conversion of precursors to products. We made two simple but plausible assumptions (a list of major model assumptions is given in Table 2). First, all gametes in the model are conserved and can be explicitly accounted for . Second, all transitions between states obey mass-action kinetics. The latter is a typical assumption for dynamic systems, used in analysis of chemical reaction kinetics . It states that a process proceeds at a rate that is proportional to the availability of each of its inputs.
Figure 3. Modeling the dynamics of C. elegans reproduction.
The reproductive system of a hermaphrodite consists principally of three compartments: the gonad, spermatheca, and uterus (A). The model tracks gametes through these compartments according to mass-action kinetics and parsimonious biological rules (B).doi:10.1371/journal.pcbi.1002338.g003
Table 2. Major assumptions of the model.doi:10.1371/journal.pcbi.1002338.t002
Although oocyte development and maturation involves a number of discrete steps and processes , , , for simplicity, we subsume them into a single state. This mathematical abstraction simplifies the subsequent calculations and reflects the difference between a fine-grained molecular model and a macro-level approach. We represent the number of oocytes, that are generated de novo, as O. Experimental data suggest that the total number of germ cells in adults  and the rate of oocyte production  are constant. Therefore our model treats the rate at which oocytes are generated as a constant, subject to saturation that prevents O from increasing beyond an upper limit established by gonad size . Together, these assumptions define the rate of oocyte creation (Figure 3B),(1)
where kg is a rate constant describing the generation of O, and ks is a rate constant pertaining to the carrying capacity of the gonad.
Hermaphrodites of the standard laboratory strain (Bristol or N2) of C. elegans produce approximately 300 sperm during development before the germline irreversibly transitions to oogenesis . Because animals produce oocytes continuously until their cache of sperm is depleted, the number of sperm determines the overall fecundity . A dedicated mechanism communicates the presence of sperm to the developing oocytes. Sperm release major sperm protein (MSP) into the proximal gonad , where it induces meiotic maturation of the proximal oocyte , . Concomitantly, MSP promotes sheath cell contraction, leading to ovulation . As the oocyte is pulled into the spermatheca, fertilization takes place . After the spermatheca, the embryo passes to the uterus where it completes the first several cell divisions before being laid . The dynamics of egg-laying are known to be bursty, but the time intervals between these bursts are typically on the order of minutes , much shorter than the time intervals at which we counted eggs. Therefore we need not consider these dynamics in our model.
The reproductive rate, while approximately constant early in adulthood, decreases as the animals age . This decline in reproductive function likely has multiple causes. In the first several days of reproductive maturity it likely reflects the decreasing number of sperm and the coupling of ovulation to sperm number , because mating during this period can produce substantially more progeny , . About 5 days after the onset on reproduction, oocyte quality becomes compromised , , and mating of week-old hermaphrodites does not increase their brood size . At lower temperatures (e.g., 20°C), within 4–5 days of reproductive maturity nearly all of a hermaphrodite's sperm have been used to fertilize eggs . However, it is reasonable to expect that chronic exposure to higher temperatures will result in gamete death. While developing oocytes are likely damaged by chronic temperature stress, they can be continuously generated, therefore their destruction is difficult to decouple from a decrease in their production rate. We thus captured this process by allowing net oocyte production rate in the model to vary with temperature. These assumptions, and their related mass action kinetics, yield expressions for the rate of ovulation and the rate of sperm death ,(2a)
where Sa is the number of active sperm, is a rate constant of ovulation, and is a rate constant of sperm death.
Because O rapidly achieves a steady state , we simplified the model specified in Equations 1 and 2 using a quasi-steady-state approximation . We found that this reformulation results in a model that captures the system dynamics equally well (see next section and Text S1). We explicitly solved the steady-state mass balance equation to obtain (see Text S1). This allowed us to express the dynamics of the system using a smaller subset of parameters. In the interest of parsimony, we used the parameter kmax to summarize the intrinsic maximum rate of oogenesis,(3)
where depends weakly on Sa, and can be treated as a constant (see Text S1).
In our experiments, we observed substantial variability in both the overall fecundity and the dynamics of egg-laying among individuals. We hypothesized that this variability arises from differences in the intrinsic capacity (kmax) for oogenesis and the number of sperm produced by each animal, both of which we surmised are normally distributed (Figures 2A, B, S2, S3, Text S1). The rate of sperm production is approximately constant over time , and high sperm count is associated with delayed onset of oogenesis . To capture this, when simulating our model, the number of sperm of each individual and the timing of the onset of embryo production were determined by the same variable drawn from a normal distribution.
Recalling the heterogeneity of brood sizes at higher temperatures (Figure 2), we reasoned that the fraction (δ) of animals that exhibit a non-robust reproductive output varies with temperature, and treated δ as a free parameter. Although the mean-field behavior of our model can be analytically solved (Text S1), we solved it numerically. We used maximum likelihood estimation  to determine the kinetic parameters for our model. Interestingly, our estimates of kmax were substantially different for the two classes.
We used time-resolved, densely sampled egg-laying curves collected at 20, 25, and 29°C (Table 1, Figure 2) to train our model for both the robust and non-robust classes of animals. Noting the narrow range of relevant temperatures, we hypothesized exponential dependence of the model parameters on temperature. Because δ is only nonzero at 28°C and above, we used curves collected at 20, 28, and 29°C to estimate its value more robustly. The estimated coefficients of these exponential functions (Figure 4A–C) result in model predictions that closely recapitulate the empirical data (Figure 4D).
Figure 4. Fitting the model to experimental data.
Because the reproductive dynamics are strongly temperature dependent, we let the three model parameters vary as exponential functions of temperature (A–C). As expected, all parameters increased with temperature. Red circles represent the estimated parameters values for the three temperatures used to train the model. Constraining model parameters yielded close fits to experimental observations, represented by dots ±1 standard deviation (D). Model predictions (solid lines) ±1 standard deviation (dashed lines) are shown for comparison.doi:10.1371/journal.pcbi.1002338.g004
More complicated models do not offer an improved description of the system
To obtain Equation 3, we surmised that the dynamics of oocyte development are steady-state , and the number of developed oocytes O is constant (also see Text S1). To ensure that this approximation does not lead to an overly simplistic model that fails to capture aspects of reproductive dynamics, we evaluated predictions for two distinct model formulations. The first assumed that O reaches a quasi-steady-state according to Equation 3. This simplified model is fully described in Equation 4. The second was more complicated, explicitly accounting for oocyte generation and development (Equations 1 and 2a) and allowing O to vary. Only subtle quantitative differences existed in the predictions of these two models, justifying the use of the parsimonious version (Figure 5A).
Figure 5. More complicated models do not offer an improved description of the system.
Explicitly accounting for oocyte development (blue) is nearly indistinguishable from the quasi-steady-state approximation (red) (A). Including a discrete state for dead oocytes (B) complicates the model, but leads to a description (Equation 6) that is mathematically equivalent to the parsimonious model (Equation 4).doi:10.1371/journal.pcbi.1002338.g005
To ensure that the parsimonious model (Equation 4) does not omit other details that could improve the description of the system, we constructed an alternative model with an additional component that plausibly exists in the reproductive system: oocyte death. In a model that explicitly included discrete states for dead oocytes (Od) (Figure 5B), the rate of oocyte accumulation becomes,(5)
where is the rate of oocyte death and is the rate constant of oocyte death. Reformulating Equation 5, we obtain,(6)
where . Because this expression is mathematically equivalent to Equation 4a, it is difficult to differentiate between this model that accounts for oocyte death from the more parsimonious model formulated above (Equation 4).
Testing predictions of the model
Our modeling framework provides the basis for predicting the behavior of animals treated under different conditions and having different genetic backgrounds. As a first test, we generated predictions of the dynamics of reproductive output following chronic temperature shifts conducted under the same experimental protocol that was used to train the model, but at three different temperatures. At 23, 28, and 30°C, we observed a close correspondence between predicted values and experimental results (Figure 6). Predictions were obtained using parameters estimated from the training data (Figure 4); the only additional information that was specified was the temperature to which the animals were exposed. Importantly, in addition to the quantitative matches obtained for the population means, we also observed a correspondence between predicted and experimentally measured animal-to-animal variances of brood sizes.
Figure 6. Predicting the dynamics of C. elegans reproduction.
Predicted egg-laying trajectories (sold lines are median predictions; dashed lines are ±1 standard deviation) for animals shifted to 23, 28, and 30°C quantitatively capture the experimental data (dots; ±1 standard deviation).doi:10.1371/journal.pcbi.1002338.g006
As a second test, we probed the reproductive dynamics of two mutants, tra-3(e2333)  and cdc-48.1(tm544) , that produce different numbers of offspring than the wild-type N2 strain (Table S2). In our experimental paradigm, at 20°C these two mutants produced 437±40 and 238±115 progeny, respectively. At least two lines of evidence suggest that availability of sperm is the limiting factor in C. elegans reproduction. First, self-fertile hermaphrodites continue laying unfertilized eggs once their cache of sperm becomes exhausted , . Second, hermaphrodites that are mated to males generate up to four times the number of progeny as their unmated counterparts because male ejaculate provides many more sperm than the number produced by a hermaphrodite , . Relevantly, the cdc-48.1(tm544) mutant animals lay approximately as many eggs as the wild type, but a substantial fraction of these oocytes are not fertilized . We therefore reasoned that the number of progeny of individual animals accurately reflected the number of sperm they produced. Using these inferred sperm counts and the model parameters estimated from the training data (Figure 4), we predicted the dynamics of the reproductive output of the two mutants. At 20 and 25°C, predictions for the cdc-48.1 mutants matched the experimental results, as did predictions for the tra-3 animals at 20°C (Figures 7A, B). At 25°C, however, the tra-3 mutants laid fewer embryos than predicted by our model (Figure 7B).
Figure 7. Predicting behavior of C. elegans reproductive mutants.
The reproductive dynamics of tra-3 and cdc-48.1 mutants at 20°C (dots; ±1 standard deviation) are well described by the model (solid lines are median predictions; dashed lines are ±1 standard deviation) (A). At 25°C, tra-3 animals produce fewer progeny than predicted (B). Embryos are arranged in an orderly fashion in N2 animals at 20 (C) and 25°C (E) and in tra-3 mutants at 20°C (D), but not at 25°C (F). Consequently, tra-3 mutants retain more embryos in the uterus than N2 animals (G; average number per worm is shown; ±1 standard deviation). Bagging phenotype of tra-3 mutants is rescued by an egg-laying constitutive mutation egl-19(ad695) (H).doi:10.1371/journal.pcbi.1002338.g007
We investigated the plausible causes of this discrepancy. At 20°C the embryos of both the wild-type N2 and tra-3 animals were arranged in an orderly fashion within the uterus (Figure 7C, D). At 25°C (Figure 7E) the embryos in wild-type animals were more numerous than at 20°C, but this effect was far more pronounced in the tra-3 mutants, which had retained embryos that were older than the age at which they are typically laid (Figure 7F). The number of embryos retained by individuals correlated with the sperm count, such that retention in the tra-3 animals was substantially higher than in the wild-type (Figure 7G). We interpreted this as an indication that our model over-predicted the number of eggs laid because it did not consider the accumulation of eggs in the uterus and its possible consequences. The total number of eggs laid and retained in the uterus of the tra-3 animals at 25°C was indistinguishable from that in the wild-type N2 animals under the same conditions. In contrast, at 20°C tra-3 mutants produced nearly 50% more offspring (437 vs. 302) reflecting a greater number of sperm. Together, these results suggest that a higher aggregate egg production rate at 25°C results in higher egg retention which causes a mechanical impediment to the passage of eggs and therefore disrupts reproduction.
The accumulation of embryos inside the uterus led to a “bagging” phenotype  and eventual hatching within the parent (Figure 7H, Table S3). Significantly, the bagging phenotype of the tra-3 mutants was completely suppressed by an egl-19(ad695) mutation that causes constitutive egg-laying . This suggests that the mechanical elements of the egg-laying apparatus were compromised by chronic heat stress, serving as a physical impediment to achieving the maximum rate of egg-laying and, therefore, the highest brood size given the number of available sperm.
We developed a macro-level, parsimonious model that, although it incorporates only a few of the known elements of the reproductive system of C. elegans, is sufficient to make quantitatively accurate predictions of the dynamics of reproduction under stress. Using detailed, time-resolved experimental data, we demonstrated that the model predicts reproductive dynamics of animals in a number of environmental and genetic backgrounds. The molecular details underlying reproduction undoubtedly are numerous and complex. Specifically, large numbers of genes are associated  with the following reproduction-related Gene Ontology terms: fertilization (23), oviposition (394), oocyte (60), oogenesis (179), and sperm (52). We have shown that a minimal model of a process can be sufficient for capturing system dynamics. We were able to infer a minimum set of essential elements that are sufficient to describe the temperature-dependent dynamics of reproduction in C. elegans.
The reproductive systems of individual C. elegans worms exhibited a heterogeneous response to temperature stress, manifested as more variable brood sizes. Several possible explanations can account for this phenomenon. Animals at higher temperatures might have an increased probability of a discrete failure event. This could plausibly give rise to two populations of animals—some reproducing at a relatively high rate, similar to (although slower than) that at lower temperatures—and some that have a broken reproductive system. Under this scenario, the combined distribution of brood sizes at a given temperature could be described as a mixture of a normal distribution, corresponding to robustly reproducing animals, and an exponential distribution, reflecting waiting time to a failure event (Figure 8A).
Figure 8. Alternative interpretations of the heterogeneous response to stress by individual nematodes.
At permissive temperatures (≤25°C) brood sizes are well described as normal distributions (as shown in Figure 2). However, at higher temperatures (≥28°C), the brood size distributions diverge from normal, and a mixture of two distributions is required to describe the data. Two different combinations of distributions could account for the observations. In both cases a fraction of the overall population consists of worms reproducing robustly; these are described by a normal distribution (blue). An exponential distribution (red) could indicate that chronic stress causes random reproductive failure among individuals in the population (A). A normal distribution (red) would suggest that subpopulations of individuals deploy qualitatively distinct reproductive strategies (B). Regardless of the explanation, there is a dichotomy of reproductive behaviors among individuals within populations under temperature stress.doi:10.1371/journal.pcbi.1002338.g008
Alternatively, the observed heterogeneity could be indicative of a dichotomy of reproductive strategies (Figure 8B). Phenotypic switching—the responsive or stochastic shift between two discrete modes of behavior—has been shown to be an important part of adaptation to environmental stress in unicellular organisms , , . Our results are consistent with the possibility that animals adopt aggressive or conservative strategies by altering the rates of oocyte development. At higher temperatures, more worms shift from aggressive (fast) to conservative (slow) egg-laying behavior. In our model, the primary difference between these populations is kmax, the initial egg-laying rate before signal from sperm becomes rate limiting. It is conceivable that the observed heterogeneity could represent a bet-hedging approach in which some individuals in a population continue reproducing “expecting” conditions to become favorable soon, while others delay reproduction until conditions improve. Such a strategy may be advantageous for coping with the ever-changing environment .
Our results serve as a demonstration of the utility of macro-level modeling for understanding complex biological systems. We can envision the application of similar models to the understanding of other phenomena that involve mass transfer. Examples would include gas exchange in the respiratory system, filtration in the excretory system, and nutrient extraction in the intestine. More broadly, any system that consists of an orderly transition between defined compartments or states could be amenable to the type of analysis presented here. This would include development and tumorigenesis. Considerable, time-resolved experimental data are essential as are the knowledge of the initial conditions and the understanding of at least some interactions within the system. We believe that macro-level modeling can serve as a useful complement to more fine-grained approaches in the analysis of complex biological systems.
Materials and Methods
Caenorhabditis elegans Bristol wild-type N2, as well as CB4419(tra-3(e2333)) , FX544(cdc-48.1(tm544)) , DA695(egl-19(ad695)) , and YR27(egl-19(ad695)/tra-3(e2333)) mutants, were maintained at 20°C as described in Brenner . CB4419(tra-3(e2333)) is an allele of tra-3 that is not temperature sensitive and does not affect the somatic gonad . This allele causes a delay in the switch from spermatogenesis to oogenesis and a concomitant increase in the number of sperm. FX544(cdc-48.1(tm544)) is a deletion mutant of a gene that regulates tra-1. In this mutant, the switch from spermatogenesis to oogenesis is premature and fewer sperm are produced . DA695(egl-19(ad695)) is a mutation in the α1 subunit of an L-type voltage-activated Ca2+ channel that causes myotonia and constitutive egg laying . Mutant strains were obtained from the Caenorhabditis Genetics Center. To construct the double mutant, YR27(egl-19(ad695)/tra-3(e2333)), CB4419 males were mated to DA695 hermaphrodites. The progeny were allowed to self and double mutant candidates were selected on the basis of empty uterus and large brood size phenotypes. The genotype was confirmed by sequencing.
To standardize the environment for nematode development, we prepared 60 mm NGM agar plates 48 to 62 h prior to experiments using 10 mL of medium per plate and seeded these plates with 100 µL of saturated OP50 culture 24 h before nematodes were transferred onto the plates. We prepared synchronized cultures of L1 larvae using hypochlorite treatment of gravid hermaphrodites . The liberated eggs were left on a shaker for 18±3 h at room temperature (23–24°C) in M9 buffer—sufficiently long for the population to arrest at the L1 molt. The L1 larvae were placed onto the plate in contact with bacteria to synchronize the sensing of food and the termination of L1 diapause. This transfer of L1 larvae corresponds to 0 h in relation to L1 arrest and serves as the benchmark for timing in the rest of the experiments. The developing nematodes were maintained at 20°C and microscopic examination of worms at 44 h post-L1 arrest confirmed that more than 92% of nematodes were late-L4. Since a thin bacterial lawn with a small area increases both the density and visibility of laid eggs, we seeded new NGM plates with 5 µL of 1:1000 dilution of saturated OP50 culture in Lysogeny broth (LB) 24±2 h after L1 arrest. We transferred single nematodes to the new NGM plates 1–2 h before the temperature shift.
The time designated for temperature shift was determined for each strain by enumerating eggs in the proximal gonad and fertilized embryos in the uterus. At 48, 50, 52 and 54 hours post L1 arrest, we examined twenty-five worms from each strain and counted the number of mature oocytes in the anterior and posterior gonad arms as well as the number of fertilized embryos in the uterus. Compared to N2, FX544 and CB4419 animals were delayed about three hours but otherwise appeared normal. The plates were moved into incubators at the experimental temperature shortly after the nematodes reached young adulthood: 48 h for N2, and 51 h post-L1 arrest for FX544 and CB4419 mutants. We measured temperature in each of the incubators with recording thermometers and discarded any time courses in which fluctuations were greater than 1°C.
We counted the total number of embryos on a plate manually using a dissecting microscope. We measured time courses at 2 h intervals for the first 12 h. For longer time courses at lower temperatures (20 and 25°C), we collected additional measurements every 12 h until egg-laying had ceased. To avoid unnecessary and possibly confounding temperature fluctuations for the time points recorded at 2 h intervals, we used new animals for each time point and discarded the plates after the number of eggs had been counted. To avoid the accumulation of offspring for time points recorded at 12 h increments, we removed the nematodes from the incubator, transferred them to new plates and returned them to their incubators within 10±5 minutes of their removal.
Experiments for each temperature were replicated on different days at least four times with at least one experiment in both the Morimoto and Ruvinsky laboratories. Thermometers between laboratories were within 0.1°C. Analysis of the individual trials suggests that small variations in developmental timing at the onset of stress contribute significantly to the variation in the total eggs laid.
Viability and motility experiments
Populations of nematodes were synchronized as described above with the following notable exceptions: (i) the worms were not transferred onto new plates before exposure to stress conditions; (ii) we stressed populations of 20–40 animals instead of using plates with single nematodes; (iii) we seeded the plates used for developing worms with 5 µL of 1:1000 dilution of saturated OP50 culture instead of saturated OP50 culture.
Viability and motility were assayed at 12 h increments by removing a different set of animals from the incubator at each time point, completing the measurements at room temperature, and discarding the worms. We touched animals with platinum wire to assess if they were motile or dead. Animals were scored as motile if they crawled at least one body length after gentle touch. Animals were scored as dead if they were unresponsive to touch and did not exhibit pharyngeal pumping.
These experiments were replicated on different days at least three times in the Ruvinsky Lab for each temperature. An average of 164 and 235 animals were used for each time point at 30 and 31°C, respectively. Time points were counted by multiple lab members to limit operator error.
Egg retention experiments
Synchronized cultures of N2, CB4419, FX544 and DA695 were prepared and plated as for the egg-laying protocol described above. Twenty worms were singled for each temperature tested. At t = 0 (48 hours post L1 arrest for N2 and DA695 and 51 hours post L1 arrest for CB4419 and FX544), the twenty plates were shifted to 20, 25 or 28°C. After twenty-four hours of heat stress, the adult hermaphrodites were dissolved on the plate in 10 µL of alkaline hypochlorite solution and the eggs that had been retained in the worm were counted. Two trials were conducted for each strain.
We used the permutation test , a bootstrapping procedure, to compare distributions of brood sizes (Figure 2) and coefficients of variation between brood sizes at different temperatures (Figure S4). For each comparison, the bootstrapping was repeated 106 times. The estimated probability that the data could be observed, given the null model is, is the fraction of bootstrapped results that is at least as extreme as d.
Inter-lab results are no more different than intra-lab results.
At permissive temperatures, brood size distributions are normal throughout reproductive lifetime.
Brood sizes are normally distributed.
Coefficient of variation of brood sizes as a function of temperature.
Summary of experiments performed to assess the effect of chronic temperature change on motility and viability.
Summary of experiments performed with mutant C. elegans strains.
Summary of egg retention experiments.
Supporting text. The supporting text covers the verification of inter-lab experimental consistency, the evaluation of model assumptions, a description of simplifying assumptions, and a derivation of the gamete dynamics.
Conceived and designed the experiments: LANA RIM IR. Performed the experiments: PDM EZA PBW. Analyzed the data: PDM EZA PBW LANA RIM IR. Wrote the paper: PDM EZA PBW LANA RIM IR.
- 1. Anderson PW (1972) More is different. Science 177: 393–396. doi: 10.1126/science.177.4047.393
- 2. Strogatz SH, Abrams DM, McRobie A, Eckhardt B, Ott E (2005) Theoretical mechanics: Crowd synchrony on the millennium bridge. Nature 438: 43–44. doi: 10.1038/43843a
- 3. Wayne A, Arciszewski M (2009) Emergence in physics. Philosophy Compass 4: 846–858. doi: 10.1111/j.1747-9991.2009.00239.x
- 4. Stowe K (2007) An Introduction to Thermodynamics and Statistical Mechanics. The Edinburgh Building, Cambridge CB2 8RU, UK: Cambridge University Press.
- 5. Luisi P (2002) Emergence in chemistry: Chemistry as the embodiment of emergence. Foundations of Chemistry 4: 183–200.
- 6. Olfati-Saber R, Fax JA, Murray RM (2007) Consensus and cooperation in networked multi-agent systems. P IEEE 95: 215–233. doi: 10.1109/jproc.2006.887293
- 7. Black D (1948) On the rationale of group decision-making. J Polit Econ 56: 23–34. doi: 10.1086/256633
- 8. Salganik MJ, Dodds PS, Watts DJ (2006) Experimental study of inequality and unpredictability in an artificial cultural market. Science 311: 854–856. doi: 10.1126/science.1121066
- 9. Salganik MJ, Watts DJ (2009) Web-based experiments for the study of collective social dynamics in cultural markets. Top Cog Sci 1: 439–468. doi: 10.1111/j.1756-8765.2009.01030.x
- 10. Schena M, Shalon D, Davis RW, Brown PO (1995) Quantitative monitoring of gene-expression patterns with a complementary-DNA microarray. Science 270: 467–470. doi: 10.1126/science.270.5235.467
- 11. Ren B, Robert F, Wyrick JJ, Aparicio O, Jennings EG, et al. (2000) Genome-wide location and function of DNA binding proteins. Science 290: 2306–2309. doi: 10.1126/science.290.5500.2306
- 12. Margulies M, Egholm M, Altman WE, Attiya S, Bader JS, et al. (2005) Genome sequencing in microfabricated high-density picolitre reactors. Nature 437: 376–380. doi: 10.1038/nature03959
- 13. Sachs K, Perez O, Pe'er D, Lauffenburger DA, Nolan GP (2005) Causal protein-signaling networks derived from multiparameter single-cell data. Science 308: 523–529. doi: 10.1126/science.1105809
- 14. Janssens H, Hou S, Jaeger J, Kim AR, Myasnikova E, et al. (2006) Quantitative and predictive model of transcriptional control of the Drosophila melanogaster even skipped gene. Nat Genet 38: 1159–1165. doi: 10.1038/ng1886
- 15. Rieger TR, Morimoto RI, Hatzimanikatis V (2005) Mathematical modeling of the eukaryotic heat-shock response: Dynamics of the hsp70 promoter. Biophys J 88: 1646–1658. doi: 10.1529/biophysj.104.055301
- 16. Lewes G (1877) Problems of life and mind: first series: The foundation of a creed. Trübner & co.
- 17. Morowitz HJ (2002) The Emergence of Everything: How the World Became Complex. Oxford University Press, USA.
- 18. Ideker T, Galitski T, Hood L (2001) A new approach to decoding life: Systems biology. Annu Rev of Genom Hum Genet 2: 343–372.
- 19. Loscalzo J, Kohane I, Barabasi AL (2007) Human disease classification in the postgenomic era: A complex systems approach to human pathobiology. Mol Syst Biol 3: 124. doi: 10.1038/msb4100163
- 20. Aldridge BB, Burke JM, Lauffenburger DA, Sorger PK (2006) Physicochemical modelling of cell signalling pathways. Nat Cell Biol 8: 1195–1203. doi: 10.1038/ncb1497
- 21. Müller M, Katsov K, Schick M (2003) Coarse-grained models and collective phenomena in membranes: Computer simulation of membrane fusion. J Polym Sci Pol Phys 41: 1441–1450. doi: 10.1002/polb.10456
- 22. Savin T, Kurpios NA, Shyer AE, Florescu P, Liang H, et al. (2011) On the growth and form of the gut. Nature 476: 57–62. doi: 10.1038/nature10277
- 23. Geldziler B, Kadandale P, Singson A (2004) Molecular genetic approaches to studying fertilization in model systems. Reproduction 127: 409–416. doi: 10.1530/rep.1.00009
- 24. Hirsh D, Vanderslice R (1976) Temperature-sensitive developmental mutants of Caenorhabditis elegans. Dev Biol 49: 220–235. doi: 10.1016/0012-1606(76)90268-2
- 25. L'Hernault SW, Shakes DC, Ward S (1988) Developmental genetics of chromosome I spermatogenesis-defective mutants in the nematode Caenorhabditis elegans. Genetics 120: 435–452.
- 26. Trent C, Tsuing N, Horvitz HR (1983) Egg-laying defective mutants of the nematode Caenorhabditis elegans. Genetics 104: 619–647.
- 27. Schafer WF (2006) Genetics of egg-laying in worms. Ann Rev Genet 40: 487–509. doi: 10.1146/annurev.genet.40.110405.090527
- 28. Schedl T (1997) Developmental Genetics of the Germ Line. pp. 241–269.
- 29. Aroian RV, Field C, Pruliere G, Kenyon C, Alberts BM (1997) Isolation of actin-associated proteins from Caenorhabditis elegans oocytes and their localization in the early embryo. EMBO J 16: 1541–1549. doi: 10.1093/emboj/16.7.1541
- 30. Klass MR, Hirsh D (1981) Sperm isolation and biochemical analysis of the major sperm protein from Caenorhabditis elegans. Dev Biol 84: 299–312. doi: 10.1016/0012-1606(81)90398-5
- 31. Miller MA, Nguyen VQ, Lee MH, Kosinski M, Schedl T, et al. (2001) A sperm cytoskeletal protein that signals oocyte meiotic maturation and ovulation. Science 291: 2144–2147. doi: 10.1126/science.1057586
- 32. Miller MA, Ruest PJ, Kosinski M, Hanks SK, Greenstein D (2003) An Eph receptor sperm-sensing control mechanism for oocyte meiotic maturation in Caenorhabditis elegans. Genes Dev 17: 187–200. doi: 10.1101/gad.1028303
- 33. Miller MA (2006) Sperm and oocyte isolation methods for biochemical and proteomic analysis. Methods Mol Biol 351: 193–201. doi: 10.1385/1-59745-151-7:193
- 34. Ward S, Carrel J (1979) Fertilization and sperm competition in the nematode Caenorhabditis elegans. Dev Biol 73: 304–321. doi: 10.1016/0012-1606(79)90069-1
- 35. Hirsh D, Oppenheim D, Klass M (1976) Development of the reproductive system of Caenorhabditis elegans. Dev Biol 49: 200–219. doi: 10.1016/0012-1606(76)90267-0
- 36. Barton MK, Schedl TB, Kimble J (1987) Gain-of-function mutations of fem-3, a sex-determination gene in Caenorhabditis elegans. Genetics 115: 107–119.
- 37. Ellis R, Schedl T (2007) Sex determination in the germ line (March 5, 2007), WormBook, ed. The C. elegans Research Community, WormBook, doi/10.1895/wormbook.1.82.2, http://www.wormbook.org.
- 38. Kimble J, Crittenden SL (2007) Controls of germline stem cells, entry into meiosis, and the sperm/oocyte decision in Caenorhabditis elegans. Annu Rev Cell Dev Bi 23: 405–433. doi: 10.1146/annurev.cellbio.23.090506.123326
- 39. Luo S, Murphy CT (2011) Caenorhabditis elegans reproductive aging: Regulation and underlying mechanisms. Genesis 49: 53–65. doi: 10.1002/dvg.20694
- 40. Singson A (2001) Every sperm is sacred: Fertilization in Caenorhabditis elegans. Dev Biol 230: 101–109. doi: 10.1006/dbio.2000.0118
- 41. Cinquin O, Crittenden SL, Morgan DE, Kimble J (2010) Progression from a stem cell-like state to early differentiation in the C. elegans germ line. Proc Natl Acad Sci U S A 107: 2048–2053. doi: 10.1073/pnas.0912704107
- 42. Kim KW, Wilson TL, Kimble J (2010) GLD-2/RNP-8 cytoplasmic poly(A) polymerase is a broad-spectrum regulator of the oogenesis program. Proc Natl Acad Sci U S A 107: 17445–17450. doi: 10.1073/pnas.1012611107
- 43. Johnston WL, Krizus A, Dennis JW (2010) Eggshell chitin and chitin-interacting proteins prevent polyspermy in C. elegans. Curr Biol 20: 1932–1937. doi: 10.1016/j.cub.2010.09.059
- 44. Kuwabara PE (2003) The multifaceted C. elegans major sperm protein: an ephrin signaling antagonist in oocyte maturation. Genes Dev 17: 155–161. doi: 10.1101/gad.1061103
- 45. L'Hernault SW (2009) The genetics and cell biology of spermatogenesis in the nematode C. elegans. Mol Cell Endocrinol 306: 59–65. doi: 10.1016/j.mce.2009.01.008
- 46. Marcello MR, Singson A (2010) Fertilization and the oocyte-to-embryo transition in C. elegans. BMB Rep 43: 389–399. doi: 10.5483/BMBRep.2010.43.6.389
- 47. Yamamoto I, Kosinski ME, Greenstein D (2006) Start me up: cell signaling and the journey from oocyte to embryo in C. elegans. Dev Dyn 235: 571–585. doi: 10.1002/dvdy.20662
- 48. McCarter J, Bartlett B, Dang T, Schedl T (1999) On the control of oocyte meiotic maturation and ovulation in Caenorhabditis elegans. Dev Biol 205: 111–128. doi: 10.1006/dbio.1998.9109
- 49. Long MA, Fee MS (2008) Using temperature to analyse temporal dynamics in the songbird motor pathway. Nature 456: 189–194. doi: 10.1038/nature07448
- 50. Barrière A, Gordon KL, Ruvinsky I (2011) Distinct functional constraints partition sequence conservation in a cis-regulatory element. PLoS Genet 7: e1002095. doi: 10.1371/journal.pgen.1002095
- 51. Prahlad V, Cornelius T, Morimoto RI (2008) Regulation of the cellular heat shock response in Caenorhabditis elegans by thermosensory neurons. Science 320: 811–814. doi: 10.1126/science.1156093
- 52. Morley JF, Morimoto RI (2004) Regulation of longevity in Caenorhabditis elegans by heat shock factor and molecular chaperones. Mol Biol Cell 15: 657–664. doi: 10.1091/mbc.E03-07-0532
- 53. Haber M, Schüngel M, Putz A, Müller S, Hasert B, et al. (2005) Evolutionary history of caenorhabditis elegans inferred from microsatellites: Evidence for spatial and temporal genetic differentiation and the occurrence of outbreeding. Mol Biol Evol 22: 160–173. doi: 10.1093/molbev/msh264
- 54. Dolgin ES, Felix MA, Cutter AD (2008) Hakuna nematoda: genetic and phenotypic diversity in African isolates of Caenorhabditis elegans and C. briggsae. Heredity 100: 304–315. doi: 10.1038/sj.hdy.6801079
- 55. Barrière A, Félix MAA (2005) High local genetic diversity and low outcrossing rate in caenorhabditis elegans natural populations. Curr Biol 15: 1176–1184. doi: 10.1016/j.cub.2005.06.022
- 56. Félix MA, Braendle C (2010) The natural history of Caenorhabditis elegans. Curr Biol 20: R965–R969. doi: 10.1016/j.cub.2010.09.050
- 57. Feder ME, Blair N, Figueras H (1997) Natural thermal stress and heat-shock protein expression in Drosophila larvae and pupae. Funct Ecol 11: 90–100. doi: 10.1046/j.1365-2435.1997.00060.x
- 58. Felder RM, Rousseau RW (1999) Elementary Principles of Chemical Processes. 3rd edition. John Wiley & Sons.
- 59. Dill KA, Bromberg S (2002) Molecular Driving Forces: Statistical Thermodynamics in Chemistry & Biology. 1st edition. Garland Science.
- 60. Corrigan C, Subramanian R, Miller MA (2005) Eph and NMDA receptors control Ca2+/calmodulin-dependent protein kinase II activation during C. elegans oocyte meiotic maturation. Development 132: 5225–5237. doi: 10.1242/dev.02083
- 61. Govindan JA, Nadarajan S, Kim S, Starich TA, Greenstein D (2009) Somatic cAMP signaling regulates MSP-dependent oocyte growth and meiotic maturation in C. elegans. Development 136: 2211–2221. doi: 10.1242/dev.034595
- 62. Crittenden SL, Leonhard KA, Byrd DT, Kimble J (2006) Cellular analyses of the mitotic region in the Caenorhabditis elegans adult germ line. Mol Biol Cell 17: 3051–3061. doi: 10.1091/mbc.E06-03-0170
- 63. Kosinski M, McDonald K, Schwartz J, Yamamoto I, Greenstein D (2005) C. elegans sperm bud vesicles to deliver a meiotic maturation signal to distant oocytes. Development 132: 3357–3369. doi: 10.1242/dev.01916
- 64. Samuel A, Murthy V, Hengartner M (2001) Calcium dynamics during fertilization in C. elegans. BMC Dev Biol 1: 8. doi: 10.1186/1471-213X-1-8
- 65. Zhou GT, Schafer WR, Schafer RW (1998) A three-state biological point process model and its parameter estimation. IEEE Transact Signal Proces 46: 2698–2707. doi: 10.1109/78.720372
- 66. Byerly L, Cassada RC, Russell RL (1976) The life cycle of the nematode Caenorhabditis elegans. I. wild-type growth and reproduction. Dev Biol 51: 23–33. doi: 10.1016/0012-1606(76)90119-6
- 67. Hodgkin J, Barnes TM (1991) More is not better: Brood size and population growth in a self-fertilizing nematode. Proc R Soc London Ser B 246: 19–24. doi: 10.1098/rspb.1991.0119
- 68. Hughes SE, Evason K, Xiong C, Kornfeld K (2007) Genetic and pharmacological factors that influence reproductive aging in nematodes. PLoS Genet 3: e25. doi: 10.1371/journal.pgen.0030025
- 69. Garigan D, Hsu ALL, Fraser AG, Kamath RS, Ahringer J, et al. (2002) Genetic analysis of tissue aging in Caenorhabditis elegans: a role for heat-shock factor and bacterial proliferation. Genetics 161: 1101–1112.
- 70. Luo S, Kleemann GA, Ashraf JM, Shaw WM, Murphy CT (2010) TGF- and insulin signaling regulate reproductive aging via oocyte and germline quality maintenance. Cell 143: 299–312. doi: 10.1016/j.cell.2010.09.013
- 71. Deen WM (1998) Analysis of Transport Phenomena (Topics in Chemical Engineering). Oxford University Press, USA.
- 72. Cutter AD (2004) Sperm-limited fecundity in nematodes: How many sperm are enough? Evolution 58: 651–655. doi: 10.1111/j.0014-3820.2004.tb01687.x
- 73. Bishop CM (2007) Pattern Recognition and Machine Learning (Information Science and Statistics). 1st edition, 2nd printing edition. Springer. 2006. corr.
- 74. Hodgkin JA (1987) Invisible alleles of tra-1 and tra-3. Worm Breeder's Gazette 10:
- 75. Caruso MEE, Jenna S, Bouchecareilh M, Baillie DL, Boismenu D, et al. (2008) GTPase-mediated regulation of the unfolded protein response in Caenorhabditis elegans is dependent on the AAA+ ATPase CDC-48. Mol Cell Biol 28: 4261–4274. doi: 10.1128/MCB.02252-07
- 76. Maupas E (1900) Modes et formes de reproduction des nematodes. Arch Zool Exp Gen 8: 463–624.
- 77. Kimble J, Ward S (1988) Germ line development and fertilization. The Nematode Caenorhabditis elegans. Cold Spring Harbor, USA: Cold Spring Harbor Press. pp. 191–241.
- 78. Chen J, Caswell-Chen EP (2004) Facultative vivipary is a life-history trait in Caenorhabditis elegans. J Nematol 36: 107–113.
- 79. Avery L (1993) The genetics of feeding in Caenorhabditis elegans. Genetics 133: 897–917. doi: 10.1534/genetics.111.128421
- 80. (2011) WormBase web site, http://www.wormbase.org, release WS227, 10 Oct 2011.
- 81. Balaban NQ, Merrin J, Chait R, Kowalik L, Leibler S (2004) Bacterial persistence as a phenotypic switch. Science 305: 1622–1625. doi: 10.1126/science.1099390
- 82. Pearl S, Gabay C, Kishony R, Oppenheim A, Balaban NQ (2008) Nongenetic individuality in the host-phage interaction. PLoS Biol 6: e120. doi: 10.1371/journal.pbio.0060120
- 83. Acar M, Mettetal JT, van Oudenaarden A (2008) Stochastic switching as a survival strategy in fluctuating environments. Nat Genet 40: 471–475. doi: 10.1038/ng.110
- 84. Tuljapurkar S (1990) Delayed reproduction and fitness in variable environments. Proc Natl Acad Sci U S A 87: 1139–1143. doi: 10.1073/pnas.87.3.1139
- 85. Brenner S (1974) The genetics of Caenorhabditis elegans. Genetics 77: 71–94.
- 86. Lee RYN, Lobel L, Hengarten M, Horvitz HR, Avery L (1997) Mutations in the α1 subunit of an L-type voltage-activated Ca2+ channel cause myotonia in Caenorhabditis elegans. EMBO J 16: 6066–6076. doi: 10.1093/emboj/16.20.6066
- 87. Sulston J, Hodgkin J (1988) Methods. The nematode Caenorhabditis elegans. Cold Spring Harbor, New York: Cold Spring Harbor Laboratory. pp. 587–606.
- 88. Efron B, Tibshirani RJ (1994) An Introduction to the Bootstrap. 1st edition. Chapman and Hall/CRC.