Skip to main content
Advertisement
  • Loading metrics

Evolutionary Evidence for Alternative Structure in RNA Sequence Co-variation

  • Justin Ritz ,

    Contributed equally to this work with: Justin Ritz, Joshua S. Martin

    Affiliation Department of Biology, University of North Carolina, Chapel Hill, North Carolina, United States of America

  • Joshua S. Martin ,

    Contributed equally to this work with: Justin Ritz, Joshua S. Martin

    Affiliations Department of Biology, University of North Carolina, Chapel Hill, North Carolina, United States of America, National Evolutionary Synthesis Center, Durham, North Carolina, United States of America

  • Alain Laederach

    alain@unc.edu

    Affiliation Department of Biology, University of North Carolina, Chapel Hill, North Carolina, United States of America

Abstract

Sequence conservation and co-variation of base pairs are hallmarks of structured RNAs. For certain RNAs (e.g. riboswitches), a single sequence must adopt at least two alternative secondary structures to effectively regulate the message. If alternative secondary structures are important to the function of an RNA, we expect to observe evolutionary co-variation supporting multiple conformations. We set out to characterize the evolutionary co-variation supporting alternative conformations in riboswitches to determine the extent to which alternative secondary structures are conserved. We found strong co-variation support for the terminator, P1, and anti-terminator stems in the purine riboswitch by extending alignments to include terminator sequences. When we performed Boltzmann suboptimal sampling on purine riboswitch sequences with terminators we found that these sequences appear to have evolved to favor specific alternative conformations. We extended our analysis of co-variation to classic alignments of group I/II introns, tRNA, and other classes of riboswitches. In a majority of these RNAs, we found evolutionary evidence for alternative conformations that are compatible with the Boltzmann suboptimal ensemble. Our analyses suggest that alternative conformations are selected for and thus likely play functional roles in even the most structured of RNAs.

Author Summary

RNA (Ribonucleic Acid) is a messenger of genetic information, master regulator, and catalyst in the cell. To carry out its function, RNA can fold into complex three-dimensional structures. Certain classes of RNAs, called riboswitches, adopt at least two alternative structures to act as a switch. We set out to detect the evolutionary signal for alternative structures in riboswitches as we hypothesize that these RNA sequences must have evolved to allow both conformations. We find that indeed such signals exist when we compare the sequences of riboswitches from multiple species. When we extend this analysis to other RNA regulators in the cell that are not thought of as switches, we detect equivalent evolutionary support for alternative structures. Viewed through the lens of evolutionary structure conservation RNA sequences appear to have adapted to adopt multiple conformations.

Introduction

RNA is unique in that it is both a messenger of genetic information and it can fold to adopt highly specific functional conformations that carry out catalysis in the cell [1][4]. Large RNAs have a high propensity to misfold, requiring chaperones and in many cases protein co-factors to achieve an active conformation [5][7]. Riboswitches are a class of RNAs that must adopt at least two conformations to function, since it is ligand binding induced conformational change that allows them to regulate transcription and/or translation [8][12]. These molecules present an interesting evolutionary challenge since the sequence space should allow both conformations [13][16]. Furthermore, even small changes in sequence can significantly alter their structure and favor non-functional conformations [11], [17].

Co-variation of RNA bases across species is one of the strongest signals in biological sequences [18][21] and is observed when homologous sequences of RNAs are aligned [22][24]. The near perfect isostericity of the canonical G-C and A-U base-pairs results in their interchangeability in most RNA stems [25], [26]. For an RNA that adopts a single conformation to carry out its function (e.g. a group I intron), we expect that the ensemble of co-varying pairs should point to a single structure. For riboswitches, which must adopt at least two conformations we hypothesize that co-variation should be observed in alignments supporting both conformations.

The purine riboswitch is the simplest system in which we hypothesize it should be possible to observe co-variation supporting alternative conformations [27][29]. The system is schematically represented in Figure 1A and includes two domains (P1, P2, P3, which is the aptamer domain) and the terminator stem. We aim to determine the relative co-variation support for the P1, terminator and anti-terminator stems of the purine riboswitch to characterize the evolutionary signal for RNAs known to function through multiple conformations. Our analysis of this relatively simple conformational switch provides insight into the strength of the evolutionary signal that can be expected supporting multiple conformations. By then applying a similar analysis to other RNA alignments we aim to determine the likelihood of functionally important alternative conformations in structured RNA.

thumbnail
Figure 1. Co-variation analysis of purine riboswitch P1, terminator and antiterminator stems [9], [27], [28], [32].

A) Consensus secondary structure of the aptamer (P1, P2 and P3) and terminator domains. The anti-terminator base-pairs are indicated with red lines, and binding of the purine ligand to the aptamer domain alters the equilibrium between terminator and anti-terminator stems. B) Representative portion of RFAM RF00167 illustrating co-variation of base-pairs in the P1, terminator and antiterminator stems. We computed Mutual Information (MI) and inconsistency scores for each pair of columns in the alignment, considering only canonical Watson-Crick base pairs and G-U wobbles. We observe significant MI and inconsistency values for the antiterminator stem, indicating evolutionary evidence for alternative conformations in RNA.

https://doi.org/10.1371/journal.pcbi.1003152.g001

Results

Co-variation of the anti-terminator stem in the purine riboswitch

We begin our investigation into the evolutionary evidence supporting alternative conformations by considering an RNA that adopts at least two conformations to carry out its function. The purine riboswitch changes conformation in the presence of its' ligand (generally a purine base or derivative) to regulate protein biosynthesis [30]. Figure 1A represents the secondary structure of the “off” conformation for the consensus purine riboswitch as determined by crystallography [31]. The structure includes the characteristic P1, P2 and P3 stems of the purine riboswitch as well as the terminator hairpin, which has not been solved by crystallography [32], [33]. The mechanism of action of this riboswitch is particularly relevant to our study as it involves a significant secondary structure rearrangement. In the “on” state, the P1 stem is not base-paired; instead the anti-terminator is formed (indicated with red lines in Figure 1A). Given that both the “on” and “off” states of the riboswitch are functionally essential, one might expect to see co-variation in the anti-terminator base-pairs across species of purine riboswitches.

Co-variation models (CM) used to identify purine riboswitches in genomic sequences usually include only the aptamer domain. This is the case of Rfam family RF00167, which is the starting point of our analyses for this investigation [34][36]. To determine the level of co-variation support for the P1, terminator and anti-terminator stems in the purine riboswitch we aligned the 246 sequences from RFAM family RF00167 in which we could identify a terminator stem within 100 nucleotides of the aptamer domain [36], [37]. We then computed mutual information (MI) and inconsistency scores for the columns in the alignment corresponding to the three stems. These two scores evaluate the extent of co-variation between two columns in the alignment. A high MI score indicates that a specific base in one column is highly predictive of the base that is in the second column. A low inconsistency score indicates that in most cases the co-variation is between canonical base-pairs (G-C to A-U for example). The MIfold package was used to compute these scores considering only canonical and G-U base-pairs, which serves as the metric for co-variation of pairs of nucleotides in this study [18]. A base-pair with high MI and low inconsistency is therefore well-supported by evolutionary evidence. We find that the MI and inconsistency metrics are inversely correlated, as expected and this suggests that our results are mostly metric agnostic (see Figure S7). These data are often used to confirm and/or improve RNA secondary structure predictions [19], [21], [38]. In Figure 1B, the first AU base-pairs in both the P1 and Terminator Stem (TS) have high MI values, but we also observe equivalent evolutionary evidence (MI 0.97, inconsistency 0.04) for the anti-terminator (AT) pair. This is consistent with the RNA adopting multiple conformations when it acts as a ligand-induced switch. We observe similar trends for the three other P1/AT/TS pairs reported in Figure 1B. Additional MI and inconsistency values for the purine riboswitch are reported in Table S1 and confirm this trend. We therefore observe equivalent evolutionary support in the purine riboswitch alignment for the anti-terminator stem relative to the P1 and terminator stems.

Alternative structures are revealed by Boltzmann suboptimal sampling

A riboswitch changes conformation upon ligand binding, allowing it to regulate transcription and/or translation [27][29]. To determine whether thermodynamic folding models support alternative conformations we performed Boltzmann suboptimal sampling of the Streptococcus pneumoniae purine riboswitch sequence, including the five single point mutations that most significantly affect structure as determined by SNPfold [11], [39]. Principal component analysis of 10,000 Boltzmann sampled suboptimal structures based on binary base-pair vectors reveals three major clusters of structures [11], [39], [40], with cluster probabilities of 20% (red), 56% (blue) and 24% (green). The “off” conformation of the riboswitch (Figure 2A, green cluster, the terminator stem is formed) as well as two alternative “on” conformations where the anti-terminator stem (red and blue clusters) are represented in the ensemble.

thumbnail
Figure 2. Structural analysis of the Boltzmann suboptimal ensemble of the purine riboswitch [40], [83].

A) Principal Component Analysis (PCA) of 10,000 suboptimal conformations of the Streptococcus pneumoniae purine riboswitch sequence reveals three major conformations, indicated in red, green and blue. The green structures predominantly include the canonical “off” structure of the riboswitch with formation of the terminator, P1, P2 and P3 stems. The red and green clusters predominantly include the “on” conformation with the antiterminator stem formed. B) Analysis of the relative abundance of the five possible conformations of the P1, terminator and antiterminator stem. This analysis reveals that the suboptimal ensemble is structurally diverse. C) Analysis of possible P1, terminator and antiterminator abundances for all purine riboswitch sequences organized according to their alignment tree. We observe that different classes of riboswitches partition differently, suggesting evolutionary adaptation of the multiple conformations of the riboswitch.

https://doi.org/10.1371/journal.pcbi.1003152.g002

The high co-variation base-pairs identified in Figure 1 are highlighted in red (anti-terminator) and black (terminator, P1) in Figure 2A, indicating that the Boltzmann ensemble is consistent with the evolutionary analysis presented in Figure 1. Suboptimal sampling reveals that there are two classes of “on” conformations possible (red and blue clusters), which is not necessarily evident from the co-variation data alone. In addition, it is possible to classify each suboptimal structure into five mutually exclusive categories depending on the structural features present: P1 stem, terminator stem, P1 & terminator, Anti-terminator stem, and no P1, terminator or Anti-terminator stems. When we classify each of the 10,000 suboptimally sampled structures represented in Figure 2A, we see that a majority (55.6%) fall into the antiterminator stem category (Figure 2B). We also find that 15.7% of the structures have both P1 and the antiterminator stem formed (Figure 2B, yellow bar). Interestingly, 20.7% of the suboptimal structures adopt conformations where none of the characteristic riboswitch features are present (No P1, terminator or Anti-terminator).

These data suggest that although the principal component visualization used in Figure 2A suggests three major classes of structures, the RNA suboptimal ensemble is even more complex. This is borne out by the fact that only 37.6% of the variance of the structural ensemble is captured in the first two principal components. It is also due to the fact that the PCA space is determined by overall structural similarity and not the restricted analysis of the terminator, P1 and antiterminator stems reported in Figure 2B. In addition, we purposefully explored riboswitch conformational space by including select point mutants that increase structural diversity to generate the principal component space [11], [39].

We performed suboptimal sampling on all the purine riboswitch sequences previously identified from RFAM RF00167 that include a terminator sequence. We analyzed each ensemble identifying the P1 and terminator elements in the suboptimal structure and plotting their relative abundance using the same coloring scheme as in Figure 2B. We report these data projected onto the phylogenetic tree from our riboswitch alignment in Figure 2C. These data reveal a qualitative correlation between structural partitioning and phylogenetic origin of the riboswitch. Certain riboswitch sequences have evolved to adopt predominantly one structure (e.g. the top half of Bacilli riboswitches are predominantly “off” with P1 and terminator stems formed, while the Desulfotomaculum sequence is likely on, with predominantly the antiterminator stem formed). Thus, evolution appears to fine-tune the partitioning of the Boltzmann ensemble to favor specific conformations.

High-MI alternative base-pairs in “structured” RNAs

The data presented in Figures 1 and 2 agree with our understanding of riboswitch function and the need for these RNAs to adopt at least two conformations to carry out their function. It is not surprising to find evolutionary evidence supporting alternative secondary structures in riboswitch alignments. However, catalytic ribozymes, such as the Tetrahymena thermophila group I intron must adopt a single structure to precisely organize the catalytic site and carry out their function [5], [41][47]. We might expect to see less evolutionary evidence for alternative RNA conformations in a “highly structured” family of RNAs like the group I introns [5], [48][50]. To test this hypothesis we performed an analogous MI analysis on the group I intron alignment from the Comparative RNA Web (CRW) database [51].

Base-pairs with MI values above three different thresholds on a circle diagram representing the T. thermophila group I intron are illustrated in Figure 3A. The secondary structure derived from the crystal structure of the intron is represented in dark gray [52], base-pairs in the accepted structure with MI values greater than the threshold are indicated in red. Green base-pairs have MI values above the threshold but are not in the crystal structure [52]. In Figure 3B, the same coloring scheme is used to project high-MI canonical pairs onto a crystal structure informed model of the three-dimensional structure of the intron [53]. Visual inspection of the three-dimensional structure reveals that most of the high-MI pairs that are not secondary structure are long range, spanning a significant section of the 3D structural model [25], [54].

thumbnail
Figure 3. MI analysis of Watson-Crick base-pairing for the group I intron alignment from the Comparative RNA Website (CRW, [19, 51]).

A) Circle diagrams of the L-21 T. thermophila group I intron structure, the secondary structure is derived from the crystal structure (PDB ID 1X8W) and is indicated in gray [52]. Base-pairs having MI support above the specified thresholds (MI = 0.41, 0.60 and 0.78) are colored red and those for which there is MI support above the threshold but that are not in the crystal structure are shown in green. B) Full length three-dimensional structural model of the T. thermophila group I intron derived from the crystal structure (helices missing in the crystal were modeled using the Nucleic Acid Simulation Tool (NAST) previously [53]. Base-pairs are projected onto the model using the same coloring scheme as in A). C) Sensitivity and PPV as a function of MI for the group I intron alignment. In this case sensitivity is computed as the number of “red” pairs divided by the total number in the accepted structure (gray pairs). PPV is computed as the number of True Positives (TP, in this case red pairs) divided by the sum of the TP and False Positives (FP, green pairs). We see that the sensitivity declines steadily with increasing, and that the data are maximally predictive at an MI value of 0.78, where the sum of PPV and sensitivity are maximal. Nonetheless, even in this case a significant number of co-varying canonical base-pairs (green) persist. D) Mean crystallographic distance in Å of non-accepted (green) base-pairs at the three MI thresholds. We see that at all three thresholds the means are above those of canonical base-pairs (shown as a red line at 18 Å), indicating that the co-variation is not likely the result of stabilizing an RNA tertiary contact.

https://doi.org/10.1371/journal.pcbi.1003152.g003

The green pairs illustrated in Figures 3A and 3B are “false-positives” in terms of the prediction of the crystal structure pairs. Extending this logic, red pairs are “true-positives,” and gray pairs are “false-negatives.” The rates of true, false, positives and negative vary with MI making it possible to compute sensitivity and Positive Predictive Value (PPV) as a function of the threshold. We computed PPV and sensitivity for these data and report the resulting curves in Figure 3C. The sum of PPV and sensitivity (green curve, Figure 3C) reveals the reason behind our choice of three MI values as illustrative thresholds, with an MI value of 0.41 representing the minima in PPV and Specificity, and the value of 0.78 the maximum.

The data plotted in Figure 3A clearly show strong MI evidence is found in the group I intron alignment for non-crystal base-pairs at all MI thresholds (green lines). It is important to point out that above the highest MI threshold (0.78) the sensitivity (gray line, Figure 3B) is 33%, i.e. a majority of crystal base-pairs are not supported by MI. The significant number of gray base-pairs in Figures 3A and 3B at the 0.78 threshold demonstrate that some of the stems are not supported by even a single co-varying base-pair. In their seminal determination of the T. thermophila intron structure, Michel and Westhof did not take into account the non-accepted (green) base-pairs for their structural model [38]. These are incompatible with a single structure model and have previously been considered false-positives for structure determination. In general, the paradigm for RNA structure prediction based on co-variation analysis has been to identify the structure that is compatible with the maximum number of co-varying pairs based on the idea that a specific RNA sequence folds to a single conformation [18], [19], [21].

Another explanation for the non-accepted base-pair co-variation observed in the group I intron alignment is non-canonical base-pairing and/or tertiary (3D) interactions [25], [54], [55]. We expect that if the green pairs in Figure 3A are due to short-range non-canonical 3D interactions, these nucleotides should be close in space in the crystal structure of the group I intron [52]. When these are projected onto the three-dimensional structure of the intron as in Figure 3B, these pairs are not close in three-dimensional space. The mean pair distances for all the pairs above the MI threshold that are not in the accepted structure is plotted in Figure 3D. As a reference the mean distance for accepted base-pairs in the structure (18 Å) is indicated as a red line (gray indicates ±1 standard deviation), while the mean pairwise distance for all pairs (48 Å) is indicated as a green line. We can see that at all MI thresholds, the green pairs are longer range than the expected 18 Å average of a canonical base-pair. It is therefore not likely that this evolutionary signal arises due to long-range tertiary contacts in the RNA.

Ubiquitous long-range high-MI base-pairs in RNA alignments

We repeated the analysis performed on group I introns alignments for six other RNA families and summarize our findings in Table 1, Figures S1, S2, S3, S4, S5, S6 include analogous PPV an sensitivity plots for these RNAs. High-MI, low inconsistency pairs are found in all the RNAs we studied that are incompatible with the crystal structure in approximately the same proportion as what we observed with the purine riboswitch and group I intron alignments. More importantly, it is not possible to discern between RNAs that are generally thought to adopt a single conformation (e.g. tRNA) and multiple conformations (e.g. riboswitches). Effectively, when viewed through the lens of co-variation, all RNAs are the same in terms of their propensity to evolve alternative conformations.

thumbnail
Table 1. Summary statistics for structural analysis of high-MI base-pairs.

https://doi.org/10.1371/journal.pcbi.1003152.t001

Column shuffling yields similar fractions of putative alternative high-MI pairs

We performed column shuffling on the alignments using the RNAz “rnazRandomizeAln” algorithm to determine the expected number of alternative high-MI pairs [56], [57]. The RNAz algorithm is designed to maintain local conservation patterns by only shuffling columns in the alignment with similar degrees of conservation [24], [57]. One limitation of this approach is that no crystal structure exists as a standard for identifying long-range high-MI base-pairs. Furthermore, RNAAlifold predictions based on the shuffled alignment result in sparsely paired RNAs [18], [58]. We therefore generated a reference structure by considering all base-pairs above a threshold MI so as to have an equivalent number of pairs in the reference as in the crystal. Using this reference we computed expected PPV and sensitivity values for each shuffled alignment and report these in Table 1. Our data indicate similar PPV and sensitivity values to those computed using non-shuffled alignments in the previous section, albeit with on average slightly higher sensitivity for lower MI thresholds. These results suggest that the evolutionary process does not necessarily select for or against multiple conformations but instead tolerates these from those that are expected by chance.

Discussion

From a chemical perspective, RNA is one of the simplest biopolymers in the cell being composed of purine and pyrimidine bases linked by a phosphodiester backbone [59], [60]. It is remarkable that despite this simple chemistry, RNA can fold into complex three-dimensional structures that are capable of catalysis [61][63]. However, the simplicity of the RNA nucleotide “alphabet” is at the heart of the structural diversity of the suboptimal ensemble of structures [40], [43], [64]. Indeed, the limited base-pairing partners for any of the four bases makes it much more likely to find multiple complementary regions in a given RNA sequence [65].

To illustrate this concept, we roughly estimate that an RNA sequence longer than 314 nucleotides can adopt more conformations than there are atoms in the Universe (see methods). A consequence of this is the remarkable result observed when a program like Sfold (which performs Boltzmann sampling) is run twice in a row. The number of identical structures in the two suboptimal samplings of 1000 structures for the same RNA is usually between 2 to 3 for RNAs of moderate lengths [40] and can often be zero for long RNAs [43], [65]. The probability of the minimum free energy structure in the Boltzman ensemble is in fact negligible for most large RNAs [40], [66]. Our findings of high MI base-pairs inconsistent with a single secondary structure, but always found in the suboptimal ensemble, suggest that these alternative structures are tolerated by evolution. Given the difficulty of evolving an RNA to adopt a single conformation, it is likely that regulatory systems involving RNA have adapted to these alternative conformations and in some cases even selected for them. Adopting a single conformation is not necessarily a pre-requisite for biological function as long as a significant fraction of the RNAs do adopt the active conformation at any given time.

The functional role of alternative conformations in riboswitches is well established [9], [28]. The data we present in Figure 1 is consistent with at least two structures. Interestingly, Boltzmann sampling of the suboptimal ensemble of the purine riboswitch (Figure 2A) reveals three major conformations (blue, green and red). However, even this classification is somewhat of an oversimplification given that the first two principal components only capture a little more than a third of the structural complexity of the suboptimal ensemble. As such, evolving an RNA to adopt a single conformation represents a daunting task, even for an evolutionary process spanning billions of generations. Our data suggest that RNAs are evolved to adopt multiple conformations, even catalytic ribozymes.

The data presented in Figure 2C is particularly intriguing from an evolutionary perspective. Indeed, we find that highly related riboswitches seem to preserve ensemble partitioning. This is not a priori surprising, since ensemble partitioning is likely important to function in the cell. We and others have recently shown, however, that there are specific mutations in all RNAs that are highly disruptive to structure (in many cases these are disease-associated) and that these single point mutations affect ensemble partitioning [39], [67], [68]. The high degree of similarity in the different clades of riboswitches in terms of their ensemble partitioning (Figure 2C) suggests that evolution avoids these disruptive mutations. This is consistent with the importance of not only preserving the ability to adopt multiple conformations, but also avoiding deleterious mutations that disrupt it.

An important consideration in interpreting our data is the role of RNA co-transcription and kinetic traps in folding to an active conformation [69]. The binding of exogenous molecules (including RNA chaperones) can significantly impact folding outcome [7], [70]. Furthermore, post-transcriptional modifications of RNA will necessarily change the folding landscape [71], [72]. The sequence ultimately selected by the evolutionary process is therefore under many different forms of selective pressure. Our analysis suggests that alternative conformations are neither selected for or against, but these may just be a consequence of selecting for a sequence that has phenotypically advantageous co-transcriptional folding pathways. Our analysis is also based on a comparison of homologous sequences in a family of RNAs with the assumption that they all have similar functional roles. Some of the alternative conformations consistent with high-MI base-pairs may also be a result of conserved RNA scaffolds adopting alternative function.

The ability to adopt specific alternative conformations may confer significant evolutionary advantages to RNAs. Near isoenergetic conformations are ideal for ligand induced switching, since binding of a specific ligand can easily shift the ensemble partitioning. Catalytic ribozymes, on the other hand must adopt a single and specific conformation to carry out catalysis. However, a majority of ribozymes readily misfold and this suggests these molecules may also act as switches in the cell [6], [49], [73]. Indeed, RNA chaperones help resolve these misfolds in an ATP dependent manner, suggesting a possible bi-molecular regulatory switch [70]. The ability of RNA to adopt multiple alternative conformations may in fact confer a significant evolutionary advantage in terms of adaptability and ability to control regulatory networks. As such, it is not surprising to find RNA playing such a key role in the central dogma of biology.

Methods

Purine riboswitch analysis

The purine riboswitch alignment was obtained from the RFAM [34][37] database (http://rfam.sanger.ac.uk/family/RF00167). The alignment in only included nucleotide positions corresponding to the P1, P2 and P3 stems. Each sequence was therefore extended by 100 nucleotides in the 3′ direction in order to allow for the ability to search for terminator stems. The RNIE software package was used to scan each of the sequences for Rho-independent terminators [74]. Sequences without a predicted terminator were removed from the analysis. The 3′ alignment of the P1 stem was then folded with the 5′ region of the predicted terminators in RNAfold to search for potential anti-terminator pairs [58], [75]. Sequences without any predicted pairs were further removed from the analysis. This resulted in a final set of 246 sequences that were used for the co-variation analysis presented in Figure 1. All alignments used for the analysis in this paper are provided in the supplement in Stockholm file format [76], [77].

A simple sequence alignment strategy was not sufficient to correctly align the terminator stems in the purine riboswitch alignment. Alignments were thus adjusted to reflect the predicted terminator stems identified using by RNAfold minimum free energy predictions of each individual sequence [58]. There are 8 possible pairing positions in the P1 stem. The nucleotides within the 5′ predicted terminator were aligned according so as to correspond with the predicted base-pairs on the 3′ end of the P1 stem. The corresponding 3′ terminator nucleotides were then retrieved and aligned according to the original predicted terminator pairs. This results in the consensus terminator stem formed by 4 base-pairs shown in Figure 1.

Additional alignments

Additional alignments used in this manuscript were retrieved either from the comparative RNA website hosted by the Gutell Lab at the University of Texas at Austin or the RFAM database [51]. The alignments were refined to the most mutationally diverse and gap limited sequences according to the reference sequence and structure. The final analysis included 1332 16S, 2204 23S, 246 purine riboswitch, 289 group I intron, 1642 Glycine (RF00504) and 601 GMP (RF01051) riboswitch sequences.

Mutual information and consistency analysis

Mutual Information scores were calculated using the MIfold MATLAB package [18], [78]. The ‘M’ algorithm specified in the package was used to calculate the mutual information scores. This formula computes the score as the information content describing the degree to which the two positions in the alignment can or cannot form a base pair. Canonical and wobble base pairs are specified as the only pairs allowed in the algorithm. The inconsistency parameter specified is the percentage of non-allowable pairs for the indicated positions.

Respective ROC curves were generated by incrementally thresholding the mutual information scores for pairs in the accepted structure. True positives were established as base pairs in the accepted structure with an MI value above the threshold. False positives were base pairs not in the accepted structure that had an MI value above the threshold. False negatives were set as base pairs in the accepted structure with an MI value below the threshold. True negatives were base pairs not in the accepted structure that had an MI value below the threshold. The TPR, FPR and PPV were calculated as:(1)(2)(3)

The RNAfold TPR and PPV values were generated by sampling pairs at varying MI cutoffs. All pairs with an MI value above the cutoff were sampled and a constraint file was created based on the pairs. The constraint file was used in a secondary structure prediction generated by RNAfold. For any one mutual information score, 100 constraints/predictions were made. The respective accepted structures were also used as constraints. Random pairs in the accepted structure were removed and the remaining pairs were used as a constraint for the RNAfold prediction. The predicted structures were then compared to the accepted structure.

Figures and diagrams

Structure diagrams were made using both VARNA and the Circle Compare algorithm found in the RNAstructure software package [79][81]. Sequence identity displays are a subset of the full set of sequences used for the analysis and were made using Jalview. Principle component analysis of the suboptimal ensemble was carried out as previously described [39]. All calculations and graphs were done using R version 2.1.12 and Python 2.7.2.

Size of the suboptimal ensemble estimation

We assumed that the number of possible RNA secondary structures can be estimated as increasing with 1.8N (where N is the sequence length) and that there are approximately 1080 observable atoms in the universe [66], [82]. Thus, solving for N we estimate that an RNA molecule longer than 314 nucleotides (e.g. the T. thermophila group I intron) is able to adopt more conformations than there are atoms in the universe.

Supporting Information

Dataset S1.

Alignments in Stockholm (.sto) format for all RNAs analyzed in the manuscript compressed as a .zip archive.

https://doi.org/10.1371/journal.pcbi.1003152.s001

(ZIP)

Figure S1.

MI analysis of Watson-Crick base-pairing for the Purine Riboswitch alignment from RFAM, RF00167 (A) Circle diagram of the Adenine Riboswitch structure. The crystal structure is based on PDB ID 1Y26, base-pairs having MI support in the crystal structure above the specified threshold are colored red, while those in grey are below the threshold. Base-pairs for which there is MI support above the threshold but that are not in the accepted structure are shown in green. B) Sensitivity and PPV as a function of MI for the Purine Riboswitch alignment. In this case Sensitivity is computed as the number of “red” pairs divided by the total number in the accepted structure (gray pairs). PPV is computed as the number of True Positives (TP, in this case red pairs) divided by the sum of the TP and False Positives (FP, green pairs). C) Mean crystallographic distance in Å of non-accepted (green) base-pairs at the three MI thresholds. We see that at all three thresholds the means are above the mean of canonical base-pairs (shown as a red line at 13.6 Å), indicating that the co-variation is not likely the result of stabilizing an RNA tertiary contact.

https://doi.org/10.1371/journal.pcbi.1003152.s002

(TIFF)

Figure S2.

MI analysis of Watson-Crick base-pairing for the phenylalanine tRNA alignment from the Comparative RNA Website (A) Circle diagram of the phenylalanine tRNA structure. The crystal structure is based on PDB ID 1EHZ, base-pairs having MI support in the crystal structure above the specified threshold are colored red, while those in grey are below the threshold. Base-pairs for which there is MI support above the threshold but that are not in the accepted structure are shown in green. B) Sensitivity and PPV as a function of MI for the phenylalanine tRNA alignment. In this case Sensitivity is computed as the number of “red” pairs divided by the total number in the accepted structure (gray pairs). PPV is computed as the number of True Positives (TP, in this case red pairs) divided by the sum of the TP and False Positives (FP, green pairs). C) Mean crystallographic distance in Å of non-accepted (green) base-pairs at the three MI thresholds. We see that at all three thresholds the means are above the mean of canonical base-pairs (shown as a red line at 13.5 Å), indicating that the co-variation is not likely the result of stabilizing an RNA tertiary contact.

https://doi.org/10.1371/journal.pcbi.1003152.s003

(TIFF)

Figure S3.

MI analysis of Watson-Crick base-pairing for the 16s ribosomal alignment from the Comparative RNA Website (A) Circle diagram of the 16s ribosomal structure. The crystal structure is based on PDB ID 1FJG, base-pairs having MI support in the crystal structure above the specified threshold are colored red, while those in grey are below the threshold. Base-pairs for which there is MI support above the threshold but that are not in the accepted structure are shown in green. B) Sensitivity and PPV as a function of MI for the 16s ribosomal alignment. In this case Sensitivity is computed as the number of “red” pairs divided by the total number in the accepted structure (gray pairs). PPV is computed as the number of True Positives (TP, in this case red pairs) divided by the sum of the TP and False Positives (FP, green pairs). C) Mean crystallographic distance in Å of non-accepted (green) base-pairs at the three MI thresholds. We see that at all three thresholds the means are above the mean of canonical base-pairs (shown as a red line at 13.6 Å), indicating that the co-variation is not likely the result of stabilizing an RNA tertiary contact.

https://doi.org/10.1371/journal.pcbi.1003152.s004

(TIFF)

Figure S4.

MI analysis of Watson-Crick base-pairing for the Group II Intron alignment from RFAM, RF02001 (A) Circle diagram of the Group II Intron structure. The crystal structure is based on PDB ID 3G78, base-pairs having MI support in the crystal structure above the specified threshold are colored red, while those in grey are below the threshold. Base-pairs for which there is MI support above the threshold but that are not in the accepted structure are shown in green. B) Sensitivity and PPV as a function of MI for the group II intron alignment. In this case Sensitivity is computed as the number of “red” pairs divided by the total number in the accepted structure (gray pairs). PPV is computed as the number of True Positives (TP, in this case red pairs) divided by the sum of the TP and False Positives (FP, green pairs). C) Mean crystallographic distance in Å of non-accepted (green) base-pairs at the three MI thresholds. We see that at all three thresholds the means are above the mean of canonical base-pairs (shown as a red line at 13.5 Å), indicating that the co-variation is not likely the result of stabilizing an RNA tertiary contact.

https://doi.org/10.1371/journal.pcbi.1003152.s005

(TIFF)

Figure S5.

MI analysis of Watson-Crick base-pairing for the Glycine Riboswitch alignment from RFAM, RF00504 (A) Circle diagram of the Glycine Riboswitch structure. The crystal structure is based on PDB ID 3OX0, base-pairs having MI support in the crystal structure above the specified threshold are colored red, while those in grey are below the threshold. Base-pairs for which there is MI support above the threshold but that are not in the accepted structure are shown in green. B) Sensitivity and PPV as a function of MI for the glycine riboswitch alignment. In this case Sensitivity is computed as the number of “red” pairs divided by the total number in the accepted structure (gray pairs). PPV is computed as the number of True Positives (TP, in this case red pairs) divided by the sum of the TP and False Positives (FP, green pairs). C) Mean crystallographic distance in Å of non-accepted (green) base-pairs at the three MI thresholds. We see that at all three thresholds the means are above the mean of canonical base-pairs (shown as a red line at 13.6 Å), indicating that the co-variation is not likely the result of stabilizing an RNA tertiary contact.

https://doi.org/10.1371/journal.pcbi.1003152.s006

(TIFF)

Figure S6.

MI analysis of Watson-Crick base-pairing for the Cyclid-diGMP Riboswitch alignment from RFAM, RF01051 (A) Circle diagram of the Cyclid-diGMP Riboswitch structure. The crystal structure is based on PDB ID 3IRW, base-pairs having MI support in the crystal structure above the specified threshold are colored red, while those in grey are below the threshold. Base-pairs for which there is MI support above the threshold but that are not in the accepted structure are shown in green. B) Sensitivity and PPV as a function of MI for the Cyclid-diGMP Riboswitch alignment. In this case Sensitivity is computed as the number of “red” pairs divided by the total number in the accepted structure (gray pairs). PPV is computed as the number of True Positives (TP, in this case red pairs) divided by the sum of the TP and False Positives (FP, green pairs). C) Mean crystallographic distance in Å of non-accepted (green) base-pairs at the three MI thresholds. We see that at all three thresholds the means are above the mean of canonical base-pairs (shown as a red line at 13 Å), indicating that the co-variation is not likely the result of stabilizing an RNA tertiary contact.

https://doi.org/10.1371/journal.pcbi.1003152.s007

(TIFF)

Figure S7.

Scatter plot of MI and Inconsistency values for all pairs in the Group I intron alignment. We only considered pairs with MI values >0.05 for this analysis. We find that the MI and Inconsistency values are negatively correlated such that our analyses are generally co-variation metric agnostic. i.e. we still find multiple low inconsistency base-pairs that are not compatible with a single RNA structure.

https://doi.org/10.1371/journal.pcbi.1003152.s008

(TIFF)

Table S1.

MI and inconsistency scores for all pairs (in excel spreadsheet format) for Riboswitch illustrated in Figure 1.

https://doi.org/10.1371/journal.pcbi.1003152.s009

(XLS)

Acknowledgments

We thank Kevin Weeks and Christine Hajdin for stimulating discussions leading to the development of this manuscript.

Author Contributions

Conceived and designed the experiments: JR JSM AL. Performed the experiments: JR JSM. Analyzed the data: JR JSM. Contributed reagents/materials/analysis tools: JR JSM. Wrote the paper: AL.

References

  1. 1. Guo F, Gooding AR, Cech TR (2006) Comparison of crystal structure interactions and thermodynamics for stabilizing mutations in the Tetrahymena ribozyme. Rna 12: 387–395.
  2. 2. Knight RD, Landweber LF (2000) Guilt by association: the arginine case revisited. RNA 6: 499–510.
  3. 3. Laederach A (2007) Informatics challenges in structured RNA. Brief Bioinform 8: 294–303.
  4. 4. Yarus M, Caporaso JG, Knight R (2005) Origins of the genetic code: the escaped triplet theory. Annu Rev Biochem 74: 179–198.
  5. 5. Russell R, Das R, Suh H, Travers KJ, Laederach A, et al. (2006) The paradoxical behavior of a highly structured misfolded intermediate in RNA folding. J Mol Biol 363: 531–544.
  6. 6. Russell R, Herschlag D (2001) Probing the folding landscape of the Tetrahymena ribozyme: commitment to form the native conformation is late in the folding pathway. J Mol Biol 308: 839–851.
  7. 7. Russell R, Tijerina P, Chadee AB, Bhaskaran H (2007) Deletion of the P5abc peripheral element accelerates early and late folding steps of the Tetrahymena group I ribozyme. Biochemistry 46: 4951–4961.
  8. 8. Lemay JF, Penedo JC, Mulhbacher J, Lafontaine DA (2009) Molecular basis of RNA-mediated gene regulation on the adenine riboswitch by single-molecule approaches. Methods Mol Biol 540: 65–76.
  9. 9. Lemay JF, Penedo JC, Tremblay R, Lilley DM, Lafontaine DA (2006) Folding of the adenine riboswitch. Chem Biol 13: 857–868.
  10. 10. Lipfert J, Das R, Chu VB, Kudaravalli M, Boyd N, et al. (2007) Structural transitions and thermodynamics of a glycine-dependent riboswitch from Vibrio cholerae. J Mol Biol 365: 1393–1406.
  11. 11. Martin JS, Halvorsen M, Davis-Neulander L, Ritz J, Gopinath C, et al. (2012) Structural effects of linkage disequilibrium on the transcriptome. Rna 18: 77–87.
  12. 12. Whitford PC, Schug A, Saunders J, Hennelly SP, Onuchic JN, et al. (2009) Nonlocal helix formation is key to understanding S-adenosylmethionine-1 riboswitch function. Biophys J 96: L7–9.
  13. 13. Gilbert SD, Rambo RP, Van Tyne D, Batey RT (2008) Structure of the SAM-II riboswitch bound to S-adenosylmethionine. Nat Struct Mol Biol 15: 177–182.
  14. 14. Grundy FJ, Henkin TM (2006) From ribosome to riboswitch: control of gene expression in bacteria by RNA structural rearrangements. Crit Rev Biochem Mol Biol 41: 329–338.
  15. 15. Lemay JF, Desnoyers G, Blouin S, Heppell B, Bastet L, et al. (2011) Comparative study between transcriptionally- and translationally-acting adenine riboswitches reveals key differences in riboswitch regulatory mechanisms. PLoS Genet 7: e1001278.
  16. 16. Tremblay R, Lemay JF, Blouin S, Mulhbacher J, Bonneau E, et al. (2011) Constitutive regulatory activity of an evolutionarily excluded riboswitch variant. J Biol Chem 286: 27406–27415.
  17. 17. Ritz J, Martin JS, Laederach A (2012) Evaluating our ability to predict the structural disruption of RNA by SNPs. BMC Genomics 13(Suppl 4): S6.
  18. 18. Freyhult E, Moulton V, Gardner P (2005) Predicting RNA structure using mutual information. Appl Bioinformatics 4: 53–59.
  19. 19. Gutell RR, Lee JC, Cannone JJ (2002) The accuracy of ribosomal RNA comparative structure models. Curr Opin Struct Biol 12: 301–310.
  20. 20. Mertz JA, Chadee AB, Byun H, Russell R, Dudley JP (2009) Mapping of the functional boundaries and secondary structure of the mouse mammary tumor virus Rem-responsive element. J Biol Chem 284: 25642–25652.
  21. 21. Wang Q, Barr I, Guo F, Lee C (2008) Evidence of a novel RNA secondary structure in the coding region of HIV-1 pol gene. Rna 14: 2478–2488.
  22. 22. Nawrocki EP, Kolbe DL, Eddy SR (2009) Infernal 1.0: inference of RNA alignments. Bioinformatics 25: 1335–1337.
  23. 23. Widmann J, Stombaugh J, McDonald D, Chocholousova J, Gardner P, et al. (2012) RNASTAR: an RNA STructural Alignment Repository that provides insight into the evolution of natural and artificial RNAs. Rna 18: 1319–1327.
  24. 24. Will S, Joshi T, Hofacker IL, Stadler PF, Backofen R (2012) LocARNA-P: accurate boundary prediction and improved detection of structural RNAs. RNA 18: 900–914.
  25. 25. Leontis NB, Stombaugh J, Westhof E (2002) The non-Watson-Crick base pairs and their associated isostericity matrices. Nucleic Acids Res 30: 3497–3531.
  26. 26. Leontis NB, Stombaugh J, Westhof E (2002) Motif prediction in ribosomal RNAs Lessons and prospects for automated motif prediction in homologous RNA molecules. Biochimie 84: 961–973.
  27. 27. Delfosse V, Bouchard P, Bonneau E, Dagenais P, Lemay JF, et al. (2010) Riboswitch structure: an internal residue mimicking the purine ligand. Nucleic Acids Res 38: 2057–2068.
  28. 28. Montange RK, Batey RT (2008) Riboswitches: emerging themes in RNA structure and function. Annu Rev Biophys 37: 117–133.
  29. 29. Stoddard CD, Gilbert SD, Batey RT (2008) Ligand-dependent folding of the three-way junction in the purine riboswitch. Rna 14: 675–684.
  30. 30. Mandal M, Boese B, Barrick JE, Winkler WC, Breaker RR (2003) Riboswitches control fundamental biochemical pathways in Bacillus subtilis and other bacteria. Cell 113: 577–586.
  31. 31. Serganov A, Yuan YR, Pikovskaya O, Polonskaia A, Malinina L, et al. (2004) Structural basis for discriminative regulation of gene expression by adenine- and guanine-sensing mRNAs. Chem Biol 11: 1729–1741.
  32. 32. Gilbert SD, Montange RK, Stoddard CD, Batey RT (2006) Structural studies of the purine and SAM binding riboswitches. Cold Spring Harb Symp Quant Biol 71: 259–268.
  33. 33. Batey RT, Gilbert SD, Montange RK (2004) Structure of a natural guanine-responsive riboswitch complexed with the metabolite hypoxanthine. Nature 432: 411–415.
  34. 34. Gardner PP, Daub J, Tate J, Moore BL, Osuch IH, et al. (2011) Rfam: Wikipedia, clans and the “decimal” release. Nucleic Acids Res 39: D141–145.
  35. 35. Gardner PP, Daub J, Tate JG, Nawrocki EP, Kolbe DL, et al. (2009) Rfam: updates to the RNA families database. Nucleic Acids Res 37: D136–140.
  36. 36. Griffiths-Jones S, Bateman A, Marshall M, Khanna A, Eddy SR (2003) Rfam: an RNA family database. Nucleic Acids Res 31: 439–441.
  37. 37. Griffiths-Jones S, Moxon S, Marshall M, Khanna A, Eddy SR, et al. (2005) Rfam: annotating non-coding RNAs in complete genomes. Nucleic Acids Res 33: D121–124.
  38. 38. Michel F, Westhof E (1990) Modelling of the three-dimensional architecture of group I catalytic introns based on comparative sequence analysis. J Mol Biol 216: 585–610.
  39. 39. Halvorsen M, Martin JS, Broadaway S, Laederach A (2010) Disease-associated mutations that alter the RNA structural ensemble. PLoS Genet 6: e1001074.
  40. 40. Ding Y, Chan CY, Lawrence CE (2005) RNA secondary structure prediction by centroids in a Boltzmann weighted ensemble. Rna 11: 1157–1166.
  41. 41. Vicens Q, Gooding AR, Laederach A, Cech TR (2007) Local RNA structural changes induced by crystallization are revealed by SHAPE. Rna 13: 536–548.
  42. 42. Shcherbakova I, Mitra S, Laederach A, Brenowitz M (2008) Energy barriers, pathways, and dynamics during folding of large, multidomain RNAs. Curr Opin Chem Biol 12: 655–666.
  43. 43. Quarrier S, Martin JS, Davis-Neulander L, Beauregard A, Laederach A (2010) Evaluation of the information content of RNA structure mapping data for secondary structure prediction. Rna 16: 1108–1117.
  44. 44. Mitra S, Laederach A, Golden BL, Altman RB, Brenowitz M (2011) RNA molecules with conserved catalytic cores but variable peripheries fold along unique energetically optimized pathways. Rna 17: 1589–1603.
  45. 45. Martin JS, Simmons K, Laederach A (2009) Exhaustive Enumeration of Kinetic Model Topologies for the Analysis of Time-Resoved RNA Folding. Algorithms 2: 200–214.
  46. 46. Laederach A, Shcherbakova I, Liang MP, Brenowitz M, Altman RB (2006) Local kinetic measures of macromolecular structure reveal partitioning among multiple parallel pathways from the earliest steps in the folding of a large RNA molecule. J Mol Biol 358: 1179–1190.
  47. 47. Laederach A, Shcherbakova I, Jonikas MA, Altman RB, Brenowitz M (2007) Distinct contribution of electrostatics, initial conformational ensemble, and macromolecular stability in RNA folding. Proc Natl Acad Sci U S A 104: 7045–7050.
  48. 48. Shcherbakova I, Brenowitz M (2005) Perturbation of the hierarchical folding of a large RNA by the destabilization of its Scaffold's tertiary structure. J Mol Biol 354: 483–496.
  49. 49. Russell R, Zhuang X, Babcock HP, Millett IS, Doniach S, et al. (2002) Exploring the folding landscape of a structured RNA. Proc Natl Acad Sci U S A 99: 155–160.
  50. 50. Murphy FL, Cech TR (1993) An independently folding domain of RNA tertiary structure within the Tetrahymena ribozyme. Biochemistry 32: 5291–5300.
  51. 51. Cannone JJ, Subramanian S, Schnare MN, Collett JR, D'Souza LM, et al. (2002) The comparative RNA web (CRW) site: an online database of comparative sequence and structure information for ribosomal, intron, and other RNAs. BMC Bioinformatics 3: 2.
  52. 52. Guo F, Gooding AR, Cech TR (2004) Structure of the Tetrahymena ribozyme: base triple sandwich and metal ion at the active site. Mol Cell 16: 351–362.
  53. 53. Jonikas MA, Radmer RJ, Laederach A, Das R, Pearlman S, et al. (2009) Coarse-grained modeling of large RNA molecules with knowledge-based potentials and structural filters. Rna 15: 189–199.
  54. 54. Leontis NB, Lescoute A, Westhof E (2006) The building blocks and motifs of RNA architecture. Curr Opin Struct Biol 16: 279–287.
  55. 55. Leontis NB, Westhof E (2003) Analysis of RNA motifs. Curr Opin Struct Biol 13: 300–308.
  56. 56. Gesell T, Washietl S (2008) Dinucleotide controlled null models for comparative RNA gene prediction. BMC Bioinformatics 9: 248.
  57. 57. Gruber AR, Findeiss S, Washietl S, Hofacker IL, Stadler PF (2010) RNAz 2.0: improved noncoding RNA detection. Pac Symp Biocomput 69–79.
  58. 58. Bindewald E, Shapiro BA (2006) RNA secondary structure prediction from sequence alignments using a network of k-nearest neighbor classifiers. Rna 12: 342–352.
  59. 59. Cech TR (1990) Self-splicing of group I introns. Annu Rev Biochem 59: 543–568.
  60. 60. Latham JA, Cech TR (1989) Defining the inside and outside of a catalytic RNA molecule. Science 245: 276–282.
  61. 61. Doherty EA, Doudna JA (2001) Ribozyme structures and mechanisms. Annu Rev Biophys Biomol Struct 30: 457–475.
  62. 62. Murray LJ, Arendall WB 3rd, Richardson DC, Richardson JS (2003) RNA backbone is rotameric. Proc Natl Acad Sci U S A 100: 13904–13909.
  63. 63. Schroeder R, Barta A, Semrad K (2004) Strategies for RNA folding and assembly. Nat Rev Mol Cell Biol 5: 908–919.
  64. 64. Miklos I, Meyer IM, Nagy B (2005) Moments of the Boltzmann distribution for RNA secondary structures. Bull Math Biol 67: 1031–1047.
  65. 65. Waldispuhl J, Clote P (2007) Computing the partition function and sampling for saturated secondary structures of RNA, with respect to the Turner energy model. J Comput Biol 14: 190–215.
  66. 66. Mathews DH (2006) Revolutions in RNA secondary structure prediction. J Mol Biol 359: 526–532.
  67. 67. Sabarinathan R, Tafer H, Seemann SE, Hofacker IL, Stadler PF, et al. (2013) RNAsnp: Efficient Detection of Local RNA Secondary Structure Changes Induced by SNPs. Hum Mutat 34: 546–56.
  68. 68. Salari R, Kimchi-Sarfaty C, Gottesman MM, Przytycka TM (2013) Sensitive measurement of single-nucleotide polymorphism-induced changes of RNA conformation: application to disease studies. Nucleic Acids Res 41: 44–53.
  69. 69. Chen C, Mitra S, Jonikas M, Martin J, Brenowitz M, et al. (2013) Understanding the role of three-dimensional topology in determining the folding intermediates of group I introns. Biophys J 104: 1326–1337.
  70. 70. Sinan S, Yuan X, Russell R (2011) The Azoarcus group I intron ribozyme misfolds and is accelerated for refolding by ATP-dependent RNA chaperone proteins. J Biol Chem 286: 37304–37312.
  71. 71. Grosjean H, Gaspin C, Marck C, Decatur WA, de Crecy-Lagard V (2008) RNomics and Modomics in the halophilic archaea Haloferax volcanii: identification of RNA modification genes. BMC Genomics 9: 470.
  72. 72. Woodson SA (2008) RNA folding and ribosome assembly. Curr Opin Chem Biol 12: 667–673.
  73. 73. Russell R, Millett IS, Doniach S, Herschlag D (2000) Small angle X-ray scattering reveals a compact intermediate in RNA folding. Nat Struct Biol 7: 367–370.
  74. 74. Gardner PP, Barquist L, Bateman A, Nawrocki EP, Weinberg Z (2011) RNIE: genome-wide prediction of bacterial intrinsic terminators. Nucleic Acids Res 39: 5845–5852.
  75. 75. Hofacker IL, Stadler PF (2006) Memory efficient folding algorithms for circular RNA secondary structures. Bioinformatics 22: 1172–1176.
  76. 76. Patel V, Wang JT, Setia S, Verma A, Warden CD, et al. (2010) On comparing two structured RNA multiple alignments. J Bioinform Comput Biol 8: 967–980.
  77. 77. Sonnhammer EL, Wootton JC (2001) Integrated graphical analysis of protein sequence features predicted from sequence composition. Proteins 45: 262–273.
  78. 78. Freyhult E, Gardner PP, Moulton V (2005) A comparison of RNA folding measures. BMC Bioinformatics 6: 241.
  79. 79. Darty K, Denise A, Ponty Y (2009) VARNA: Interactive drawing and editing of the RNA secondary structure. Bioinformatics 25: 1974–1975.
  80. 80. Mathews DH (2004) Using an RNA secondary structure partition function to determine confidence in base pairs predicted by free energy minimization. Rna 10: 1178–1190.
  81. 81. Mathews DH, Sabina J, Zuker M, Turner DH (1999) Expanded sequence dependence of thermodynamic parameters improves prediction of RNA secondary structure. J Mol Biol 288: 911–940.
  82. 82. Zuker M, Sankoff D (1984) RNA Secondary Structures and their Prediction. Bull Math Bio 46: 591–621.
  83. 83. Ding Y, Chan CY, Lawrence CE (2004) Sfold web server for statistical folding and rational design of nucleic acids. Nucleic Acids Res 32: W135–141.