Sloppy models, parameter uncertainty, and the role of experimental design.

Department of Biological Engineering, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139, USA.
Molecular BioSystems (Impact Factor: 3.18). 10/2010; 6(10):1890-900. DOI: 10.1039/b918098b
Source: PubMed

ABSTRACT Computational models are increasingly used to understand and predict complex biological phenomena. These models contain many unknown parameters, at least some of which are difficult to measure directly, and instead are estimated by fitting to time-course data. Previous work has suggested that even with precise data sets, many parameters are unknowable by trajectory measurements. We examined this question in the context of a pathway model of epidermal growth factor (EGF) and neuronal growth factor (NGF) signaling. Computationally, we examined a palette of experimental perturbations that included different doses of EGF and NGF as well as single and multiple gene knockdowns and overexpressions. While no single experiment could accurately estimate all of the parameters, experimental design methodology identified a set of five complementary experiments that could. These results suggest optimism for the prospects for calibrating even large models, that the success of parameter estimation is intimately linked to the experimental perturbations used, and that experimental design methodology is important for parameter fitting of biological models and likely for the accuracy that can be expected from them.

1 Follower
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: The ability to restore homeostasis upon environmental challenges has been proposed as a measure for health. Metabolic profiling of plasma samples during the challenge response phase should offer a profound view on the flexibility of a phenotype to cope with daily stressors. Current data modeling approaches, however, struggle to extract biological descriptors from time-resolved metabolite profiles that are able to discriminate between different phenotypes. Thus, for the case of oxylipin responses in plasma upon an oral glucose tolerance test we developed a modeling approach that incorporates a priori biological pathway knowledge. The degradation pathways of arachidonic and linoleic acids were modeled using a regression model based on a pseudo-steady-state approximated model, resulting in a parameter A that summarizes the relative enzymatic activity in these pathways. Analysis of the phenotypic parameters As suggests that different phenotypes can be discriminated according to preferred relative activity of the arachidonic and linoleic pathway. Correlation analysis shows that there is little or no competition between the arachidonic and linoleic acid pathways, although they share the same enzymes.
    PLoS ONE 01/2015; In press(3). DOI:10.1371/journal.pone.0119856 · 3.53 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Quasi steady-state enzyme kinetic models are increasingly used in systems modelling. The Michaelis Menten model is popular due to its reduced parameter dimensionality, but its low-enzyme and irreversibility assumption may not always be valid in the in vivo context. While the total quasi-steady state assumption (tQSSA) model eliminates the reactant stationary assumptions, its mathematical complexity is increased. Here, we propose the differential quasi-steady state approximation (dQSSA) kinetic model, which expresses the differential equations as a linear algebraic equation. It eliminates the reactant stationary assumptions of the Michaelis Menten model without increasing model dimensionality. The dQSSA was found to be easily adaptable for reversible enzyme kinetic systems with complex topologies and to predict behaviour consistent with mass action kinetics in silico. Additionally, the dQSSA was able to predict coenzyme inhibition in the reversible lactate dehydrogenase enzyme, which the Michaelis Menten model failed to do. While the dQSSA does not account for the physical and thermodynamic interactions of all intermediate enzyme-substrate complex states, it is proposed to be suitable for modelling complex enzyme mediated biochemical systems. This is due to its simpler application, reduced parameter dimensionality and improved accuracy.
    03/2015; 271. DOI:10.1016/j.fob.2015.03.002
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Background Clinical trials are the main method for evaluating safety and efficacy of medical interventions and have produced many advances in improving human health. The Women¿s Health Initiative overturned a half-century of harmful practice in hormone therapy, the National Lung Screening Trial identified the first successful lung cancer screening tool and the Prostate, Lung, Colorectal and Ovarian Cancer Screening Trial overturned decades-long assumptions. While some trials identify unforeseen safety issues or harms, many fail to demonstrate efficacy. Large trials require substantial resources; to ensure reliable outcomes, we must seek ways to improve the predictive information used as the basis of trials.ResultsHere we demonstrate a modeling framework for linking knowledge of underlying biological mechanism to evaluate the expectation of trial outcomes. Key features include the ability to propagate uncertainty in biological mechanism to uncertainty in trial outcome and mechanisms for identifying knowledge gaps most responsible for unexpected outcomes. The framework was used to model the effect of selenium supplementation for prostate cancer prevention and parallels the Selenium and Vitamin E Cancer Prevention Trial that showed no efficacy despite suggestive data from secondary endpoints in the Nutritional Prevention of Cancer trial and found increased incidence of high-grade prostate cancer in certain subgroups.Conclusion Using machine learning methods, we identified the parameters of the model that are most predictive of trial outcome and found that the top four are directly related to the rates of reactions producing methylselenol and transporting extracellular selenium into the cell as selenide. This modeling process demonstrates how the approach can be used in advance of a large clinical trial to identify the best targets for conducting further research to reduce the uncertainty in the trial outcome.
    BMC Systems Biology 12/2014; 8(1):6. DOI:10.1186/s12918-014-0140-0 · 2.85 Impact Factor


1 Download
Available from