Conference Paper

Adaptive Design Optimization in Experiments with People.

Conference: Advances in Neural Information Processing Systems 22: 23rd Annual Conference on Neural Information Processing Systems 2009. Proceedings of a meeting held 7-10 December 2009, Vancouver, British Columbia, Canada.
Source: DBLP
Download full-text


Available from: Daniel R Cavagnaro, Jul 29, 2014
1 Follower
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: a b s t r a c t A commonly voiced concern with the Bayes factor is that, unlike many other Bayesian and non-Bayesian quantitative measures of model evaluation, it is highly sensitive to the parameter prior. This paper argues that, when dealing with psychological models that are quantitatively instantiated theories, being sensitive to the prior is an attractive feature of a model evaluation measure. This assertion follows from the observation that in psychological models parameters are not completely unknown, but correspond to psychological variables about which theory often exists. This theory can be formally captured in the prior range and prior distribution of the parameters, indicating which parameter values are allowed, likely, unlikely and forbidden. Because the prior is a vehicle for expressing psychological theory, it should, like the model equation, be considered as an integral part of the model. It is argued that the combined practice of building models using informative priors, and evaluating models using prior sensitive measures advances knowledge.
    Journal of Mathematical Psychology 12/2010; 54:491-498. DOI:10.1016/ · 1.81 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: Experimentation is ubiquitous in the field of psychology and fundamental to the advancement of its science, and one of the biggest challenges for researchers is designing experiments that can conclusively discriminate the theoretical hypotheses or models under investigation. The recognition of this challenge has led to the development of sophisticated statistical methods that aid in the design of experiments and that are within the reach of everyday experimental scientists. This tutorial paper introduces the reader to an implementable experimentation methodology, dubbed Adaptive Design Optimization, that can help scientists to conduct "smart" experiments that are maximally informative and highly efficient, which in turn should accelerate scientific discovery in psychology and beyond.
    Journal of Mathematical Psychology 06/2013; 57(3-4):53-67. DOI:10.1016/ · 1.81 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Recent work by Luce (2010a; 2010b) on p-additive utility theory has yielded three distinct representation classes that correspond to risk attitude. We present a method for classifying decision makers under such $p$-additive representations. Our approach extends the classification criterion described by Luce (2010b) to accommodate decision makers with risk attitudes that vary as a function of the decision environment. We present the results of a new decision making under risk experiment designed to evaluate risk attitude. We found that no single $p$-additive representation model emerged as the best description of the participants' preferences. Participants were best described by consistent risk attitudes and risk attitudes that vary as a function of the decision environment in roughly equal numbers.
    Journal of Mathematical Psychology 08/2013; DOI:10.1016/ · 1.81 Impact Factor
Show more