Randal M. Henne's research while affiliated with Microsoft and other places

Publications (2)

Article
Full-text available
The web provides an unprecedented opportunity to evaluate ideas quickly using controlled experiments, also called randomized experiments, A/B tests (and their generalizations), split tests, Control/Treatment tests, MultiVariable Tests (MVT) and parallel flights. Controlled experiments embody the best scientific design for establishing a causal rela...
Conference Paper
Full-text available
The web provides an unprecedented opportunity to evaluate ideas quickly using controlled experiments, also called randomized experiments (single-factor or factorial designs), A/B tests (and their generalizations), split tests, Control/Treatment tests, and parallel flights. Controlled experiments embody the best scientific design for establishing a...

Citations

... Design activities aim to create products that meet user needs and expectations, for example, by drawing storyboards (Henrikson et al., 2016) or sketches (Tohidi et al., 2006). In contrast, evaluation activities aim to assess the effectiveness and efficiency of products, for example, by using A/B testing (Kohavi et al., 2007) or Wizard of Oz (Porcheron et al., 2021). As Figure 1 presents, design and evaluation activities are complementary and mutually reinforcing, which gradually meet user needs and expectations through continuous iteration. ...
... Results are indicated as mean [95 % CI]. Upper and lower 95 % CI values of relative differences over food ration were calculated following Kohavi et al. (2009). ...