Correlation Is Not Causation

Academic medicine: journal of the Association of American Medical Colleges (Impact Factor: 3.47). 01/2009; 83(12):1123; author reply 1123. DOI: 10.1097/ACM.0b013e31818c749a
Source: PubMed

ABSTRACT HR measurement is very simple when you know what you’re doing. However, if you make it overly simplistic, don’t be surprised if no one is interested in the results. HR benchmarks based on a spurious connection between business performance and HR practices convince no one. Effective and convincing HR measurement starts with clear causation, not correlation.

  • [Show abstract] [Hide abstract]
    ABSTRACT: In human resource management (HRM) and allied fields (e.g., organizational behavior, management, and industrial and organizational psychology), tests of mediation are frequently conducted using the hierarchical multiple regression (HMR) strategy of Baron and Kenny [Baron, R. M., & Kenny, D. A. (1986). The moderator–mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology, 51, 1173–1182]. Although previous research has identified a number of serious problems with this approach, the present study adds to the literature by identifying yet additional problems with its use in inferring the existence of mediation. Using a statistical simulation, we found that certain patterns of correlation coefficients guarantee inferences about mediation, whereas other patterns preclude such inferences. On the basis of various analyses including logistic regression and inspection of three-dimensional plots, we identified patterns of correlation coefficients needed to satisfy Baron and Kenny's [Baron, R. M., & Kenny, D. A. (1986). The moderator–mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology, 51, 1173–1182] conditions for inferring mediation. The same patterns have no necessary relation to actual causal connections among variables in mediation models. Moreover, as a consequence of the failure of the HMR strategy to detect mediating effects, many instances of actual mediation in HRM and allied fields may have gone undetected. In view of the foregoing, we conclude that the HMR strategy should no longer be used in testing for mediation.
    Human Resource Management Review 12/2008; 18(4):294-310. DOI:10.1016/j.hrmr.2008.07.009 · 2.38 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: In a national field experiment, the same questionnaires were administered simultaneously by RDD telephone interviewing, by the Internet with a probability sample, and by the Internet with a nonprobability sample of people who volunteered to do surveys for money. The probability samples were more representative of the nation than the nonprobability sample in terms of demographics and electoral participation, even after weighting. The nonprobability sample was biased toward being highly engaged in and knowledgeable about the survey's topic (politics). The telephone data manifested more random measurement error, more survey satisficing, and more social desirability response bias than did the Internet data, and the probability Internet sample manifested more random error and satisficing than did the volunteer Internet sample. Practice at completing surveys increased reporting accuracy among the probability Internet sample, and deciding only to do surveys on topics of personal interest enhanced reporting accuracy in the nonprobability Internet sample. Thus, the nonprobability Internet method yielded the most accurate self-reports from the most biased sample, while the probability Internet sample manifested the optimal combination of sample composition accuracy and self-report accuracy. These results suggest that Internet data collection from a probability sample yields more accurate results than do telephone interviewing and Internet data collection from nonprobability samples.
    Public Opinion Quarterly 12/2009; 73(4). DOI:10.1093/poq/nfp075 · 2.25 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Complex problem-solving (CPS) is as an area of cognitive science that has received a good amount of attention, but theories in the field have not progressed accordingly. The reasons could be the lack of good definitions and classifications of the tasks (taxonomies). Although complexity is a term used pervasively in psychology and is operationalized in different ways, there are no psychological theories of complexity. The definition of problem-solving has been changed in the past to reflect the varied interests of the researchers and has lost its initial concreteness. These two facts together make it difficult to define CPS or make clear if CPS should reuse the theory and methods of classical problem-solving or on the contrary should build a theoretical structure starting from scratch. A taxonomy is offered of tasks using both formal features and psychological features that are theory-independent that could help compare the CPS tasks used in the literature. The adequateness is also reviewed of the most extended definitions of CPS and conclude that they are in serious need of review, since they cover tasks that are not considered problem-solving by their own authors or are not complex, but ignore others that should clearly be included.
    Theoretical Issues in Ergonomics Science 01/2005; 6(1). DOI:10.1080/14639220512331311553