Statistical Conclusion Validity

Statistical conclusion validity refers to the appropriate use of statistics to infer whether the presumed independent and dependent variables covary (Cook & Campbell, 1979). It concerns two related statistical inferences: (1) whether the presumed cause and effect covary and (2) how strongly they covary.

The most common threats to statistical conclusion validity are:

  • Low statistical power
  • Violated assumptions of the test statistics
  • Fishing and the error rate problem
  • Unreliability of measures
  • Restriction of range
  • Unreliability of treatment implementation
  • Extraneous variance in the experimental setting
  • Heterogeneity of the units under study
  • Inaccurate effect size estimation

Read more about Statistical Conclusion Validity:  See Also

Famous quotes containing the words conclusion and/or validity:

    I’ve heard the wolves scuffle, and said: So this
    Is man; so what better conclusion is there
    The day will not follow night, and the heart
    Of man has a little dignity, but less patience
    Than a wolf’s....
    Allen Tate (1899–1979)

    It does not follow, because our difficulties are stupendous, because there are some souls timorous enough to doubt the validity and effectiveness of our ideals and our system, that we must turn to a state controlled or state directed social or economic system in order to cure our troubles.
    Herbert Hoover (1874–1964)