Statistical Conclusion Validity

Statistical conclusion validity refers to the appropriate use of statistics to infer whether the presumed independent and dependent variables covary (Cook & Campbell, 1979). It concerns two related statistical inferences: (1) whether the presumed cause and effect covary and (2) how strongly they covary.

The most common threats to statistical conclusion validity are:

  • Low statistical power
  • Violated assumptions of the test statistics
  • Fishing and the error rate problem
  • Unreliability of measures
  • Restriction of range
  • Unreliability of treatment implementation
  • Extraneous variance in the experimental setting
  • Heterogeneity of the units under study
  • Inaccurate effect size estimation

Read more about Statistical Conclusion Validity:  See Also

Famous quotes containing the words conclusion and/or validity:

    I have come to the conclusion that the major part of the work of a President is to increase the gate receipts of expositions and fairs and by tourists into town.
    William Howard Taft (1857–1930)

    There are ... two minimum conditions necessary and sufficient for the existence of a legal system. On the one hand those rules of behavior which are valid according to the system’s ultimate criteria of validity must be generally obeyed, and on the other hand, its rules of recognition specifying the criteria of legal validity and its rules of change and adjudication must be effectively accepted as common public standards of official behavior by its officials.
    —H.L.A. (Herbert Lionel Adolphus)