Threats To External Validity
"A threat to external validity is an explanation of how you might be wrong in making a generalization." Generally, generalizability is limited when the cause (i.e. the independent variable) depends on other factors; therefore, all threats to external validity interact with the independent variable.
- Aptitude-Treatment-Interaction: The sample may have certain features that may interact with the independent variable, limiting generalizability. For example, inferences based on comparative psychotherapy studies often employ specific samples (e.g. volunteers, highly depressed, no comorbidity). If psychotherapy is found effective for these sample patients, will it also be effective for non-volunteers or the mildly depressed or patients with concurrent other disorders?
- Situation: All situational specifics (e.g. treatment conditions, time, location, lighting, noise, treatment administration, investigator, timing, scope and extent of measurement, etc. etc.) of a study potentially limit generalizability.
- Pre-Test Effects: If cause-effect relationships can only be found when pre-tests are carried out, then this also limits the generality of the findings.
- Post-Test Effects: If cause-effect relationships can only be found when post-tests are carried out, then this also limits the generality of the findings.
- Reactivity (Placebo, Novelty, and Hawthorne Effects): If cause-effect relationships are found they might not be generalizable to other settings or situations if the effects found only occurred as an effect of studying the situation.
- Rosenthal Effects: Inferences about cause-consequence relationships may not be generalizable to other investigators or researchers.
Read more about this topic: External Validity
Famous quotes containing the words threats to, threats, external and/or validity:
“Among the best traitors Ireland has ever had, Mother Church ranks at the very top, a massive obstacle in the path to equality and freedom. She has been a force for conservatism, not on the basis of preserving Catholic doctrine or preventing the corruption of her children, but simply to ward off threats to her own security and influence.”
—Bernadette Devlin (b. 1947)
“Among the best traitors Ireland has ever had, Mother Church ranks at the very top, a massive obstacle in the path to equality and freedom. She has been a force for conservatism, not on the basis of preserving Catholic doctrine or preventing the corruption of her children, but simply to ward off threats to her own security and influence.”
—Bernadette Devlin (b. 1947)
“All in all, the creative act is not performed by the artist alone; the spectator brings the work in contact with the external world by deciphering and interpreting its inner qualifications and thus adds his contribution to the creative act. This becomes even more obvious when posterity gives its final verdict and sometimes rehabilitates forgotten artists.”
—Marcel Duchamp (1887–1968)
“It does not follow, because our difficulties are stupendous, because there are some souls timorous enough to doubt the validity and effectiveness of our ideals and our system, that we must turn to a state controlled or state directed social or economic system in order to cure our troubles.”
—Herbert Hoover (1874–1964)