Randomized Controlled Trials in The Social Sciences
The use of RCTs in social sciences is a highly contested issue. Some writers from a medical or health background have argued that existing research in a range of social science disciplines lacks rigour, and should be improved by greater use of randomized control trials. The issue has been particularly controversial in transport studies, with some writers arguing that public spending on programmes such as school travel plans could not be justified unless their efficacy is demonstrated by randomized controlled trials. Graham-Rowe and colleagues reviewed 77 evaluations of transport interventions found in the literature, categorising them into 5 "quality levels". They concluded that most of the studies were of low quality and advocated the use of randomized controlled trials wherever possible in future transport research.
Melia took issue with these conclusions, arguing that claims about the advantages of RCTs, in establishing causality and avoiding bias, have been exaggerated. He proposed the following 8 criteria for the use of RCTs in contexts where interventions must change human behaviour to be effective:
The intervention:
- Has not been applied to all members of a unique group of people (e.g. the population of a whole country, all employees of a unique organisation etc.)
- Is applied in a context or setting similar to that which applies to the control group
- Can be isolated from other activities – and the purpose of the study is to assess this isolated effect
- Has a short timescale between its implementation and maturity of its effects
And the causal mechanisms:
- Are either known to the researchers, or else all possible alternatives can be tested
- Do not involve significant feedback mechanisms between the intervention group and external environments
- Have a stable and predictable relationship to exogenous factors
- Would act in the same way if the control group and intervention group were reversed
Read more about this topic: Randomized Controlled Trial
Famous quotes containing the words controlled, trials, social and/or sciences:
“The roaring alongside he takes for granted,
and that every so often the world is bound to shake.
He runs, he runs to the south, finical, awkward,
in a state of controlled panic, a student of Blake.”
—Elizabeth Bishop (1911–1979)
“Why, since man and woman were created for each other, had He made their desires so dissimilar? Why should one class of women be able to dwell in luxurious seclusion from the trials of life, while another class performed their loathsome tasks? Surely His wisdom had not decreed that one set of women should live in degradation and in the end should perish that others might live in security, preserve their frappeed chastity, and in the end be saved.”
—Madeleine [Blair], U.S. prostitute and “madam.” Madeleine, ch. 10 (1919)
“As the tragic writer rids us of what is petty and ignoble in our nature, so also the humorist rids us of what is cautious, calculating, and priggish—about half of our social conscience, indeed. Both of them permit us, in blessed moments of revelation, to soar above the common level of our lives.”
—Robertson Davies (b. 1913)
“These modern ingenious sciences and arts do not affect me as those more venerable arts of hunting and fishing, and even of husbandry in its primitive and simple form; as ancient and honorable trades as the sun and moon and winds pursue, coeval with the faculties of man, and invented when these were invented. We do not know their John Gutenberg, or Richard Arkwright, though the poets would fain make them to have been gradually learned and taught.”
—Henry David Thoreau (1817–1862)