Does Order of Procedure Affect Statistical Significance?
Order refers to which comes first: the test data or the specification of the hypotheses to be tested. When the hypotheses come first the test is "prospective" and when the data come first the test is "retrospective". Traditionally, prospective tests have been required. However, there is a well-known generally accepted hypothesis test in which the data preceded the hypotheses. In that study the statistical significance was calculated the same as it would have been had the hypotheses preceded the data. A related question in use of statistics in the physical sciences is whether probability theory applies to the known past in the same way that it applies to the unknown future. Although these questions have been discussed, there are few references in this area of statistics. It hardly seems reasonable to accord the same status to a hypothesis that explains the results of an experiment after the results are known as to a hypothesis that predicts the results of an experiment before they are known. This is because it is well known that predicting an event before it occurs is more difficult than explaining it after it occurs.
Read more about this topic: Statistical Significance
Famous quotes containing the words order and/or affect:
“The herd of mankind can hardly be said to think; their notions are almost all adoptive; and, in general, I believe it is better that it should be so; as such common prejudices contribute more to order and quiet, than their own separate reasonings would do, uncultivated and unimproved as they are.”
—Philip Dormer Stanhope, 4th Earl Chesterfield (1694–1773)
“The route through childhood is shaped by many forces, and it differs for each of us. Our biological inheritance, the temperament with which we are born, the care we receive, our family relationships, the place where we grow up, the schools we attend, the culture in which we participate, and the historical period in which we live—all these affect the paths we take through childhood and condition the remainder of our lives.”
—Robert H. Wozniak (20th century)