Statistical Significance - Does Order of Procedure Affect Statistical Significance?

Does Order of Procedure Affect Statistical Significance?

Order refers to which comes first: the test data or the specification of the hypotheses to be tested. When the hypotheses come first the test is "prospective" and when the data come first the test is "retrospective". Traditionally, prospective tests have been required. However, there is a well-known generally accepted hypothesis test in which the data preceded the hypotheses. In that study the statistical significance was calculated the same as it would have been had the hypotheses preceded the data. A related question in use of statistics in the physical sciences is whether probability theory applies to the known past in the same way that it applies to the unknown future. Although these questions have been discussed, there are few references in this area of statistics. It hardly seems reasonable to accord the same status to a hypothesis that explains the results of an experiment after the results are known as to a hypothesis that predicts the results of an experiment before they are known. This is because it is well known that predicting an event before it occurs is more difficult than explaining it after it occurs.

Read more about this topic:  Statistical Significance

Famous quotes containing the words order and/or affect:

    After decades of unappreciated drudgery, American women just don’t do housework any more—that is, beyond the minimum that is required in order to clear a path from the bedroom to the front door so they can get off to work in the mourning.
    Barbara Ehrenreich (20th century)

    When we choose to be parents, we accept another human being as part of ourselves, and a large part of our emotional selves will stay with that person as long as we live. From that time on, there will be another person on this earth whose orbit around us will affect us as surely as the moon affects the tides, and affect us in some ways more deeply than anyone else can. Our children are extensions of ourselves in ways our parents are not, nor our brothers and sisters, nor our spouses.
    Fred Rogers (20th century)