Shortcomings of Classical Test Theory
One of the most important or well known shortcomings of Classical Test Theory is that examinee characteristics and test characteristics cannot be separated: each can only be interpreted in the context of the other. Another shortcoming lies in the definition of Reliability that exists in Classical Test Theory, which states that reliability is "the correlation between test scores on parallel forms of a test". The problem with this is that there are differing opinions of what parallel tests are. Various reliability coefficients provide either lower bound estimates of reliability or reliability estimates with unknown biases. A third shortcoming involves the standard error of measurement. The problem here is that, according to Classical Test Theory, the standard error of measurement is assumed to be the same for all examinees. However, as Hambleton explains in his book, scores on any test are unequally precise measures for examinees of different ability, thus making the assumption of equal errors of measurement for all examinees implausible (Hambleton, Swaminathan, Rogers, 1991, p.4). A fourth, and final shortcoming of the Classical Test Theory is that it is test oriented, rather than item oriented. In other words, Classical Test Theory cannot help us make predictions of how well an individual or even a group of examinees might do on a test item.
Read more about this topic: Classical Test Theory
Famous quotes containing the words shortcomings of, shortcomings, classical, test and/or theory:
“No shortcomings of other people cause us to be more intolerant than those which are caricatures of our own.”
—Franz Grillparzer (1791–1872)
“I feel a kind of reverence for the first books of young authors. There is so much aspiration in them, so much audacious hope and trembling fear, so much of the heart’s history, that all errors and shortcomings are for a while lost sight of in the amiable self assertion of youth.”
—Henry Wadsworth Longfellow (1807–1882)
“Compare the history of the novel to that of rock ‘n’ roll. Both started out a minority taste, became a mass taste, and then splintered into several subgenres. Both have been the typical cultural expressions of classes and epochs. Both started out aggressively fighting for their share of attention, novels attacking the drama, the tract, and the poem, rock attacking jazz and pop and rolling over classical music.”
—W. T. Lhamon, U.S. educator, critic. “Material Differences,” Deliberate Speed: The Origins of a Cultural Style in the American 1950s, Smithsonian (1990)
“Just as we need to encourage women to test life’s many options, we need to acknowledge real limits of energy and resources. It would be pointless and cruel to prescribe role combination for every woman at each moment of her life. Life has its seasons. There are moments when a woman ought to invest emotionally in many different roles, and other moments when she may need to conserve her psychological energies.”
—Faye J. Crosby (20th century)
“There could be no fairer destiny for any physical theory than that it should point the way to a more comprehensive theory in which it lives on as a limiting case.”
—Albert Einstein (1879–1955)