Shortcomings of Classical Test Theory
One of the most important or well known shortcomings of Classical Test Theory is that examinee characteristics and test characteristics cannot be separated: each can only be interpreted in the context of the other. Another shortcoming lies in the definition of Reliability that exists in Classical Test Theory, which states that reliability is "the correlation between test scores on parallel forms of a test". The problem with this is that there are differing opinions of what parallel tests are. Various reliability coefficients provide either lower bound estimates of reliability or reliability estimates with unknown biases. A third shortcoming involves the standard error of measurement. The problem here is that, according to Classical Test Theory, the standard error of measurement is assumed to be the same for all examinees. However, as Hambleton explains in his book, scores on any test are unequally precise measures for examinees of different ability, thus making the assumption of equal errors of measurement for all examinees implausible (Hambleton, Swaminathan, Rogers, 1991, p.4). A fourth, and final shortcoming of the Classical Test Theory is that it is test oriented, rather than item oriented. In other words, Classical Test Theory cannot help us make predictions of how well an individual or even a group of examinees might do on a test item.
Read more about this topic: Classical Test Theory
Famous quotes containing the words shortcomings of, shortcomings, classical, test and/or theory:
“The higher, the more exalted the society, the greater is its culture and refinement, and the less does gossip prevail. People in such circles find too much of interest in the world of art and literature and science to discuss, without gloating over the shortcomings of their neighbors.”
—Mrs. H. O. Ward (1824–1899)
“My mother and father are the only people on the whole planet for whom I will never begrudge a thing. Should I achieve great things, it is the work of their hands; they are splendid people and their absolute love of their children places them above the highest praise. It cloaks all of their shortcomings, shortcomings that may have resulted from a difficult life.”
—Anton Pavlovich Chekhov (1860–1904)
“The basic difference between classical music and jazz is that in the former the music is always greater than its performance—Beethoven’s Violin Concerto, for instance, is always greater than its performance—whereas the way jazz is performed is always more important than what is being performed.”
—André Previn (b. 1929)
“The test of a man’s or woman’s breeding is how they behave in a quarrel. Anybody can behave well when things are going smoothly.”
—George Bernard Shaw (1856–1950)
“Everything to which we concede existence is a posit from the standpoint of a description of the theory-building process, and simultaneously real from the standpoint of the theory that is being built. Nor let us look down on the standpoint of the theory as make-believe; for we can never do better than occupy the standpoint of some theory or other, the best we can muster at the time.”
—Willard Van Orman Quine (b. 1908)