Objective Video Quality
Objective video evaluation techniques are mathematical models that approximate results of subjective quality assessment, but are based on criteria and metrics that can be measured objectively and automatically evaluated by a computer program. Objective methods are classified based on the availability of the original video signal, which is considered to be of high quality (generally not compressed). Therefore, they can be classified as Full Reference Methods (FR), Reduced Reference Methods (RR) and No-Reference Methods (NR). FR metrics compute the quality difference by comparing every pixel in each image of the distorted video to its corresponding pixel in the original video. RR metrics extract some features of both videos and compare them to give a quality score. They are used when all the original video is not available, e.g. in a transmission with a limited bandwidth. NR metrics try to assess the quality of a distorted video without any reference to the original video. These metrics are usually used when the video coding method is known.
The most traditional ways of evaluating quality of digital video processing system (e.g. video codec like DivX, Xvid) are calculation of the signal-to-noise ratio (SNR) and peak signal-to-noise ratio (PSNR) between the original video signal and signal passed through this system. PSNR is the most widely used objective video quality metric. However, PSNR values do not perfectly correlate with a perceived visual quality due to the non-linear behavior of the human visual system. Recently a number of more complicated and precise metrics were developed, for example UQI, VQM, PEVQ, SSIM, VQuad-HD and CZD. Based on a benchmark by the Video Quality Experts Group (VQEG) in the course of the Multimedia Test Phase 2007-2008 some metrics were standardized as ITU-T Rec. J.246 (RR), J.247 (FR) in 2008 and J.341 (FR HD) in 2011.
The performance of an objective video quality metric is evaluated by computing the correlation between the objective scores and the subjective test results. The latter is called mean opinion score (MOS). The most frequently used correlation coefficients are : linear correlation coefficient, Spearman's rank correlation coefficient, kurtosis, kappa coefficient and outliers ratio.
When estimating quality of a video codec, all the mentioned objective methods may require repeating post-encoding tests in order to determine the encoding parameters that satisfy a required level of visual quality, making them time consuming, complex and impractical for implementation in real commercial applications. For this reason, much research has been focused on developing novel objective evaluation methods which enable prediction of the perceived quality level of the encoded video before the actual encoding is performed .
Read more about this topic: Video Quality
Famous quotes containing the words objective, video and/or quality:
“When you’re dealing with monkeys, you’ve got to expect some wrenches.”
—Alvah Bessie, Ranald MacDougall, and Lester Cole. Raoul Walsh. Captain Nelson, Objective Burma, giving a subaltern a mission (1945)
“It is among the ranks of school-age children, those six- to twelve-year-olds who once avidly filled their free moments with childhood play, that the greatest change is evident. In the place of traditional, sometimes ancient childhood games that were still popular a generation ago, in the place of fantasy and make- believe play . . . today’s children have substituted television viewing and, most recently, video games.”
—Marie Winn (20th century)
“There are few things more disturbing than to find, in somebody we detest, a moral quality which seems to us demonstrably superior to anything we ourselves possess. It augurs not merely an unfairness on the part of creation, but a lack of artistic judgement.... Sainthood is acceptable only in saints.”
—Pamela Hansford Johnson (1912–1981)