Concept Testing - Shortcomings of Traditional Concept Testing

Shortcomings of Traditional Concept Testing

The traditional system of concept testing has been inadequate as a means to identify and quantify the criteria upon which consumer preference of one concept over another was based. These methods were insufficient to ascertain the relative importance of the factors responsible for or governing why consumers, markets and market segments reacted differently to concepts presented to them in the concept tests. Without such information, market researchers and advertisers, with their expertise, could generalize, on the basis of a concept test, as to how consumers might react to the actual products or to variations of the tested concepts. Communication of the concept, as embodied in a new product, has generally been left to the creativity of the advertising agency. No systematic quantitative method was known, however, which could accurately identify the criteria on which the consumer choices were based and the contribution or importance of each criterion to the purchase decision. Therefore, previous concept testing methods have failed to provide market researchers with the complete information necessary for them to create products specifically tailored to satisfy a consumer group balance of purchase criteria.

Moreover, traditional concept testing methods have failed to accurately quantify the relationships between consumer response to concepts and consumer choice of existing products which compete in the same consumer market. Thus, they were unable to provide a communication of the benefits of a consumer product, closely representing the tested concept, to a high degree of accuracy.

These problems of concept testing have been identified in business and marketing journals. For example, Moore and William (1982) in a literature survey and review of concept testing methodology, point out that concept tests have failed to account for changes between the concept tested and the communication describing the benefits of the product which embodies the concept. The Moore article reports that "no amount of improvement in current concept testing practices can remedy these problems." This is reflective of the fact that none of the traditional methods provided a quantitative means for ascertaining the relative importance of the underlying criteria of concept choices as a means for identifying the visual and verbal expressions of the concepts which best communicate the benefits sought by the consumer. Nor did the traditional methods quantify the relationships between concepts and existing products offered in the same consumer market. The ability of a method to ameliorate or overcome the above shortcomings would provide substantial improvement in communication of the concepts identified in testing and offered to the market as a product.

One such method is conjoint analysis and another is choice modelling. In addition, with online retailing become increasingly prominent, many online respondents are also online consumers. Thus, they are able to easily place themselves in the mindset of a consumer looking to buy goods or services. Since the arrival of these methods, market researchers have been able to make better, more accurate, suggestions to their clients regarding the decision to move forward, revise, or start over with a product concept. Online Choice Modelling for example can produce detailed econometric models of demand for various attributes of the new product such as feature, packaging and price.