Open Profiling of Quality: A Mixed Method Approach to Understanding Multimodal Quality Perception

To quantify the excellence of multimedia quality, subjective evaluation experiments are conducted. In these experiments, the tradition of quantitative assessment is the most dominating, but it disregards the understanding of participants' interpretations, descriptions, and the evaluation criteria of quality. The goal of this paper is to present a new multimedia quality evaluation method called Open Profiling of Quality (OPQ) as a tool for building a deeper understanding on subjective quality. OPQ is a mixed method combining a conventional quantitative psycho perceptual evaluation and qualitative descriptive quality evaluation based on the individual's own vocabulary.