I argue in favor of a systematic subjective evaluation of non-photorealistic images. Objective measurements are hard to design, and quantitative user studies are problematic for a multiplicity of reasons. Subjective evaluations are not quantitative but are faster to conduct and offer the chance to dig into subtleties that are obscured by numerical scores. By carefully laying out the important elements of the intended image style, and then evaluating their results according to their adherence to the style, researchers can produce convincing evaluations with a manageable level of effort.

Additional Metadata
Keywords Aesthetics, Computer-generated art, Evaluation, Non-photorealistic rendering, User studies
Persistent URL dx.doi.org/10.1145/2630397.2630400
Conference Workshop on Non-Photorealistic Animation and Rendering, NPAR 2014 - 4th Joint Symposium on Computational Aesthetics and Sketch-Based Interfaces and Modeling and Non-Photorealistic Animation and Rendering, Expressive 2014
Citation
Mould, D. (2014). Authorial subjective evaluation of non-photorealistic images. Presented at the Workshop on Non-Photorealistic Animation and Rendering, NPAR 2014 - 4th Joint Symposium on Computational Aesthetics and Sketch-Based Interfaces and Modeling and Non-Photorealistic Animation and Rendering, Expressive 2014. doi:10.1145/2630397.2630400