Perceptual Evaluation of Liquid Simulation Methods
Abstract
This paper proposes a novel framework to evaluate fluid simulation methods based on crowd-sourced user studies in order to robustly gather large numbers of opinions. The key idea for a robust and reliable evaluation is to use a reference video from a carefully selected real-world setup in the user study. By conducting a series of controlled user studies and comparing their evaluation results, we observe various factors that affect the perceptual evaluation. Our data show that the availability of a reference video makes the evaluation consistent. We introduce this approach for computing scores of simulation methods as visual accuracy metric. As an application of the proposed framework, a variety of popular simulation methods are evaluated.
- Publication:
-
arXiv e-prints
- Pub Date:
- November 2020
- DOI:
- 10.48550/arXiv.2011.10257
- arXiv:
- arXiv:2011.10257
- Bibcode:
- 2020arXiv201110257U
- Keywords:
-
- Computer Science - Graphics
- E-Print:
- Details at: http://ge.in.tum.de/publications/2017-sig-um/