TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
Suitable methodology in subjective video quality assessment: a resolution dependent paradigm
1. Stéphane Péchard Romuald Pépion Patrick Le Callet IRCCyN — France Suitable methodology in subjective video quality assessment: a resolution dependent paradigm
2. Outline 1. Introduction 2. Comparison of subjective scores 3. Impact of the number of observers on precision 4. Conclusion
15. ACR less critical than SAMVIQ Distorsions better perceived with SAMVIQ BUT the inverse for reference
16. What can explain? Scale difference Number of viewing Explicit reference
17. Scale difference? Corriveau: ACR closer to the extremities But reference MOS only in [68.52;87.04] => not the explanation ACR uses 96.3% SAMVIQ uses 82.1%
18. Number of viewing? => only explain the plot, not the CC SAMVIQ: unlimited viewing with distorsions: MOS ACR > MOS SAMVIQ more precise scores
19.
20. Explicit reference presence? No obvious impact SAMVIQ: no difference between references No higher scores than explicit reference => only identical assessments Not the same psychological condition
37. Rejection modes analysis CI without rejection < CI with rejection because mean computed with more CI without rejection (mode 1) Nevertheless, not important differences
38. Rejection modes analysis CI SAMVIQ rejection > CI ACR rejection Same reason : number of validated observers in SAMVIQ < in ACR
39. Conclusion ACR-SAMVIQ comparison different behaviours weak relation when resolution increases SAMVIQ more accurate with multi-viewing more information to process
40. Conclusion strong impact of the number of observers weak impact of the rejection algorithm ACR requires more than 22 observers to get the same precision than SAMVIQ with 15 interesting for laboratories to select the best methodology