Quality of Multimedia Experience: Past, Present and Future

Quality of Multimedia Experience Past, Present and Future Prof. Dr. Touradj Ebrahimi [email_address]

[object Object],[object Object],[object Object],[object Object],Today we will talk about…

Quality – a simple yet difficult concept ,[object Object],[object Object],[object Object],[object Object],[object Object]

A fundamental yet largely under-investigated concept ,[object Object],[object Object],Aristotle 384 BC – 322 BC

Some definitions according to dictionary ,[object Object],[object Object],[object Object]

Some definitions according to dictionary ,[object Object],[object Object]

Definition according to ISO 9000 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Quality – is in fact an elephant The blind men and the elephant: Poem by John Godfrey Saxe

Quality of Service in computer networks and communications ,[object Object]

Quality in QoS framework Network Quality Capacity Coverage Handoff Link Quality Bitrate Frame/Bit/Packet loss Delay User Quality Speech fidelity Audio fidelity Image fidelity Video fidelity

Quality of Service in computer networks and communications ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

What is Mean Opinion Score (MOS)? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

[object Object],Subjective evaluation ,[object Object],[object Object],[object Object],[object Object]

Test/lab environment ,[object Object],[object Object],[object Object],[object Object],[object Object]

Test material ,[object Object],[object Object],[object Object],[object Object],p01 p06 p10 bike cafe woman

Test methodology ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

[object Object],[object Object],[object Object],[object Object],[object Object],ITU Recommendations for test methodologies

[object Object],Test methodology (I) ,[object Object],100 0 Excellent Bad ,[object Object],[object Object],[object Object],5 Excellent 4 Good 3 Fair 2 Poor 1 Bad 5 Imperceptible 4 Perceptible but not annoying 3 Slightly annoying 2 Annoying 1 Very annoying

[object Object],Test methodology (II) ,[object Object],5 Imperceptible 4 Perceptible but not annoying 3 Slightly annoying 2 Annoying 1 Very annoying

[object Object],Test methodology (III) Sample 1 Sample 2 ,[object Object],100 0 Excellent Bad Sample 1 Sample 2 100 0 Excellent Bad

[object Object],Test methodology (IV) ,[object Object],[object Object],[object Object],Much worse Much better much worse worse slightly worse the same slightly better better much better

[object Object],Test methodology (V) (Very annoying) (Imperceptible)

[object Object],Test methodology (VI) (Much better) (Much worse) (Reference) (Test sequence)

Analysis of the data ,[object Object],[object Object],[object Object],m ij = score by subject i for test condition j . N = number of subjects after outliers removal. t(1-α/2,N) = t-value corresponding to a two-tailed t-Student distribution with N-1 degrees of freedom and a desired significance level α (α=0.05 in our case). σ j = standard deviation of the scores distribution across subjects for test condition j .

Relationship between estimated mean values ,[object Object],[object Object],[object Object],[object Object]

MOS hypothesis test 0.25 bpp 0.50 bpp 0.75 bpp 1.00 bpp 1.25 bpp 1.50 bpp 6 5 4 3 2 1 0 Number of times H 0 is rejected JPEG 2000 4:2:0 JPEG 2000 4:4:4 JPEG JPEG XR MS JPEG XR PS JPEG 2000 4:2:0 JPEG 2000 4:4:4 JPEG JPEG XR MS JPEG XR PS

[object Object],[object Object],[object Object],[object Object],[object Object],Objective quality metrics

FR, RR and NR scenarios ,[object Object],[object Object],[object Object],Input/Reference signal Output/Processed signal signal processing FR METRIC Input/Reference signal Output/Processed signal signal processing NR METRIC Input/Reference signal Output/Processed signal signal processing Features extraction RR METRIC

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],MOS predictors based on fidelity measures

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],MOS predictors based on fidelity metrics

Peak Signal to Noise Ratio ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

PSNR for color images/video (I) ,[object Object],WPSNR = w 1 PSNR 1 + w 2 PSNR 2 + w 3 PSNR 3 WPSNR_MSE WPSNR_PIX

PSNR for color images/video (II) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

PSNR for color images/video (III) on R component: bpp (bits/pixel) bpp (bits/pixel) bpp (bits/pixel) on G component: on B component:

on Y’ component: on Cb component: on Cr component: bpp (bits/pixel) bpp (bits/pixel) bpp (bits/pixel) PSNR for color images/video (IV)

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],MOS predictors based on fidelity metrics Computational model of the visual system Visibility Map

PSNR-HVS-M ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

[object Object],[object Object],[object Object],MOS predictors based on fidelity measures

Mean SSIM (MSSIM) ,[object Object],[object Object],[object Object],[object Object],[object Object],(C 3 =constant)

[object Object],[object Object],[object Object],Mean SSIM (MSSIM) MSSIM=0.9168 MSSIM=0.6949 MSSIM=0.7052

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Specific distortion metrics

Blur metric ,[object Object],[object Object],Gaussian blurred image JPEG2000 compressed image

Correlation subjective ratings / NR blur metrics 96% correlation 85% correlation

Multimedia communication – a definition ,[object Object],[object Object],[object Object],[object Object]

Evolutions versus Revolutions in multimedia ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Some of the major milestones in multimedia ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Quality of Service vs Quality of Experience ,[object Object],[object Object],[object Object],[object Object],[object Object]

Factors impacting Quality of Experience Context

Quality of Experience in networked multimedia

Trends in QoE ,[object Object],[object Object],[object Object],[object Object],[object Object]

Trends in QoE community building ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Trends in standardization ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Challenges ahead ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

What does this all mean to you? ,[object Object],[object Object],[object Object],[object Object]

Thank you for your attention Questions?

Acknowledgements ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Quality of Multimedia Experience: Past, Present and Future

Recomendados

Recomendados

Más contenido relacionado

Similar a Quality of Multimedia Experience: Past, Present and Future

Similar a Quality of Multimedia Experience: Past, Present and Future (20)

Más de Touradj Ebrahimi

Más de Touradj Ebrahimi (20)

Quality of Multimedia Experience: Past, Present and Future

Notas del editor