Design of a No-Reference Perceptual Ringing Artifact Metric Master Thesis in Media & Knowledge Engineering Thesis Committee: Prof. Dr. I. Heynderickx Prof. Dr. R.L. Lagendijk Dr. W.P. Brinkman Dr. K.V. Hindriks MSc. H. Liu Author N.C.R. Klomp Email [email protected] Student number 1099957 Supervisor Prof. Dr. I. Heynderickx Group MMI Author N.C.R. Klomp Email [email protected] Keywords: objective metric, ringing artifact, perceptual edge detection, luminance masking, texture masking This report is made as a part of a Master thesis project at the faculty of Computer Science at the Delft University of Technology. All rights reserved. Nothing from this publication may be reproduced without written permission by the copyright holder. No rights whatsoever can be claimed on grounds of this report. Printed in The Netherlands Master Thesis N.C.R. Klomp __________________________________________________________________________________________________________________ Index 1 Introduction ................................................................................................................................................................................................................................................... 5 1.1 Research Question ............................................................................................................................................................................................................................ 7 1.2 Ringing Artifact ................................................................................................................................................................................................................................. 8 1.3 Objective Metrics and the HVS........................................................................................................................................................................................................ 10 1.4 Ringing Metrics ............................................................................................................................................................................................................................... 14 2 Literature ..................................................................................................................................................................................................................................................... 17 2.1 PCA Ringing Metric [31] .................................................................................................................................................................................................................. 17 2.2 Ratio Ringing Metric [28] ................................................................................................................................................................................................................ 19 2.3 Horizontal Ringing Metric [27] ........................................................................................................................................................................................................ 20 2.4 No-Reference Ringing Metric [31] ................................................................................................................................................................................................... 21 2.5 Morphological Filtering Ringing Metric [29] .................................................................................................................................................................................... 24 2.6 Region Clustering Ringing Metric [30] ............................................................................................................................................................................................. 30 2.7 Conclusion ...................................................................................................................................................................................................................................... 36 3 Approach ..................................................................................................................................................................................................................................................... 39 3.1 Overview......................................................................................................................................................................................................................................... 41 3.2 Ringing Region Detection ................................................................................................................................................................................................................ 42 3.2.1 Color Conversion................................................................................................................................................................................................................ 42 3.2.2 Edge Preserving Smoothing ............................................................................................................................................................................................... 42 3.2.3 Edge Detection .................................................................................................................................................................................................................. 48 3.2.4 Perceptual Grouping .......................................................................................................................................................................................................... 50 3.2.5 Local Region Classification ................................................................................................................................................................................................. 52 3.2.6 Human Vision Model ......................................................................................................................................................................................................... 53 3.2.7 Region Regrouping ............................................................................................................................................................................................................. 57 3.2.8 Spurious Ringing Object Removal ...................................................................................................................................................................................... 59 3.3 Ringing Quantification .................................................................................................................................................................................................................... 62 4 Experiments ................................................................................................................................................................................................................................................. 65 4.1 Ringing Region Experiment ............................................................................................................................................................................................................. 65 4.1.1 Experimental procedure .................................................................................................................................................................................................... 65 4.1.2 Subjective Data Processing ................................................................................................................................................................................................ 66 4.1.3 Performance Evaluation ..................................................................................................................................................................................................... 67 4.1.4 Performance Evaluation Metric Components .................................................................................................................................................................... 69 4.1.5 Performance Evaluation against Metrics from Literature ................................................................................................................................................... 72 4.2 Ringing Annoyance Experiment ...................................................................................................................................................................................................... 75 4.2.1 Experimental procedure .................................................................................................................................................................................................... 75 4.2.2 Subjective Data Processing ................................................................................................................................................................................................ 76 4.2.3 Evaluation Criteria ............................................................................................................................................................................................................. 81 4.2.4 Performance Evaluation ....................................................................................................................................................................................................