Full-Reference and Non-Reference Image Quality Assessment Based on Optimization Technique

• Material Type: 博士論文
• Title: Full-Reference and Non-Reference Image Quality Assessment Based on Optimization Technique
• Author/Editor: YADANAR, KHAING
• Author Heading: YADANAR, KHAING
• Publication Date: 2019
• Publication Date (W3CDTF): 2019
• Alternative Title: 最適化技術に基づくフルリファレンスおよびノンリファレンス画像品質評価
• Periodical title: 博士論文（埼玉大学大学院理工学研究科（博士後期課程））
• Degree grantor/type: 埼玉大学
• Date Granted: 2019-09-20
• Date Granted (W3CDTF): 2019-09-20
• Dissertation Number: 甲第1142号
• Degree Type: 博士(工学)
• Conferring No. (Dissertation): 甲第1142号
• Text Language Code: eng
• Target Audience: 一般
• Note (General): type:text; In this study, we proposed some objective image quality estimation methods for full-reference image quality assessment(FR-IQA ) and no-reference or blind image quality assessment (BIQA ). First, we proposed a new combination technique forfull-reference image quality assessment (FR - IQA ) by utilizing three better-recognized image quality assessment (IQA ) methods. For selecting the IQA methods, we firstly pick up the most appropriate IQA index for image quality databases and then add other two indices which have the most dissimilar features with the first index. Indeed, the combination of multiple IQA measures naturally emerges because of the shortcomings of single IQA indices for different types of distortions.Over the last several decades, IQA has been a topic of intense research in image processing field and it is the process of determining the level of accuracy of digital images. Nowadays, huge amount of images are daily produced for several purposes, for example, forecasting weather, finding diseases and monitoring criminals. For these reasons, it is very importance to keep the quality of such images at an acceptable visual level at the end-users after the production and transmission. Furthermore, accurate measurement of the image quality is an important step in many image-based applications. To achieve this goal, effective IQA algorithms are necessary and have recently become a very hot research topic.Basically, there are two types of image quality assessment called subjective image quality assessment and objective image quality assessment. Subjective Image Quality Assessment is the most reliable way to evaluate the visual quality of digital images perceived by the human observers. In practice, however, subjective image quality assessment is time consuming and very expensive. Thus, it is often used to construct image quality datasets and provide the ground-truth mean opinion scores (MOS ) for evaluating objective quality measures. Objective image quality assessment is automatically estimating the quality of images by algorithms instead of humans using MOS provided by human observers and it is more handy than the subjective IQA . To carry out this requirement, many researchers proposed various not only single but also combination IQA methods in recent times. However, all existing single and combination IQA methods still have some shortcomings to be able to get the highest performance for full-reference IQA . Therefore, we consider a simple and robust combination method that are suitable for all image databases. In our combination, we firstly pick up the most correlated IQA method for all types of distortions by applying the algorithm that is used to select the most appropriate method for combination. After choosing the first combined IQA method, we choose the one which has the biggest index ranking difference with the first one as the second combined IQA method, since it has the most different characteristics comparing to the first chosen combined IQA method. Following the same way, we decide the third one. After selecting the most appropriate methods, we combine the three methods by employing the weighting factors, exponentaited coefficients and constant values. Then, we optimize these parameter values by using the Particle Swarm Optimization (PSO ). Experimental results verified that the proposed method gives the best performance for various databases and outperforms other state-of-the-art not only traditional single methods but also previous combination methods.On the other hand, it is very difficult to get the information of reference images for image quality estimation in reality. This gives a motivation to consider blind image quality assessment (BIQA ) methods which are able to measure the quality of distorted images without referencing the original images. Therefore, many researchers develop numerous BIQA approaches using Natural Scene Statistics (NSS ) based features. In most NSS based BIQA methods, features are extracted by the wavelet transform and they are usually very slow due to the use of computationally expensive image transformations. Thus, more recent techniques promote extracting features from the spatial domain, which leads to a significant reduction in computation time. However, all existing BIQA methods have still restrictions to get the highest performance. To overcome the restrictions, we consider to construct a very simple and robust end-to-end learning mechanism using convolutional neural network (CNN ). One of CNN s advantages is that it can take raw images as input and incorporate feature learning into the training process. Thus, in our work, we take distorted images labelled with Mean Opinion Score (MOS ) as inputs and output the related score for each image. Experimental results demonstrated that our proposed method outperforms other state-of-the-art ones.; Acknowledgements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13Abstract . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 141 Introduction 161.1 Background . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 161.1.1 Full-reference Image Quality Assessment (FR - IQA syes) . 171.1.2 No-reference Image Quality Assessment (NR - IQA syes) . 191.2 Problem Statements and Objectives . . . . . . . . . . . . . . . . . . 221.3 Overviews . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 231.4 Organization of the thesis . . . . . . . . . . . . . . . . . . . . . . . 262 Combination of Dissimilar Feature-Scores for Image Quality Assessment Using Particle Swarm Optimization Algorithm 272.1 Related Work . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 272.2 Structural Similarity (SSIM) Measure . . . . . . . . . . . . . . . . . 302.3 Multi-scale structural similarity (MS-SSIM) Measure . . . . . . . . 322.4 Most apparent distortion (MAD) Measure . . . . . . . . . . . . . . 332.5 Feature similarity (FSIM) Measure . . . . . . . . . . . . . . . . . . 382.6 Feature similarity index for color images (FSIMC) . . . . . . . . . . 402.7 Combined Full-Reference Image Quality Metric (CQM) . . . . . . . 412.8 Extended Hybrid Image Similarity (EHIS) . . . . . . . . . . . . . . 422.9 Exponentiated Combination of Two Scores for Image Quality Assessment (2SCM) . . . . . . . . . . . . . . . . . . . . . . . . . . . . 422.10 Optimized Three Scores Combination for Image Quality Assessment (3SCM) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 432.11 Particle Swarm Optimization (PSO) Algorithm . . . . . . . . . . . 442.12 Proposed Method . . . . . . . . . . . . . . . . . . . . . . . . . . . . 462.13 Experimental Results and Discussion . . . . . . . . . . . . . . . . . 482.13.1 Image Databases . . . . . . . . . . . . . . . . . . . . . . . . 482.13.2 Cross Validation . . . . . . . . . . . . . . . . . . . . . . . . 602.13.3 Parameter Optimization . . . . . . . . . . . . . . . . . . . . 612.13.4 Performance Evaluation . . . . . . . . . . . . . . . . . . . . 622.13.5 Experimental Results . . . . . . . . . . . . . . . . . . . . . . 622.14 Conclusion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 693 Convolutional Neural Network for Blind Image Quality Assessment 773.1 Related Work . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 773.1.1 Blind or Referenceless Image Spatial Quality Evaluator (BRISQUE) 783.1.2 Codebook Representation for No-Reference Image Assessment (CORNIA) . . . . . . . . . . . . . . . . . . . . . . . . 803.1.3 High Order Statistics Aggregation (HOSA) . . . . . . . . . . 813.1.4 Learning from Rankings for NR-IQA and Fine-tuning (RankIQA+FT) 823.2 Convolutional Neural Network . . . . . . . . . . . . . . . . . . . . . 833.2.1 Convolution . . . . . . . . . . . . . . . . . . . . . . . . . . . 843.2.2 Pooling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 853.2.3 Batch Normalization . . . . . . . . . . . . . . . . . . . . . . 853.2.4 Activation functions . . . . . . . . . . . . . . . . . . . . . . 863.3 Proposed Method . . . . . . . . . . . . . . . . . . . . . . . . . . . . 873.4 Implementation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 903.4.1 NNABLA . . . . . . . . . . . . . . . . . . . . . . . . . . . . 913.5 Experimental Results and Discussion . . . . . . . . . . . . . . . . . 933.5.1 Image Databases . . . . . . . . . . . . . . . . . . . . . . . . 933.5.2 Training and Testing . . . . . . . . . . . . . . . . . . . . . . 963.5.3 Performance Evaluation . . . . . . . . . . . . . . . . . . . . 963.5.4 Experimental Results . . . . . . . . . . . . . . . . . . . . . . 963.5.5 Cross validation . . . . . . . . . . . . . . . . . . . . . . . . . 1053.6 Conclusion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1064 Conclusion and Future Work 1074.0.1 Summary of the Research . . . . . . . . . . . . . . . . . . . 1074.0.2 Future Work . . . . . . . . . . . . . . . . . . . . . . . . . . . 108; 指導教員 : 島村徹也
• DOI: 10.24561/00019023; https://doi.org/10.24561/00019023
• Persistent ID (NDL): info:ndljp/pid/11551869; https://dl.ndl.go.jp/pid/11551869
• Collection: 障害者向け資料
• Collection (Materials For Handicapped People:1): テキストデータ
• Collection (particular): 国立国会図書館デジタルコレクション > デジタル化資料 > 博士論文; https://dl.ndl.go.jp/collections/A00014
• Acquisition Basis: 博士論文（自動収集）
• Date Accepted (W3CDTF): 2020-10-06T21:18:06+09:00
• Date Created (W3CDTF): 2020-07-21
• Format (IMT): application/pdf
• Access Restrictions: 国立国会図書館内限定公開
• Service for the Digitized Contents Transmission Service: 図書館・個人送信対象外
• Availability of remote photoduplication service: 可
• Periodical Title (URI): http://dx.doi.org/10.24561/00019023; http://id.nii.ac.jp/1586/00019023/
• Data Provider (Database): 国立国会図書館 : 国立国会図書館デジタルコレクション; https://dl.ndl.go.jp

Table of Contents

2023-09-04 再収集