MUSIQ: Multi-scale Image Quality Transformer

MUSIQ：Transformer多尺度图像质量评估

paper：https://arxiv.org/abs/2108.05997

code：google-research/musiq at master · google-research/google-research · GitHub

本文提出了一种多尺度图像质量Transformer：MUSIQ，它可以处理具有不同分辨率、尺寸和宽高比的全尺寸图像输入，可以捕获不同粒度的图像质量，在多个大规模 IQA数据集上表现SOTA！

Figure 1. In CNN-based models (b), images need to be resized or cropped to a fixed shape for batch training. However, such preprocessing can alter image aspect ratio and composition, thus impacting image quality. Our patch-based MUSIQ model (a) can process the full-size image and extract multi-scale features, which aligns with the human visual system.

摘要

Image quality assessment (IQA) is an important research topic for understanding and improving visual experience. The current state-of-the-art IQA methods are based on convolutional neural networks (CNNs). The performance of CNN-based models is often compromised by the fixed shape constraint in batch training. To accommodate this, the input images are usually resized and cropped to a fixed shape, causing image quality degradation. To address this, we design a multi-scale image quality Transformer (MUSIQ) to process native resolution images with varying sizes and aspect ratios. With a multi-scale image representation, our proposed method can capture image quality at different granularities. Furthermore, a novel hash-based 2D spatial embedding and a scale embedding is proposed to support the positional embedding in the multi-scale representation. Experimental results verify that our method can achieve state-of-the-art performance on multiple large scale IQA datasets such as PaQ-2-PiQ [43], SPAQ [12], and KonIQ10k [17].

ICCV 2021 | 谷歌提出MUSIQ：多尺度图像质量Transformer - 知乎

MUSIQ: Multi-scale Image Quality Transformer【图像质量评估】相关推荐

[2021-ICCV] MUSIQ Multi-scale Image Quality Transformer 论文简析
[2021-ICCV] MUSIQ: Multi-scale Image Quality Transformer 论文简析论文:https://arxiv.org/abs/2108.05997 代码 ...
图像质量评估-BRISQUE
1. 介绍 1.1 什么是图像质量评估Image Quality Assessment (IQA)? 图像质量评价(IQA)算法以任意图像作为输入,输出质量分数作为输出.有三种类型的IQA: 全参考图 ...
超声图像质量评估论文综述
已经开发出许多专用于医学图像后处理的算法,从而提出了有关此类图像评估的根本问题.主观评估是评估医学领域质量的最可靠方法.但是,由于人类观察者必须具有医学背景,因此在医学应用中既费时又困难.客观指标是一 ...
读“基于机器学习的无参考图像质量评估综述”有感
读"基于机器学习的无参考图像质量评估综述"有感摘要: 无参数图像质量评价(NRIQA)因其广泛的应用需求一直以来都是计算机视觉及其交叉领域的研究热点.回顾近十几年来基于机器学习的 ...
《MA‑CRNN: a multi‑scale attention CRNN for Chinese text line recognition in natural scenes》论文阅读
参考博文: CRNN的一个变种,可以读一读,看看相对于CRNN来说有什么变化?以及为什么? 文章目录 make decision step1:读摘要 step2:读Introduction step3 ...
图像质量评估（IQA）基础知识
图像质量评估(IQA)基础知识全参.半参和无参常用衡量标准 http://blog.csdn.net/caoleiwe/article/details/49045633 本研究采用三个常用的性能指 ...
图像质量评估（IQA）——“KonCept512” 论文解读
今天是1024程序员的节日,也是许久没有更新博客了,特地百忙抽空记录一篇博文. 解读之前,论文链接就不放了,网上有比较多的下载资源,先放上该论文的引用信息: Hosu V, Lin H, Sziran ...
图像质量评估指标：MSE，PSNR，SSIM
文章目录 MSE与PSNR的计算方法 MSE与PSNR的问题 SSIM的理念与计算方法理念概念准备公式理解基本元素三原则亮度.对比度.结构的相似度指标设计最终公式程序计算方法计算公式 ...
【论文review+总结】屏幕内容图像质量评估SC-IQA（Screen Content Image Quality Assessment）
目录论文review 2017年论文 2018年论文 2019年论文总结主要思路主要方法总结全参考FR-IQA 弱参考RR-IQA 无参考NR-IQA 多内容(不只局限于SCIs--基于cr ...

MUSIQ: Multi-scale Image Quality Transformer【图像质量评估】

摘要

MUSIQ: Multi-scale Image Quality Transformer【图像质量评估】相关推荐

最新文章

热门文章