语义分割--Global Deconvolutional Networks for Semantic Segmentation

语义分割
Global Deconvolutional Networks for Semantic Segmentation
BMVC 2016
https://github.com/DrSleep/GDN

基于CNN的语义分割在近两年得到飞速的发展，但是这种 pixel-wise labelling with CNNs has its own unique challenges: 特征图的精确放大 + context 信息的嵌入
1）an accurate deconvolution, or upsampling, of low-resolution output into a higher-resolution segmentation mask
2）an inclusion of global information, or context, within locally extracted features

本文提出一个网络结构 Global Deconvolutional Network 解决这两个问题。本文的模型最大亮点是在保持较高精度同时 significantly 降低了模型的参数量

3 Global Deconvolutional Network
3.1 Baseline Models
这里我们选择了两个开源的基准分割模型： FCN-32s and DeepLab ，他们两个都是基于 VGG 16-layer net，将全连接层变为卷积层，目标函数用 pixel-wise softmax loss 表示

3.2 Global Interpolation
输入图像经过一系列卷积和池化后得到一个 encoded image，其尺寸降采样很多。为了输出原始图像尺寸的分割图像，我们需要同时对这个 encoded image 进行 decode and upsample。这里我们设计了一个 a learnable global interpolation

假定 x 表示 decoded information，输入RGB图像为 I , 上采样后的信号为 y

我们的这个上采样不是根据最近的四个点数据信息来计算的，而是包括了更多的信息进来
Opposite to a simple bilinear interpolation, which operates only on the closest four points, the equation above allows to include much more information on the rectangular grid

this operation is differentiable

3.3 Multi-task loss
loss functions 定义如下：

本文提出的每个模型其目的都是为了提取全局信息，将其嵌入到网络中去。本文提出的这个插值方法也是有效的上采样方法。
Overall, each component of the proposed approach aims to capture global information and incorporate it into the network, hence the name global deconvolutional network. Besides that, the proposed interpolation also effectively upsamples the coarse output and a nonlinear upsampling can be achieved with the addition of an activation function on the top of the block.

4 Experiments

语义分割--Global Deconvolutional Networks for Semantic Segmentation相关推荐

语义分割--Full-Resolution Residual Networks for Semantic Segmentation in Street Scenes
Full-Resolution Residual Networks for Semantic Segmentation in Street Scenes CVPR2017 Theano/Lasagne ...
语义分割-Unsupervised Domain Adaptation in Semantic Segmentation：a Review语义分割中的无监督领域自适应：综述
Unsupervised Domain Adaptation in Semantic Segmentation:a Review语义分割中的无监督领域自适应:综述 0.摘要 1.介绍 1.1.语义分割 ...
语义分割CVPR2020-Unsupervised Intra-domain Adaptation for Semantic Segmentation through Self-Supervision
Unsupervised Intra-domain Adaptation for Semantic Segmentation through Self-Supervision:基于自监督的非监督域内自 ...
【图像语义分割】Large Kernel Maters--Improved Semantic Segmentation by Global ConvNet
该篇文章是face++的文章,个人觉得相当严谨摘要: 目前流行的网络架构往往通过堆积小的卷积核(stack small filters),因为在相同计算量下,stack small filters往 ...
语义分割--DeconvNet--Learning Deconvolution Network for Semantic Segmentation
Learning Deconvolution Network for Semantic Segmentation ICCV2015 http://cvlab.postech.ac.kr/researc ...
语义分割--Mix-and-Match Tuning for Self-Supervised Semantic Segmentation
Mix-and-Match Tuning for Self-Supervised Semantic Segmentation AAAI Conference on Artificial Intelli ...
语义分割--Fully Convolutional DenseNets for Semantic Segmentation
The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentation CVPRW 2017 ...
[轻量化语义分割] Rethinking BiSeNet For Real-time Semantic Segmentation（CVPR2021）
paper:https://openaccess.thecvf.com/content/CVPR2021/papers/Fan_Rethinking_BiSeNet_for_Real-Time_Sem ...
语义分割--Pixel Deconvolutional Networks
Pixel Deconvolutional Networks https://arxiv.org/abs/1705.06820 本文首先指出在常规的 deconvolutional operation ...

语义分割--Global Deconvolutional Networks for Semantic Segmentation

语义分割--Global Deconvolutional Networks for Semantic Segmentation相关推荐

最新文章

热门文章