【盘点影响计算机视觉Top100论文】从ResNet到AlexNet(吴琦博士论文《具有中间属性层的图像说明》入选)

GitHub · 2017年08月22日

计算机视觉近年来获得了较大的发展,代表了深度学习最前沿的研究方向。本文梳理了2012到2017年计算机视觉领域的大事件:以论文和其他干货资源为主,并附上资源地址。囊括上百篇论文,分ImageNet 分类、物体检测、物体追踪、物体识别、图像与语言和图像生成等多个方向进行介绍。

上述的深度学习被引用最多的100篇论文是Github上的一个开源项目,社区的成员都可以参与。在这个项目上,我们发现了另一个项目——Deep Vision,这是一个关于计算机视觉资源的项目,包含了近年来对该领域影响最大的论文、图书和博客等的汇总。其中在论文部分,作者也分为ImageNet 分类、物体检测、物体追踪、物体识别、图像与语言和图像生成等多个方向进行介绍。

经典论文



ImageNet分类
物体检测
物体跟踪
低级视觉 边缘检测
语义分割
视觉注意力和显著性
物体识别
人体姿态估计
CNN原理和性质(Understanding CNN)
图像和语言


上面是根据这些论文、作者、机构的一些关键词制作的热图。

ImageNet分类


图片来源:AlexNet论文

论文:用于图像识别的深度残差网络
作者:何恺明、张祥雨、任少卿和孙剑
链接(复制后可以在浏览器中打开查看):http://arxiv.org/pdf/1512.03385v1.pdf

论文:深入学习整流器:在ImageNet分类上超越人类水平
作者:何恺明、张祥雨、任少卿和孙剑
链接:https://arxiv.org/pdf/1502.01852.pdf

论文:批量归一化:通过减少内部协变量来加速深度网络训练
作者:Sergey Ioffe, Christian Szegedy
链接:https://arxiv.org/pdf/1502.03167.pdf

论文:更深的卷积,CVPR 2015
作者:Christian Szegedy, Wei Liu, Yangqing Jia, Pierre Sermanet, Scott Reed, Dragomir Anguelov, Dumitru Erhan, Vincent Vanhoucke, Andrew Rabinovich
链接:https://arxiv.org/pdf/1409.4842.pdf

论文:大规模视觉识别中的极深卷积网络,ICLR 2015
作者:Karen Simonyan & Andrew Zisserman
链接:https://arxiv.org/pdf/1409.1556.pdf

论文:使用深度卷积神经网络进行ImageNet分类
作者:Alex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton
链接:http://papers.nips.cc/paper/4824-imagenet-classification-with-deep-convolutional-neural-networks.pdf

物体检测


图片来源:Faster-RCNN 论文

论文:用于实时物体检测的深度轻量神经网络(PVANET:Deep but Lightweight Neural Networks for Real-time Object Detection)
作者:Kye-Hyeon Kim, Sanghoon Hong, Byungseok Roh, Yeongjae Cheon, Minje Park
链接:https://arxiv.org/pdf/1608.08021

论文:使用卷积网络进行识别、定位和检测(OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks),ICLR 2014
作者:Pierre Sermanet, David Eigen, Xiang Zhang, Michael Mathieu, Rob Fergus, Yann LeCun
链接:https://arxiv.org/pdf/1312.6229.pdf

论文:精确物体检测和语义分割的丰富特征层次结构(Rich feature hierarchies for accurate object detection and semantic segmentation),CVPR 2014
作者:Ross Girshick, Jeff Donahue, Trevor Darrell, Jitendra Malik
链接:http://www.cv-foundation.org/openaccess/content_cvpr_2014/papers/Girshick_Rich_Feature_Hierarchies_2014_CVPR_paper.pdf

论文:视觉识别深度卷积网络中的空间金字塔池化(Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition),ECCV 2014
作者:何恺明、张祥雨、任少卿和孙剑
链接:https://arxiv.org/pdf/1406.4729.pdf

论文:Fast R-CNN
作者:Ross Girshick
链接:https://arxiv.org/pdf/1504.08083.pdf

论文:使用RPN走向实时物体检测(Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks)
作者:任少卿、何恺明、Ross Girshick、孙剑
链接:https://arxiv.org/pdf/1506.01497.pdf

论文:R-CNN minus R
作者:Karel Lenc, Andrea Vedaldi
链接:https://arxiv.org/pdf/1506.06981.pdf

论文:密集场景中端到端的行人检测(End-to-end People Detection in Crowded Scenes)
作者:Russell Stewart, Mykhaylo Andriluka
链接:https://arxiv.org/pdf/1506.04878.pdf

论文:你只看一次:统一实时物体检测(You Only Look Once: Unified, Real-Time Object Detection)
作者:Joseph Redmon, Santosh Divvala, Ross Girshick, Ali Farhadi
链接:https://arxiv.org/pdf/1506.02640.pdf

论文:使用跳跃池化和RNN在场景中检测物体(Inside-Outside Net: Detecting Objects in Context with Skip Pooling and Recurrent Neural Networks)
作者:Sean Bell, C. Lawrence Zitnick, Kavita Bala, Ross Girshick
链接:https://arxiv.org/abs/1512.04143.pdf

论文:用于图像识别的深度残差网络
作者:何恺明、张祥雨、任少卿和孙剑
链接:http://arxiv.org/pdf/1512.03385v1.pdf

论文:通过区域全卷积网络进行物体识别(R-FCN: Object Detection via Region-based Fully Convolutional Networks)
作者:代季峰,李益,何恺明,孙剑
链接:https://arxiv.org/abs/1605.06409

论文:单次多框检测器(SSD: Single Shot MultiBox Detector)
作者:Wei Liu, Dragomir Anguelov, Dumitru Erhan, Christian Szegedy, Scott Reed, Cheng-Yang Fu, Alexander C. Berg
链接:https://arxiv.org/pdf/1512.02325v2.pdf

论文:现代卷积物体检测器的速度/精度权衡(Speed/accuracy trade-offs for modern convolutional object detectors)
作者:Jonathan Huang, Vivek Rathod, Chen Sun, Menglong Zhu, Anoop Korattikara, Alireza Fathi, Ian Fischer, Zbigniew Wojna, Yang Song, Sergio Guadarrama, Kevin Murphy
链接:https://arxiv.org/pdf/1611.10012v1.pdf

物体跟踪

论文:用卷积神经网络通过学习可区分的显著性地图实现在线跟踪(Online Tracking by Learning Discriminative Saliency Map with Convolutional Neural Network)
作者:Seunghoon Hong, Tackgeun You, Suha Kwak, Bohyung Han
地址:arXiv:1502.06796.

论文:DeepTrack:通过视觉跟踪的卷积神经网络学习辨别特征表征(DeepTrack: Learning Discriminative Feature Representations by Convolutional Neural Networks for Visual Tracking)
作者:Hanxi Li, Yi Li and Fatih Porikli
发表: BMVC, 2014.

论文:视觉跟踪中,学习深度紧凑图像表示(Learning a Deep Compact Image Representation for Visual Tracking)
作者:N Wang, DY Yeung
发表:NIPS, 2013.

论文:视觉跟踪的分层卷积特征(Hierarchical Convolutional Features for Visual Tracking)
作者:Chao Ma, Jia-Bin Huang, Xiaokang Yang and Ming-Hsuan Yang
发表: ICCV 2015

论文:完全卷积网络的视觉跟踪(Visual Tracking with fully Convolutional Networks)
作者:Lijun Wang, Wanli Ouyang, Xiaogang Wang, and Huchuan Lu,
发表:ICCV 2015

论文:学习多域卷积神经网络进行视觉跟踪
(Learning Multi-Domain Convolutional Neural Networks for Visual Tracking)
作者:Hyeonseob Namand Bohyung Han

对象识别(Object Recognition)

论文:卷积神经网络弱监督学习(Weakly-supervised learning with convolutional neural networks)
作者:Maxime Oquab,Leon Bottou,Ivan Laptev,Josef Sivic,CVPR,2015
链接:http://www.cv-foundation.org/openaccess/content_cvpr_2015/papers/Oquab_Is_Object_Localization_2015_CVPR_paper.pdf

论文:深度滤波器组用于纹理识别和分割(Deep Filter Banks for Texture Recognition and Segmentation)
作者:Mircea Cimpoi, Subhransu Maji, Andrea Vedaldi, CVPR, 2015.
链接:http://www.cv-foundation.org/openaccess/content_cvpr_2015/papers/Cimpoi_Deep_Filter_Banks_2015_CVPR_paper.pdf

人体姿态估计(Human Pose Estimation)

论文:使用 Part Affinity Field的实时多人2D姿态估计(Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields)
作者:Zhe Cao, Tomas Simon, Shih-En Wei, and Yaser Sheikh, CVPR, 2017.

论文:Deepcut:多人姿态估计的联合子集分割和标签(Deepcut: Joint subset partition and labeling for multi person pose estimation)
作者:Leonid Pishchulin, Eldar Insafutdinov, Siyu Tang, Bjoern Andres, Mykhaylo Andriluka, Peter Gehler, and Bernt Schiele, CVPR, 2016.

论文:Convolutional pose machines
作者:Shih-En Wei, Varun Ramakrishna, Takeo Kanade, and Yaser Sheikh, CVPR, 2016.

论文:人体姿态估计的 Stacked hourglass networks(Stacked hourglass networks for human pose estimation)
作者:Alejandro Newell, Kaiyu Yang, and Jia Deng, ECCV, 2016.

论文:用于视频中人体姿态估计的Flowing convnets(Flowing convnets for human pose estimation in videos)
作者:Tomas Pfister, James Charles, and Andrew Zisserman, ICCV, 2015.

论文:卷积网络和人类姿态估计图模型的联合训练(Joint training of a convolutional network and a graphical model for human pose estimation)
作者:Jonathan J. Tompson, Arjun Jain, Yann LeCun, Christoph Bregler, NIPS, 2014.

理解CNN

图:(from Aravindh Mahendran, Andrea Vedaldi, Understanding Deep Image Representations by Inverting Them, CVPR, 2015.

论文:通过测量同变性和等价性来理解图像表示(Understanding image representations by measuring their equivariance and equivalence)
作者:Karel Lenc, Andrea Vedaldi, CVPR, 2015.
链接:http://www.cv-foundation.org/openaccess/content_cvpr_2015/papers/Lenc_Understanding_Image_Representations_2015_CVPR_paper.pdf

论文:深度神经网络容易被愚弄:无法识别的图像的高置信度预测(Deep Neural Networks are Easily Fooled:High Confidence Predictions for Unrecognizable Images)
作者:Anh Nguyen, Jason Yosinski, Jeff Clune, CVPR, 2015.
链接:http://www.cv-foundation.org/openaccess/content_cvpr_2015/papers/Nguyen_Deep_Neural_Networks_2015_CVPR_paper.pdf

论文:通过反演理解深度图像表示(Understanding Deep Image Representations by Inverting Them)
作者:Aravindh Mahendran, Andrea Vedaldi, CVPR, 2015
链接:http://www.cv-foundation.org/openaccess/content_cvpr_2015/papers/Mahendran_Understanding_Deep_Image_2015_CVPR_paper.pdf

论文:深度场景CNN中的对象检测器(Object Detectors Emerge in Deep Scene CNNs)
作者:Bolei Zhou, Aditya Khosla, Agata Lapedriza, Aude Oliva, Antonio Torralba, ICLR, 2015.
链接:http://arxiv.org/abs/1412.6856

论文:用卷积网络反演视觉表示(Inverting Visual Representations with Convolutional Networks)
作者:Alexey Dosovitskiy, Thomas Brox, arXiv, 2015.
链接:http://arxiv.org/abs/1506.02753

论文:可视化和理解卷积网络(Visualizing and Understanding Convolutional Networks)
作者:Matthrew Zeiler, Rob Fergus, ECCV, 2014.
链接:https://www.cs.nyu.edu/~fergus/papers/zeilerECCV2014.pdf

理解CNN

图像说明(Image Captioning)

图:(from Andrej Karpathy, Li Fei-Fei, Deep Visual-Semantic Alignments for Generating Image Description, CVPR, 2015.)

UCLA / Baidu
用多模型循环神经网络解释图像(Explain Images with Multimodal Recurrent Neural Networks)
Junhua Mao, Wei Xu, Yi Yang, Jiang Wang, Alan L. Yuille, arXiv:1410.1090
http://arxiv.org/pdf/1410.1090

Toronto
使用多模型神经语言模型统一视觉语义嵌入(Unifying Visual-Semantic Embeddings with Multimodal Neural Language Models)
Ryan Kiros, Ruslan Salakhutdinov, Richard S. Zemel, arXiv:1411.2539.
http://arxiv.org/pdf/1411.2539

Berkeley
用于视觉识别和描述的长期循环卷积网络(Long-term Recurrent Convolutional Networks for Visual Recognition and Description)
Jeff Donahue, Lisa Anne Hendricks, Sergio Guadarrama, Marcus Rohrbach, Subhashini Venugopalan, Kate Saenko, Trevor Darrell, arXiv:1411.4389.
http://arxiv.org/pdf/1411.4389

Google
看图写字:神经图像说明生成器(Show and Tell: A Neural Image Caption Generator)
Oriol Vinyals, Alexander Toshev, Samy Bengio, Dumitru Erhan, arXiv:1411.4555.
http://arxiv.org/pdf/1411.4555

Stanford
用于生成图像描述的深度视觉语义对齐(Deep Visual-Semantic Alignments for Generating Image Description)
Andrej Karpathy, Li Fei-Fei, CVPR, 2015.
Web:http://cs.stanford.edu/people/karpathy/deepimagesent/
Paper:http://cs.stanford.edu/people/karpathy/cvpr2015.pdf

UML / UT
使用深度循环神经网络将视频转换为自然语言(Translating Videos to Natural Language Using Deep Recurrent Neural Networks)
Subhashini Venugopalan, Huijuan Xu, Jeff Donahue, Marcus Rohrbach, Raymond Mooney, Kate Saenko, NAACL-HLT, 2015.
http://arxiv.org/pdf/1412.4729

CMU / Microsoft
学习图像说明生成的循环视觉表示(Learning a Recurrent Visual Representation for Image Caption Generation)
Xinlei Chen, C. Lawrence Zitnick, arXiv:1411.5654.
Xinlei Chen, C. Lawrence Zitnick, Mind’s Eye: A Recurrent Visual Representation for Image Caption Generation, CVPR 2015
http://www.cs.cmu.edu/~xinleic/papers/cvpr15_rnn.pdf

Microsoft
从图像说明到视觉概念(From Captions to Visual Concepts and Back)
Hao Fang, Saurabh Gupta, Forrest Iandola, Rupesh Srivastava, Li Deng, Piotr Dollár, Jianfeng Gao, Xiaodong He, Margaret Mitchell, John C. Platt, C. Lawrence Zitnick, Geoffrey Zweig, CVPR, 2015.
http://arxiv.org/pdf/1411.4952

Univ. Montreal / Univ. Toronto
Show, Attend, and Tell:视觉注意力与神经图像标题生成(Show, Attend, and Tell: Neural Image Caption Generation with Visual Attention)
Kelvin Xu, Jimmy Lei Ba, Ryan Kiros, Kyunghyun Cho, Aaron Courville, Ruslan Salakhutdinov, Richard S. Zemel, Yoshua Bengio, arXiv:1502.03044 / ICML 2015
http://www.cs.toronto.edu/~zemel/documents/captionAttn.pdf

Idiap / EPFL / Facebook
基于短语的图像说明(Phrase-based Image Captioning)
Remi Lebret, Pedro O. Pinheiro, Ronan Collobert, arXiv:1502.03671 / ICML 2015
http://arxiv.org/pdf/1502.03671

UCLA / Baidu
像孩子一样学习:从图像句子描述快速学习视觉的新概念(Learning like a Child: Fast Novel Visual Concept Learning from Sentence Descriptions of Images)
Junhua Mao, Wei Xu, Yi Yang, Jiang Wang, Zhiheng Huang, Alan L. Yuille, arXiv:1504.06692
http://arxiv.org/pdf/1504.06692

MS + Berkeley

探索图像说明的最近邻方法( Exploring Nearest Neighbor Approaches for Image Captioning)
Jacob Devlin, Saurabh Gupta, Ross Girshick, Margaret Mitchell, C. Lawrence Zitnick, arXiv:1505.04467
http://arxiv.org/pdf/1505.04467.pdf

图像说明的语言模型(Language Models for Image Captioning: The Quirks and What Works)
Jacob Devlin, Hao Cheng, Hao Fang, Saurabh Gupta, Li Deng, Xiaodong He, Geoffrey Zweig, Margaret Mitchell, arXiv:1505.01809
http://arxiv.org/pdf/1505.01809.pdf

阿德莱德
具有中间属性层的图像说明( Image Captioning with an Intermediate Attributes Layer)
Qi Wu, Chunhua Shen, Anton van den Hengel, Lingqiao Liu, Anthony Dick, arXiv:1506.01144

蒂尔堡
通过图片学习语言(Learning language through pictures)
Grzegorz Chrupala, Akos Kadar, Afra Alishahi, arXiv:1506.03694

蒙特利尔大学
使用基于注意力的编码器-解码器网络描述多媒体内容(Describing Multimedia Content using Attention-based Encoder-Decoder Networks)
Kyunghyun Cho, Aaron Courville, Yoshua Bengio, arXiv:1507.01053

康奈尔
图像表示和神经图像说明的新领域(Image Representations and New Domains in Neural Image Captioning)
Jack Hessel, Nicolas Savva, Michael J. Wilber, arXiv:1508.02091

MS + City Univ. of HongKong
Learning Query and Image Similarities with Ranking Canonical Correlation Analysis
Ting Yao, Tao Mei, and Chong-Wah Ngo, ICCV, 2015

视频字幕(Video Captioning)

伯克利
Jeff Donahue, Lisa Anne Hendricks, Sergio Guadarrama, Marcus Rohrbach, Subhashini Venugopalan, Kate Saenko, Trevor Darrell, Long-term Recurrent Convolutional Networks for Visual Recognition and Description, CVPR, 2015.

犹他州/ UML / 伯克利
Subhashini Venugopalan, Huijuan Xu, Jeff Donahue, Marcus Rohrbach, Raymond Mooney, Kate Saenko, Translating Videos to Natural Language Using Deep Recurrent Neural Networks, arXiv:1412.4729.

微软
Yingwei Pan, Tao Mei, Ting Yao, Houqiang Li, Yong Rui, Joint Modeling Embedding and Translation to Bridge Video and Language, arXiv:1505.01861.

犹他州/ UML / 伯克利
Subhashini Venugopalan, Marcus Rohrbach, Jeff Donahue, Raymond Mooney, Trevor Darrell, Kate Saenko, Sequence to Sequence--Video to Text, arXiv:1505.00487.

蒙特利尔大学/ 舍布鲁克
Li Yao, Atousa Torabi, Kyunghyun Cho, Nicolas Ballas, Christopher Pal, Hugo Larochelle, Aaron Courville, Describing Videos by Exploiting Temporal Structure, arXiv:1502.08029

MPI / 伯克利
Anna Rohrbach, Marcus Rohrbach, Bernt Schiele, The Long-Short Story of Movie Description, arXiv:1506.01698

多伦多大学 / MIT
Yukun Zhu, Ryan Kiros, Richard Zemel, Ruslan Salakhutdinov, Raquel Urtasun, Antonio Torralba, Sanja Fidler, Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Books, arXiv:1506.06724

蒙特利尔大学
Kyunghyun Cho, Aaron Courville, Yoshua Bengio, Describing Multimedia Content using Attention-based Encoder-Decoder Networks, arXiv:1507.01053

TAU / 美国南加州大学
Dotan Kaufman, Gil Levi, Tal Hassner, Lior Wolf, Temporal Tessellation for Video Annotation and Summarization, arXiv:1612.06950.

图像生成

卷积/循环网络

论文:Conditional Image Generation with PixelCNN Decoders”
作者:Aäron van den Oord, Nal Kalchbrenner, Oriol Vinyals, Lasse Espeholt, Alex Graves, Koray Kavukcuoglu

论文:Learning to Generate Chairs with Convolutional Neural Networks
作者:Alexey Dosovitskiy, Jost Tobias Springenberg, Thomas Brox
发表:CVPR, 2015.

论文:DRAW: A Recurrent Neural Network For Image Generation
作者:Karol Gregor, Ivo Danihelka, Alex Graves, Danilo Jimenez Rezende, Daan Wierstra
发表:ICML, 2015.

对抗网络

论文:生成对抗网络(Generative Adversarial Networks)
作者:Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, Yoshua Bengio
发表:NIPS, 2014.

论文:使用对抗网络Laplacian Pyramid 的深度生成图像模型(Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks)
作者:Emily Denton, Soumith Chintala, Arthur Szlam, Rob Fergus
发表:NIPS, 2015.

论文:生成模型演讲概述 (A note on the evaluation of generative models)
作者:Lucas Theis, Aäron van den Oord, Matthias Bethge
发表:ICLR 2016.

论文:变分自动编码深度高斯过程(Variationally Auto-Encoded Deep Gaussian Processes)
作者:Zhenwen Dai, Andreas Damianou, Javier Gonzalez, Neil Lawrence
发表:ICLR 2016.

论文:用注意力机制从字幕生成图像 (Generating Images from Captions with Attention)
作者:Elman Mansimov, Emilio Parisotto, Jimmy Ba, Ruslan Salakhutdinov
发表: ICLR 2016

论文:分类生成对抗网络的无监督和半监督学习(Unsupervised and Semi-supervised Learning with Categorical Generative Adversarial Networks)
作者:Jost Tobias Springenberg
发表:ICLR 2016

论文:用一个对抗检测表征(Censoring Representations with an Adversary)
作者:Harrison Edwards, Amos Storkey
发表:ICLR 2016

论文:虚拟对抗训练实现分布式顺滑 (Distributional Smoothing with Virtual Adversarial Training)
作者:Takeru Miyato, Shin-ichi Maeda, Masanori Koyama, Ken Nakae, Shin Ishii
发表:ICLR 2016

论文:自然图像流形上的生成视觉操作(Generative Visual Manipulation on the Natural Image Manifold)
作者:朱俊彦, Philipp Krahenbuhl, Eli Shechtman, and Alexei A. Efros
发表: ECCV 2016.

论文:深度卷积生成对抗网络的无监督表示学习(Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks)
作者:Alec Radford, Luke Metz, Soumith Chintala
发表: ICLR 2016

问题回答

图:(from Stanislaw Antol, Aishwarya Agrawal, Jiasen Lu, Margaret Mitchell, Dhruv Batra, C. Lawrence Zitnick, Devi Parikh, VQA: Visual Question Answering, CVPR, 2015 SUNw:Scene Understanding workshop)

弗吉尼亚大学 / 微软研究院
论文:VQA: Visual Question Answering, CVPR, 2015 SUNw:Scene Understanding workshop.
作者:Stanislaw Antol, Aishwarya Agrawal, Jiasen Lu, Margaret Mitchell, Dhruv Batra, C. Lawrence Zitnick, Devi Parikh

MPI / 伯克利
论文:Ask Your Neurons: A Neural-based Approach to Answering Questions about Images
作者:Mateusz Malinowski, Marcus Rohrbach, Mario Fritz,
发布 : arXiv:1505.01121.

多伦多
论文: Image Question Answering: A Visual Semantic Embedding Model and a New Dataset
作者:Mengye Ren, Ryan Kiros, Richard Zemel
发表: arXiv:1505.02074 / ICML 2015 deep learning workshop.

百度/ 加州大学洛杉矶分校
作者:Hauyuan Gao, Junhua Mao, Jie Zhou, Zhiheng Huang, Lei Wang, 徐伟
论文:Are You Talking to a Machine? Dataset and Methods for Multilingual Image Question Answering
发表: arXiv:1505.05612.

POSTECH(韩国)
论文:Image Question Answering using Convolutional Neural Network with Dynamic Parameter Prediction
作者:Hyeonwoo Noh, Paul Hongsuck Seo, and Bohyung Han
发表: arXiv:1511.05765

CMU / 微软研究院
论文:Stacked Attention Networks for Image Question Answering
作者:Yang, Z., He, X., Gao, J., Deng, L., & Smola, A. (2015)
发表: arXiv:1511.02274.

MetaMind
论文:Dynamic Memory Networks for Visual and Textual Question Answering
作者:Xiong, Caiming, Stephen Merity, and Richard Socher
发表: arXiv:1603.01417 (2016).

首尔国立大学 + NAVER
论文:Multimodal Residual Learning for Visual QA
作者:Jin-Hwa Kim, Sang-Woo Lee, Dong-Hyun Kwak, Min-Oh Heo, Jeonghee Kim, Jung-Woo Ha, Byoung-Tak Zhang
发表:arXiv:1606:01455

UC Berkeley + 索尼
论文:Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Grounding
作者:Akira Fukui, Dong Huk Park, Daylen Yang, Anna Rohrbach, Trevor Darrell, and Marcus Rohrbach
发表:arXiv:1606.01847

Postech
论文:Training Recurrent Answering Units with Joint Loss Minimization for VQA
作者:Hyeonwoo Noh and Bohyung Han
发表: arXiv:1606.03647

首尔国立大学 + NAVER
论文: Hadamard Product for Low-rank Bilinear Pooling
作者:Jin-Hwa Kim, Kyoung Woon On, Jeonghee Kim, Jung-Woo Ha, Byoung-Tak Zhan
发表:arXiv:1610.04325.

视觉注意力和显著性


论文:Predicting Eye Fixations using Convolutional Neural Networks
作者:Nian Liu, Junwei Han, Dingwen Zhang, Shifeng Wen, Tianming Liu
发表:CVPR, 2015.

作者:Learning a Sequential Search for Landmarks
论文:Saurabh Singh, Derek Hoiem, David Forsyth
发表:CVPR, 2015.

论文:Multiple Object Recognition with Visual Attention
作者:Jimmy Lei Ba, Volodymyr Mnih, Koray Kavukcuoglu,
发表:ICLR, 2015.

作者:Volodymyr Mnih, Nicolas Heess, Alex Graves, Koray Kavukcuoglu
论文:Recurrent Models of Visual Attention
发表:NIPS, 2014.

低级视觉

超分辨率

Sven Behnke: Learning Iterative Image Reconstruction. IJCAI, 2001. Sven Behnke: Learning Iterative Image Reconstruction in the Neural Abstraction Pyramid. International Journal of Computational Intelligence and Applications, vol. 1, no. 4, pp. 427-438, 2001.

Chao Dong, Chen Change Loy, Kaiming He, Xiaoou Tang, Learning a Deep Convolutional Network for Image Super-Resolution, ECCV, 2014.
Chao Dong, Chen Change Loy, Kaiming He, Xiaoou Tang, Image Super-Resolution Using Deep Convolutional Networks, arXiv:1501.00092.

Jiwon Kim, Jung Kwon Lee, Kyoung Mu Lee, Accurate Image Super-Resolution Using Very Deep Convolutional Networks, arXiv:1511.04587, 2015.

Jiwon Kim, Jung Kwon Lee, Kyoung Mu Lee, Deeply-Recursive Convolutional Network for Image Super-Resolution, arXiv:1511.04491, 2015.

Zhaowen Wang, Ding Liu, Wei Han, Jianchao Yang and Thomas S. Huang, Deep Networks for Image Super-Resolution with Sparse Prior. ICCV, 2015.

Justin Johnson, Alexandre Alahi, Li Fei-Fei, Perceptual Losses for Real-Time Style Transfer and Super-Resolution, arXiv:1603.08155, 2016.

Christian Ledig, Lucas Theis, Ferenc Huszar, Jose Caballero, Andrew Cunningham, Alejandro Acosta, Andrew Aitken, Alykhan Tejani, Johannes Totz, Zehan Wang, Wenzhe Shi, Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network, arXiv:1609.04802v3, 2016.

其他应用

Philipp Fischer, Alexey Dosovitskiy, Eddy Ilg, Philip Häusser, Caner Hazırbaş, Vladimir Golkov, Patrick van der Smagt, Daniel Cremers, Thomas Brox, FlowNet: Learning Optical Flow with Convolutional Networks, arXiv:1504.06852.

Philipp Fischer, Alexey Dosovitskiy, Eddy Ilg, Philip Häusser, Caner Hazırbaş, Vladimir Golkov, Patrick van der Smagt, Daniel Cremers, Thomas Brox, FlowNet: Learning Optical Flow with Convolutional Networks, arXiv:1504.06852.

Chao Dong, Yubin Deng, Chen Change Loy, Xiaoou Tang, Compression Artifacts Reduction by a Deep Convolutional Network, arXiv:1504.06993.

Christian J. Schuler, Michael Hirsch, Stefan Harmeling, Bernhard Schölkopf, Learning to Deblur, arXiv:1406.7444
Jian Sun, Wenfei Cao, Zongben Xu, Jean Ponce, Learning a Convolutional Neural Network for Non-uniform Motion Blur Removal, CVPR, 2015

Li Xu, Jimmy SJ. Ren, Ce Liu, Jiaya Jia, Deep Convolutional Neural Network for Image Deconvolution, NIPS, 2014.

Li Xu, Jimmy SJ. Ren, Qiong Yan, Renjie Liao, Jiaya Jia, Deep Edge-Aware Filters, ICML, 2015.

Jure Žbontar, Yann LeCun, Computing the Stereo Matching Cost with a Convolutional Neural Network, CVPR, 2015.

Deepak Pathak, Philipp Krahenbuhl, Jeff Donahue, Trevor Darrell, Alexei A. Efros, Context Encoders: Feature Learning by Inpainting, CVPR, 2016

边缘检测

Saining Xie, Zhuowen Tu, Holistically-Nested Edge Detection, arXiv:1504.06375.

Gedas Bertasius, Jianbo Shi, Lorenzo Torresani, DeepEdge: A Multi-Scale Bifurcated Deep Network for Top-Down Contour Detection, CVPR, 2015.

Wei Shen, Xinggang Wang, Yan Wang, Xiang Bai, Zhijiang Zhang, DeepContour: A Deep Convolutional Feature Learned by Positive-Sharing Loss for Contour Detection, CVPR, 2015.

语义分割

图片来源:BoxSup论文

Alexander Kolesnikov, Christoph Lampert, Seed, Expand and Constrain: Three Principles for Weakly-Supervised Image Segmentation, ECCV, 2016.

Guosheng Lin, Chunhua Shen, Ian Reid, Anton van dan Hengel, Efficient piecewise training of deep structured models for semantic segmentation, arXiv:1504.01013. (1st ranked in VOC2012)
Guosheng Lin, Chunhua Shen, Ian Reid, Anton van den Hengel, Deeply Learning the Messages in Message Passing Inference, arXiv:1508.02108. (4th ranked in VOC2012)

Ziwei Liu, Xiaoxiao Li, Ping Luo, Chen Change Loy, Xiaoou Tang, Semantic Image Segmentation via Deep Parsing Network, arXiv:1509.02634 / ICCV 2015 (2nd ranked in VOC 2012)

Iasonas Kokkinos, Surpassing Humans in Boundary Detection using Deep Learning, arXiv:1411.07386 (4th ranked in VOC 2012)

Jifeng Dai, Kaiming He, Jian Sun, BoxSup: Exploiting Bounding Boxes to Supervise Convolutional Networks for Semantic Segmentation, arXiv:1503.01640. (6th ranked in VOC2012)

Hyeonwoo Noh, Seunghoon Hong, Bohyung Han, Learning Deconvolution Network for Semantic Segmentation, arXiv:1505.04366. (7th ranked in VOC2012)
Seunghoon Hong, Hyeonwoo Noh, Bohyung Han, Decoupled Deep Neural Network for Semi-supervised Semantic Segmentation, arXiv:1506.04924.
Seunghoon Hong,Junhyuk Oh, Bohyung Han, and Honglak Lee, Learning Transferrable Knowledge for Semantic Segmentation with Deep Convolutional Neural Network, arXiv:1512.07928

Shuai Zheng, Sadeep Jayasumana, Bernardino Romera-Paredes, Vibhav Vineet, Zhizhong Su, Dalong Du, Chang Huang, Philip H. S. Torr, Conditional Random Fields as Recurrent Neural Networks, arXiv:1502.03240. (8th ranked in VOC2012)

Liang-Chieh Chen, George Papandreou, Kevin Murphy, Alan L. Yuille, Weakly-and semi-supervised learning of a DCNN for semantic image segmentation, arXiv:1502.02734. (9th ranked in VOC2012)

Mohammadreza Mostajabi, Payman Yadollahpour, Gregory Shakhnarovich, Feedforward Semantic Segmentation With Zoom-Out Features, CVPR, 2015

Holger Caesar, Jasper Uijlings, Vittorio Ferrari, Joint Calibration for Semantic Segmentation, arXiv:1507.01581.

Jonathan Long, Evan Shelhamer, Trevor Darrell, Fully Convolutional Networks for Semantic Segmentation, CVPR, 2015.

Bharath Hariharan, Pablo Arbelaez, Ross Girshick, Jitendra Malik, Hypercolumns for Object Segmentation and Fine-Grained Localization, CVPR, 2015.

Abhishek Sharma, Oncel Tuzel, David W. Jacobs, Deep Hierarchical Parsing for Semantic Segmentation, CVPR, 2015.

Clement Farabet, Camille Couprie, Laurent Najman, Yann LeCun, Scene Parsing with Multiscale Feature Learning, Purity Trees, and Optimal Covers, ICML, 2012.
Clement Farabet, Camille Couprie, Laurent Najman, Yann LeCun, Learning Hierarchical Features for Scene Labeling, PAMI, 2013.

Vijay Badrinarayanan, Alex Kendall and Roberto Cipolla "SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation." arXiv preprint arXiv:1511.00561, 2015.

Fisher Yu, Vladlen Koltun, "Multi-Scale Context Aggregation by Dilated Convolutions", ICLR 2016

Hamid Izadinia, Fereshteh Sadeghi, Santosh Kumar Divvala, Yejin Choi, Ali Farhadi, "Segment-Phrase Table for Semantic Segmentation, Visual Entailment and Paraphrasing", ICCV, 2015

Iasonas Kokkinos, "Pusing the Boundaries of Boundary Detection Using deep Learning", ICLR 2016

Niloufar Pourian, S. Karthikeyan, and B.S. Manjunath, "Weakly supervised graph based semantic segmentation by learning communities of image-parts", ICCV, 2015