Paper Showcase & Work

2022

Assessing a Single Image in Reference-Guided Image Synthesis

Assessing a Single Image in Reference-Guided Image Synthesis. Jiayi Guo, Chaoqun Du, Jiangshan Wang, Huijuan Huang, Pengfei Wan, Gao Huang. AAAI Conference on Artificial Intelligence (AAAI), 2022.

2021

On the Integration of Self-Attention and Convolution

On the Integration of Self-Attention and Convolution. Xuran Pan, Chunjiang Ge, Rui Lu, Shiji Song, Guanfu Chen, Zeyi Huang, Gao Huang. Arxiv Preprint 2021.

Architecture DesignVision Transformer

Not All Images are Worth 16x16 Words: Dynamic Vision Transformers with Adaptive Sequence Length

Not All Images are Worth 16x16 Words: Dynamic Transformers for Efficient Image Recognition. Yulin Wang*, Rui Huang*, Shiji Song, Zeyi Huang, Gao Huang. Neural Information Processing Systems (NeurIPS) 2021.

Dynamic neural networksVision Transformer

Adaptive Focus for Efficient Video Recognition

Adaptive Focus for Efficient Video Recognition. Yulin Wang*, Zhaoxi Chen*, Haojun Jiang, Shiji Song, Yizeng Han, Gao Huang. International Conference on Computer Vision (ICCV Oral) 2021.

Dynamic neural networksCV

Regularizing Deep Networks with Semantic Data Augmentation

Regularizing Deep Networks with Semantic Data Augmentation. Yulin Wang*, Gao Huang*, Shiji Song, Xuran Pan, Yitong Xia, Cheng Wu. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021.

CVDynamic neural networks

Revisiting Locally Supervised Learning: an Alternative to End-to-end Training

Revisiting Locally Supervised Learning: an Alternative to End-to-end Training. Yulin Wang, Zanlin Ni, Shiji Song, Le Yang, Gao Huang. International Conference on Learning Representations (ICLR) 2021.

CVDynamic neural networks

Dynamic Neural Networks: A Survey

Dynamic Neural Networks: A Survey. Yizeng Han*, Gao Huang*, Shiji Song, Le Yang, Honghui Wang, Yulin Wang. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021

Dynamic neural networksCV

Spatially Adaptive Feature Refinement for Efficient Inference

Spatially Adaptive Feature Refinement for Efficient Inference. Yizeng Han, Gao Huang, Shiji Song, Le Yang, Yitian Zhang, Haojun Jiang. IEEE Transactions on Image Processing (TIP), 2021

Dynamic neural networksCV

Towards Learning Spatially Discriminative Feature Representations

Towards Learning Spatially Discriminative Feature Representations. Chaofei Wang*, Jiayu Xiao*, Yizeng Han, Qisen Yang, Shiji Song, Gao Huang. International Conference on Computer Vision (ICCV), 2021

Network OptimizationCV

3D Object Detection with Pointformer

3D Object Detection with Pointformer. Xuran Pan*, Zhuofan Xia*, Shiji Song, Li Erran Li, Gao Huang. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2021.

3D VisionCV

CondenseNet V2: Sparse Feature Reactivation for Deep Networks

CondenseNet V2: Sparse Feature Reactivation for Deep Networks. Le Yang*, Haojun Jiang*, Ruojin Cai, Yulin Wang, Shiji Song, Gao Huang, Qi Tian. IEEE Conference on Computer Vision and Pattern Recognition (CVPR ) 2021.

Temporal-Spatial Causal Interpretations for Vision-Based Reinforcement Learning

Temporal-Spatial Causal Interpretations for Vision-Based Reinforcement Learning. Wenjie Shi*, Gao Huang*, Shiji Song, Cheng Wu. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 2021.

InterpretabilityDeep RL

Meta-Reinforcement Learning With Dynamic Adaptiveness Distillation

Meta-Reinforcement Learning With Dynamic Adaptiveness Distillation. Hangkai Hu*, Gao Huang, Xiang Li, Shiji Song. IEEE Transactions on Neural Networks and Learning Sysytems (TNNLS) 2021.

Deep RL

Attention-Based Meta-Reinforcement Learning for Tracking Control of AUV With Time-Varying Dynamics

Attention-Based Meta-Reinforcement Learning for Tracking Control of AUV With Time-Varying Dynamics. Peng Jiang, Shiji Song, Gao Huang. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS(TNNLS) 2021.

Deep RL

Exploration With Task Information for Meta Reinforcement Learning

Exploration With Task Information for Meta Reinforcement Learning. Peng Jiang, Shiji Song, Gao Huang. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS(TNNLS) 2021.

Deep RL

Large scale air pollution prediction with deep convolutional networks

Large scale air pollution prediction with deep convolutional networks. Gao HUANG*, Chunjiang GE*, Tianyu XIONG, Shiji SONG, Le YANG, Baoxian LIU, Wenjun YIN & Cheng WU. SCIENCE CHINA Information Sciences, 2021

Searching Parameterized AP Loss for Object Detection

Searching Parameterized AP Loss for Object Detection. Chenxin Tao*, Zizhang Li*, Xizhou Zhu*, Gao Huang, Yong Liu, Jifeng Dai. 35th Conference on Neural Information Processing Systems (NeurIPS), 2021

CV or RL...

Auto Seg-Loss: Searching Metric Surrogates for Semantic Segmentation

Auto Seg-Loss: Searching Metric Surrogates for Semantic Segmentation. Hao Li*, Chenxin Tao*, Xizhou Zhu, Xiaogang Wang, Gao Huang, Jifeng Dai. International Conference on Learning Representations (ICLR), 2020

CV or RL...

Frequency Domain Image Translation: More Photo-realistic, Better Identity-preserving

Frequency Domain Image Translation: More Photo-realistic, Better Identity-preserving. Mu Cai, Hong Zhang, Huijuan Huang, Qichuan Geng, Yixuan Li, Gao Huang. International Conference on Computer Vision (ICCV) 2021.

Generalized Domain Conditioned Adaptation Network

Generalized Domain Conditioned Adaptation Network. Shuang Li, Binhui Xie, Qiuxia Lin, Chi Harold Liu, Gao Huang, Guoren Wang. IEEE Transactions on Pattern Analysis and Machine Intelligence (IEEE TPAMI), 2021.

Evolving Attention with Residual Convolutions

Evolving Attention with Residual Convolutions. Yujing Wang*, Yaming Yang*, Jiangang Bai, Mingliang Zhang, Jing Bai, Jing Yu, Ce Zhang, Gao Huang, Yunhai Tong. International Conference on Machine Learning (ICML) 2021.

Cross-iteration Batch Normalization

Cross-iteration Batch Normalization. Zhuliang Yao, Yue Cao, Shuxin Zheng, Gao Huang, Stephen Lin. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2021.

2020

Spatially Adaptive Inference with Stochastic Feature Sampling and Interpolation

Spatially Adaptive Inference with Stochastic Feature Sampling and Interpolation. Zhenda Xie, Zheng Zhang, Xizhou Zhu, Gao Huang , Stephen Lin. European Conference on Computer Vision (ECCV Oral) 2020.

CVDynamic neural networks

Glance and Focus: a Dynamic Approach to Reducing Spatial Redundancy in Image Classification

Glance and Focus: a Dynamic Approach to Reducing Spatial Redundancy in Image Classification. Yulin Wang, Kangchen Lv, Rui Huang, Shiji Song, Le Yang, Gao Huang. Neural Information Processing Systems (NeurIPS) 2020.

CVDynamic neural networks

Self-Supervised Discovering of Interpretable Features for Reinforcement Learning

Self-Supervised Discovering of Interpretable Features for Reinforcement Learning. Wenjie Shi*, Gao Huang, Shiji Song, Zhuoyuan Wang, Tingyu Lin, Cheng Wu. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 2020.

InterpretabilityDeep RL

Resolution Adaptive Networks for Efficient Inference

Resolution Adaptive Networks for Efficient Inference. Le Yang*, Yizeng Han*, Xi Chen*, Shiji Song, Jifeng Dai, Gao Huang. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2020.

Dynamic neural networksCV

2019

Horizontal Pyramid Matching for Person Re-identification

Horizontal Pyramid Matching for Person Re-identification. Yang Fu, Yunchao Wei, Yuqian Zhou, Honghui Shi, Gao Huang, Xinchao Wang, Zhiqiang Yao, Thomas Huang. AAAI Conference on Artificial Intelligence (AAAI) 2019.

Anytime Stereo Image Depth Estimation on Mobile Devices

Anytime Stereo Image Depth Estimation on Mobile Devices. Yan Wang, Zihang Lai, Gao Huang, Brian Wang, Laurens van der Maaten, Mark Campbell, Kilian Q. Weinberger. International Conference on Robotics and Automation (ICRA) 2019.

Rethinking the Value of Network Pruning

Rethinking the Value of Network Pruning. Zhuang Liu*, Mingjie Sun*, Tinghui, Zhou, Gao Huang, Trevor Darrell. International Conference on Learning Representations (ICLR) 2019.

Improved Techniques for Training Adaptive Deep Networks

Improved Techniques for Training Adaptive Deep Networks. Hao Li*, Hong Zhang*, Xiaojuan Qi, Ruigang Yang, Gao Huang. International Conference on Computer Vision (ICCV) 2019.

CVDynamic neural networks

Asymmetric Valleys: Beyond Sharp and Flat Local Minima

Asymmetric Valleys: Beyond Sharp and Flat Local Minima. Haowei He, Gao Huang, Yang Yuan. Neural Information Processing Systems (NeurIPS Spotlight) 2019.

Convolutional Networks with Dense Connectivity

Convolutional Networks with Dense Connectivity. Gao Huang, Zhuang Liu, Geoff Pleiss, Laurens Van Der Maaten, Kilian Q. Weingerger. IEEE Transactions on Pattern Analysis and Machine Intelligence (IEEE TPAMI) 2019. (Journal version of DenseNet; Deep understanding of dense connectivity.)

CVDynamic neural networks

Deep Residual Correction Network for Partial Domain Adaptation

Deep Residual Correction Network for Partial Domain Adaptation. Shuang Li, Chi Harold Liu, Qiuxia Lin, Qi Wen, Limin Su, Gao Huang, Zhengming Ding. IEEE Transactions on Pattern Analysis and Machine Intelligence (IEEE TPAMI), 2019.

Implicit Semantic Data Augmentation for Deep Networks

Implicit Semantic Data Augmentation for Deep Networks. Yulin Wang*, Xuran Pan*, Shiji Song, Hong Zhang, Cheng Wu, Gao Huang. Neural Information Processing Systems (NeurIPS) 2019.

CVDynamic neural networks

Regularized Anderson Acceleration for Off-Policy Deep Reinforcement Learning

Regularized Anderson Acceleration for Off-Policy Deep Reinforcement Learning. Wenjie Shi*, Shiji Song, Hui Wu, Ya-Chu Hsu, Cheng Wu, Gao Huang. 33rd Conference on Neural Information Processing Systems (NeurIPS), 2019.

Deep RL

Self-Attention-Based Temporary Curiosity in Reinforcement Learning Exploration

Self-Attention-Based Temporary Curiosity in Reinforcement Learning Exploration. Hangkai Hu*, Shiji Song, Gao Huang. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2019.

Deep RL

2018

Multi-Scale Dense Convolutional Networks for Resource Efficient Image Classification

Multi-Scale Dense Convolutional Networks for Resource Efficient Image Classification. Gao Huang, Danlu Chen, Tianhong Li, Felix Wu, Laurens van der Maaten, Kilian Q. Weinberger. International Conference on Learning Representations (ICLR Oral) 2018.

Resource Aware Person Re-identification across Multiple Resolutions

Resource Aware Person Re-identification across Multiple Resolutions. Yan Wang*, Lequn Wang*, Yurong You*, Xu Zou, Vincent Chen, Serena Li, Gao Huang, Bharath Hariharan, Kilian Weinberger. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2018.

CondenseNet: An Efficient DenseNet using Learned Group Convolutions

CondenseNet: An Efficient DenseNet using Learned Group Convolutions. Gao Huang*, Shichen Liu*, Laurens van der Maaten, Kilian Q. Weinberger. IEEE Conference on Computer Vision and Pattern Recognition (CVPR Spotlight) 2018.

An Empirical Study on Evaluation Metrics of Generative Adversarial Networks

An Empirical Study on Evaluation Metrics of Generative Adversarial Networks. Qiantong Xu, Gao Huang, Yang Yuan, Chuan Guo, Yu Sun, Felix Wu, Kilian Weinberger. arXiv Preprint 2018.

2017

Snapshot Ensembles: Train 1, Get M for Free

Snapshot Ensembles: Train 1, Get M for Free. Gao Huang*, Yixuan Li*, Geoff Pleiss, Zhuang Liu, John E. Hopcroft, Kilian Weinberger. International Conference on Learning Representations (ICLR) 2017.

Densely Connected Convolutional Networks

Densely Connected Convolutional Networks. Gao Huang*, Zhuang Liu*, Laurens van der Maaten, Kilian Weinberger. IEEE Conference on Computer Vision and Pattern Recognition (CVPR Oral) 2017.

Learning Efficient Convolutional Networks through Network Slimming

Learning Efficient Convolutional Networks through Network Slimming. Zhuang Liu, Jianguo Li, Zhiqiang Shen, Gao Huang, Shoumeng Yan, Changshui Zhang. International Conference on Computer Vision (ICCV) 2017.

Memory-Efficient Implementation of DenseNets

Memory-Efficient Implementation of DenseNets. Geoff Pleiss*, Danlu Chen*, Gao Huang, Tongcheng Li, Laurens van der Maaten, Kilian Q. Weinberger. Technical Report 2017.

2016

Supervised Word Mover's Distance

Supervised Word Mover's Distance. Gao Huang*, Chuan Guo*, Matt Kusner, Yu Sun, Fei Sha, Kilian Weinberger. Neural Information Processing Systems (NIPS Oral) 2016.

NLP

Deep Networks with Stochastic Depth

Deep Networks with Stochastic Depth. Gao Huang*, Yu Sun*, Zhuang Liu, Daniel Sedra, Kilian Weinberger. European Conference on Computer Vision (ECCV Spotlight) 2016. (This paper was recommended as an Oral at NIPS 2016 Deep Learning Symposium)