*Corresponding author.
2023
Appearance-preserved Portrait-to-anime Translation via Proxy-guided Domain Adaptation
Wenpeng Xiao, Cheng Xu, Jiajie Mai, Xuemiao Xu, Yue Li, Chengze Li, Xueting Liu, and Shengfeng He*
IEEE Transactions on Visualization and Computer Graphics (TVCG), 2023
[PDF] [Code]
Layout Generation as Intermediate Action Sequence Prediction
Huiting Yang, Danqing Huang, Chin-Yew Lin, and Shengfeng He*
Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI), 2023
[PDF] [Supp] [Code]
2022
Make Your Own Sprites: Aliasing-Aware and Cell-Controllable Pixelization
Zongwei Wu, Liangyu Chai, Nanxuan Zhao, Bailin Deng, Yongtuo Liu, Qiang Wen, Junle Wang, and Shengfeng He*
ACM Transactions on Graphics (SIGGRAPH Asia 2022 issue), 2022
Editing Out-of-domain GAN Inversion via Differential Activations
Haorui Song, Yong Du, Tianyi Xiang, Junyu Dong, Jing Qin, and Shengfeng He*
European Conference on Computer Vision (ECCV), 2022
Faithful Extreme Rescaling via Generative Prior Reciprocated Invertible Representations
Zhixuan Zhong, Liangyu Chai, Yang Zhou, Bailin Deng, Jia Pan, and Shengfeng He*
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022
(Oral Presentation)
Shunted Self-Attention via Multi-Scale Token Aggregation
Sucheng Ren, Daquan Zhou, Shengfeng He, Jiashi Feng, and Xinchao Wang
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022
(Oral Presentation)
High-resolution Face Swapping via Latent Semantics Disentanglement
Yangyang Xu, Bailin Deng, Junle Wang, Yanqing Jing, Jia Pan, and Shengfeng He*
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022
Co-advise: Cross Inductive Bias Distillation
Sucheng Ren, Zhengqi Gao, Tianyu Hua, Zihui Xue, Yonglong Tian, Shengfeng He*, and Hang Zhao
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022
A Simple Data Mixing Prior for Improving Self-Supervised Learning
Sucheng Ren, Huiyu Wang, Zhengqi Gao, Shengfeng He*, Alan Yuille, Yuyin Zhou, Cihang Xie
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022
Controllable Screentone Transfer via Pattern Correspondence and Regularization
Zhansheng Li, Nanxuan Zhao, Zongwei Wu, Yihua Dai, Junle Wang, Yanqing Jing, and Shengfeng He*
Computer Graphics Forum (Pacific Graphics 2022 Fast Track), 2022
[PDF] [Code]
Fully Deformable Network for Multi-view Face Image Synthesis
Cheng Xu, Keke Li, Xuandi Luo, Xuemiao Xu, Shengfeng He*, and Kun Zhang
IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2022
[PDF]
Pose and Attribute Consistent Person Image Synthesis
Cheng Xu, Zejun Chen, Jiajie Mai, Xuemiao Xu, and Shengfeng He*
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), 2022
[PDF]
Background Matting via Recursive Excitation
Junjie Deng, Yangyang Xu, Zeyang Zhou, and Shengfeng He*
IEEE International Conference on Multimedia & Expo (ICME) (Oral Presentation), 2022
2021
From Continuity to Editability: Inverting GANs with Consecutive Images
Yangyang Xu, Yong Du, Wenpeng Xiao, Xuemiao Xu, and Shengfeng He*
IEEE International Conference on Computer Vision (ICCV), 2021
From Contexts to Locality: Ultra-high Resolution Image Segmentation via Locality-aware Contextual Correlation
Qi Li, Weixiang Yang, Wenxi Liu, Yuanlong Yu, and Shengfeng He
IEEE International Conference on Computer Vision (ICCV), 2021
Spatially-invariant Style-codes Controlled Makeup Transfer
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021
Delving Deep into Many-to-many Attention for Few-shot Video Object Segmentation
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021
Reciprocal Transformations for Unsupervised Video Object Segmentation
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021
Learning from the Master: Distilling Cross-modal Advanced Knowledge for Lip Reading
Sucheng Ren, Yong Du, Jianming Lv, Guoqiang Han, and Shengfeng He*
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021
Differentiated Learning for Multi-Modal Domain Adaptation
Jianming Lv, Kaijie Liu, and Shengfeng He
ACM International Conference on Multimedia (ACM MM), 2021
(Oral)
Multi-view Face Synthesis via Progressive Face Flow
Yangyang Xu, Xuemiao Xu, Jianbo Jiao, Keke Li, Cheng Xu, and Shengfeng He*
IEEE Transactions on Image Processing (TIP)
Mask-Guided Deformation Adaptive Network for Human Parsing
Aihua Mao, Yuan Liang, Jianbo Jiao, Yongtuo Liu, and Shengfeng He*
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM)
Invertible Grayscale with Sparsity Enforcing Priors
Yong Du, Yangyang Xu, Taizhong Ye, Qiang Wen, Chufeng Xiao, Junyu Dong, Guoqiang Han, and Shengfeng He*
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM)
Learning Transferable Perturbations for Image Captioning
Hanjie Wu, Yongtuo Liu, Hongmin Cai, and Shengfeng He*
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM)
Holistically-Associated Transductive Zero-shot Learning
Yangyang Xu, Xuemiao Xu, Guoqiang Han, and Shengfeng He*
IEEE Transactions on Cognitive and Developmental Systems (TCDS)
Deep Multi-view Clustering via Iteratively Self-supervised Universal and Specific Space Learning
Qinjian Huang, Yue Zhang, Shengfeng He, Bin Zhang, Tingting Dan, Hong Peng, and Hongmin Cai
IEEE Transactions on Cybernetics (TCYB)
Fast Scene Labeling via Structural Inference
Huaidong Zhang, Chu Han, Xiaodan Zhang, Yong Du, Xuemiao Xu, Guoqiang Han, Jing Qin, and Shengfeng He*
Neurocomputing
Weakly Supervised Segmentation via Instance-aware Propagation
Xin Huang, Qianshu Zhu, Yongtuo Liu, and Shengfeng He*
Neurocomputing
2020
TENet: Triple Excitation Network for Video Salient Object Detection
European Conference on Computer Vision (ECCV), Glasgow, 2020
(Spotlight Oral, Acceptance Rate 5.0%)
Don’t Hit Me! Glass Detection in Real-world Scenes
Haiyang Mei, Xin Yang, Yang Wang, Yuanyuan Liu, Shengfeng He, Qiang Zhang, Xiaopeng Wei, and Rynson W.H. Lau
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Seatle, 2020
GDFace: Gated Deformation for Multi-view Face Image Synthesis
Xuemiao Xu, Keke Li, Cheng Xu, and Shengfeng He*
Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI), New York, 2020
Two-stage Photograph Cartoonization via Line Tracing
Simin Li, Qiang Wen, Shuang Zhao, Zixun Sun, Guoqiang Han, and Shengfeng He*
Computer Graphics Forum (Pacific Graphics 2020 issue), Wellington, 2020
Coherence and Identity Learning for Arbitrary-length Face Video Generation
Shuquan Ye, Chu Han, Jiaying Lin, Guoqiang Han, and, Shengfeng He*
International Conference on Pattern Recognition (ICPR), Milan, 2020
![CrowdGAN[00_00_09--00_00_15]](https://fcdn.goodq.top/caches/de86095cea00b72940595480c3c74cae/aHR0cDovL3d3dy5zaGVuZ2ZlbmdoZS5jb20vcWZ5LWNvbnRlbnQvdXBsb2Fkcy8yMDIwLzEyL2NlMjBmYTczNWQ4YTgyZDJkYjU1ODc4MDI1ZWQ4YWI1LmdpZj9haS1uby1jYWNoZT10cnVl.gif)
CrowdGAN: Identity-free Interactive Crowd Video Generation and Beyond
Liangyu Chai, Yongtuo Liu, Wenxi Liu, Guoqiang Han, and Shengfeng He*
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
![snapshot 截取视频[00_00_07--00_00_09]](https://fcdn.goodq.top/caches/de86095cea00b72940595480c3c74cae/aHR0cDovL3d3dy5zaGVuZ2ZlbmdoZS5jb20vcWZ5LWNvbnRlbnQvdXBsb2Fkcy8yMDIwLzA2L2VjYTI2NjY0NGM4ZWNlMjdhM2UxNjM0OTBjZjY0NjQ5LmdpZj9haS1uby1jYWNoZT10cnVl.gif)
Video Snapshot: Single Image Motion Expansion via Invertible Motion Embedding
Qianshu Zhu, Chu Han, Guoqiang Han, Tien-Tsin Wong, and Shengfeng He*
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
Learning Long-term Structural Dependencies for Video Salient Object Detection
Bo Wang, Wenxi Liu, Guoqiang Han, and Shengfeng He*
IEEE Transactions on Image Processing (TIP)
Real-time Hierarchical Supervoxel Segmentation via a Minimum Spanning Tree
Bo Wang, Yiliang Chen, Wenxi Liu, Jing Qin, Yong Du, Guoqiang Han, and Shengfeng He*
IEEE Transactions on Image Processing (TIP)
FormNet: Formatted Learning for Image Restoration
IEEE Transactions on Image Processing (TIP)
Extension of our CVPRW 2017.
Blind Image Denoising via Dynamic Dual Learning
Yong Du, Guoqiang Han, Yinjie Tan, Chufeng Xiao, and Shengfeng He*
IEEE Transactions on Multimedia (TMM)
Unsupervised Domain Adaptation via Importance Sampling
Xuemiao Xu, Hai He, Huaidong Zhang, Yangyang Xu, and Shengfeng He*
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
Few-shot Breast Cancer Metastases Classification via Unsupervised Cell Ranking
Jiaojiao Chen, Jianbo Jiao, Shengfeng He*, Guoqiang Han, and Jing Qin
IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB)
Smart Scribbles for Image Matting
Xin Yang, Yu Qiao, Shaozhe Chen, Shengfeng He*, Xiaopeng Wei, Baocai Yin, Qiang Zhang, and Rynson W.H. Lau
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM)
2019
Fast User-Guided Single Image Reflection Removal via Edge-aware Cascaded Networks
Huaidong Zhang, Xuemiao Xu, Hai He, Shengfeng He, Guoqiang Han, Jing Qin, and Dapeng WuIEEE Transactions on Multimedia (TMM)
[PDF]
Single Image Reflection Removal Beyond Linearity
Qiang Wen, Yinjie Tan, Jing Qin, Wenxi Liu, Guoqiang Han, and Shengfeng He*IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, 2019
[PDF] [Supp] [Source Code]
Self-supervised Spatio-temporal Representation Learning for Videos by Predicting Motion and Appearance Statistics
Jiangliu Wang, Jianbo Jiao, Linchao Bao, Shengfeng He, Yunhui Liu, and Wei LiuIEEE Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, 2019
[PDF]
Exploring Duality in Visual Questions Driven Top-Down Saliency
Shengfeng He, Chu Han, Guoqiang Han, and Jing QinIEEE Transactions on Neural Networks and Learning Systems (TNNLS)
[PDF]
Deformable Object Tracking with Gated Fusion
Wenxi Liu, Yibing Song, Dengsheng Chen, Shengfeng He*, Yuanlong Yu, Tao Yan,Gehard P. Hancke, and Rynson W.H. Lau
IEEE Transactions on Image Processing (TIP)
[PDF]
Joint Face Hallucination and Deblurring via Structure Generation and Detail Enhancement
Yibing Song, Jiawei Zhang, Lijun Gong, Shengfeng He, Linchao Bao, Jinshan Pan,Qingxiong Yang, and Ming-Hsuan Yang
International Journal of Computer Vision (IJCV), 2019
[PDF]
Joint Shape Matching for Overlapping Cytoplasm Segmentation in Cervical Smear Images
Youyi Song, Jing Qin, Baiying Lei, Shengfeng He, and Kup-Sze Cho
IEEE International Symposium on Biomedical Imaging (ISBI), Venice, 2019
Deep Binocular Tone Mapping
Zhuming Zhang, Chu Han, Shengfeng He, Xueting Liu, Haichao Zhu, Xinghong Hu, and Tien-Tsin Wong
The Visual Computer (Proc. CGI), June 2019
Proposal-Driven Segmentation for Videos
Junliang Li, Shengfeng He*, Hon-Cheng Wong*, and Sio-Long Lo
IEEE Signal Processing Letters, 26 (8), 1098-1102, 2019
Age Estimation via Attribute-region Association
Yiliang Chen, Shengfeng He*, Zichang Tan, Chu Han, Guoqiang Han, and Jing Qin
Neurocomputing
2018
Active Matting
Xin Yang, Ke Xu, Shaoze Shen, Shengfeng He*, Baocai Yin, and Rynson W.H. LauAdvances in Neural Information Processing Systems (NeurIPS), Dec. 2018
[PDF]
Deep Unsupervised Pixelization
Chu Han^, Qiang Wen^, Shengfeng He*, Qianshu Zhu, Yinjie Tan, Guoqiang Han, and Tien-Tsin Wong(^joint first authors)
ACM Transactions on Graphics (SIGGRAPH Asia 2018 issue), 2018
[PDF] [Supp] [Source Code]
Example-based Colorization via Dense Encoding Pyramids
Chufeng Xiao, Chu Han, Zhuming Zhang, Jing Qin, Tien-Tsin Wong, Guoqiang Han, and Shengfeng He*Computer Graphics Forum (Pacific Graphics 2018 Fast Track), 2018
[PDF] [Source Code]
SINet: A Scale-insensitive Convolutional Neural Network for Fast Vehicle Detection
Xiaowei Hu, Xuemiao Xu, Yongjie Xiao, Hao Chen, Shengfeng He, Jing Qin and Pheng-Ann HengIEEE Transactions on Intelligent Transportation Systems (TITS)
[PDF] [Source Code]
Image Captioning via Semantic Element Embedding
Xiaodan Zhang, Shengfeng He, Xinhang Song, Pengxu Wei, Shuqiang Jiang,Qixiang Ye, Jianbin Jiao and Rynson W.H. Lau
Neurocomputing
[PDF]
Efficient Image Super Resolution Integration
Ke Xu, Xin Wang, Xin Yang, Shengfeng He*, Baocai Yin, Qiang Zhang, and Rynson W.H. LauThe Visual Computer (Proc. CGI), June 2018
[PDF]
2017
Delving into Salient Object Subitizing and Detection
Shengfeng He, Jianbo Jiao, Xiaodan Zhang, Guoqiang Han, Rynson W.H. LauInternational Conference on Computer Vision (ICCV), Venice, 2017
DeshadowNet: A Multi-context Embedding Deep Network for Shadow Removal
Liangqiong Qu, Jiandong Tian, Shengfeng He, Yandong Tang, and Rynson W.H. LauIEEE Conference on Computer Vision and Pattern Recognition (CVPR), Hawaii, 2017
(Spotlight Oral, Acceptance Rate 8%)
[PDF] [SRD testset] [SRD training set (Baidu/Code: kuzj) (Google)] [Code]
[PDF] [SRD testset] [SRD training set (Baidu/Code: kuzj) (Google)] [Code]
Learning to Hallucinate Face Images via Component Generation and Enhancement
Yibing Song, Jiawei Zhang, Shengfeng He, Linchao Bao, and Qingxiong YangInternational Joint Conference on Artificial Intelligence (IJCAI), pp 4537-4543, Melbourne, 2017
FormResNet: Formatted Residual Learning for Image Restoration
Jianbo Jiao, Wei-Chih Tu, Shengfeng He, and Rynson W.H. LauIEEE Conference on Computer Vision and Pattern Recognition Workshop (CVPR Workshop), Hawaii, 2017
(Oral)
Keyword-driven Image Captioning via Context-dependent Bilateral LSTM
Xiaodan Zhang, Shengfeng He, Xinhang Song, Pengxu Wei, Shuqiang Jiang,Qixiang Ye, Jianbin Jiao and Rynson W.H. Lau
IEEE International Conference on Multimedia and Expo (ICME), Hong Kong, 2017
Joint Image Denoising and Disparity Estimation via Stereo Structure PCA and Noise-tolerant Cost
Jianbo Jiao, Qingxiong Yang, Shengfeng He, Shuhang Gu, Lei Zhang, and Rynson W.H. LauInternational Journal of Computer Vision (IJCV), 124(2): 204-222 (2017)
[PDF]
L0-Regularized Image Downscaling
Junjie Liu, Shengfeng He*, and Rynson W.H. LauIEEE Transactions on Image Processing (TIP)
[PDF] [Code] [BSDS Results] [User Study]
Egocentric Temporal Action Proposals
Shao Huang, Weiqiang Wang, Shengfeng He*, and Rynson W.H. LauIEEE Transactions on Image Processing (TIP)
[PDF]
RGBD Salient Object Detection via Deep Fusion
Liangqiong Qu, Shengfeng He*, Jiawei Zhang, Jiandong Tian, Yandong Tang, and Qingxiong YangIEEE Transactions on Image Processing (TIP), 26(5):2274-2285, May. 2017
[PDF] [Source Code (Google Drive)]
Interactive Hierarchical Object Proposals
Mingliang Chen, Jiawei Zhang, Shengfeng He*, Qingxiong Yang, Qing Li, and Ming-Hsuan YangIEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
[PDF]
Egocentric Hand Detection Via Dynamic Region Growing
Shao Huang, Weiqiang Wang, Shengfeng He, and Rynson W.H. LauACM Transactions on Multimedia Computing, Communications, and Applications (TOMM)
[PDF]
Stylizing Face Images via Multiple Exemplars
Yibing Song, Linchao Bao, Shengfeng He, Qingxiong Yang, and Ming-hsuan YangComputer Vision and Image Understanding (CVIU)
[PDF]
2016
Exemplar-Driven Top-Down Saliency Detection via Deep Association
Shengfeng He and Rynson W.H. LauIEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5723-5732, Las Vegas, June, 2016
(Spotlight Oral, Acceptance Rate 9.7%)
[PDF]
Real-time Salient Object Detection with a Minimum Spanning Tree
Wei-Chih Tu, Shengfeng He, Qingxiong Yang, and Shao-Yi ChienIEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2334-2342, Las Vegas, June, 2016
(Spotlight Oral, Acceptance Rate 9.7%)
Stereo Object Proposals
Shao Huang, Weiqiang Wang, Shengfeng He*, and Rynson W.H. LauIEEE Transactions on Image Processing (TIP), vol. 26, no. 2, pp. 671-683, Feb. 2017
[PDF] [StereoObj dataset]
Robust Object Tracking via Locality Sensitive Histograms
Shengfeng He, Rynson W.H. Lau, Qingxiong Yang, Jiang Wang, and Ming-Hsuan YangIEEE Transactions on Circuits and Systems for Video Technology (TCSVT), 27(5): 1006-1017 (2017)
(LSHT extension)
[PDF] [Supplemental Material]
2015
Oriented Object Proposals
Shengfeng He and Rynson W.H. LauIEEE International Conference on Computer Vision (ICCV), pp. 280 - 288, Santiago, Dec. 2015
SuperCNN: A Superpixelwise Convolutional Neural Network for Salient Object Detection
Shengfeng He, Rynson W.H. Lau, Wenxi Liu, Zhe Huang, and Qingxiong YangInternational Journal of Computer Vision (IJCV), vol. 115, no. 3, pp. 330-344, Dec. 2015
[PDF]
Fast Weighted Histograms for Bilateral Filtering and Nearest Neighbor Searching
Shengfeng He, Qingxiong Yang, Rynson W.H. Lau, and Ming-Hsuan YangIEEE Transactions on Circuits and Systems for Video Technology (TCSVT), vol. 26, no. 5, pp. 891-902, May 2016.
(Extension of our Locality Sensitive Histograms for different applications.)
[PDF] [Demo]
Saliency-Guided Color-to-Gray Conversion Using Region-based Optimization
Du Hao, Shengfeng He, Sheng Bin, Lizhuang Ma, and Rynson W.H. LauIEEE Transactions on Image Processing (TIP), vol. 24, no. 1, pp. 434 - 443, Jan. 2015
[PDF] [Supplemental Material] [CSDD dataset] [Our Results on CSDD] [Our Results on Cadik]
[Source Code] [Demo]
2014
A Tool-Free Calibration Method for Turntable-based 3D Scanning Systems
Xufang Pang, Rynson W.H. Lau, Zhan Song, Yangyan Li, and Shengfeng HeIEEE Computer Graphics and Applications (CG&A), 36(1):52-61, Jan. 2016.
[PDF]
Saliency Detection with Flash and No-flash Image Pairs
Shengfeng He and Rynson W.H. LauEuropean Conference on Computer Vision (ECCV), Zurich, September, 2014
[PDF] [Supplemental Material] [Video Spotlight] [Dataset]
2013
Consistent Stereo Image Editing
Tao Yan, Shengfeng He, Rynson W.H. Lau, and Yun XuACM International Conference on Multimedia (ACM MM), pp. 677-680, Barcelona, October, 2013
Visual Tracking via Locality Sensitive Histograms
Shengfeng He, Qingxiong Yang, Rynson W.H. Lau, Jiang Wang, and Ming-Hsuan YangIEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2427-2434, Portland, June, 2013
[PDF] [Supplemental Material] [Video Demo] [More Videos] [Reimplemented Matlab Code]
2012
Synthetic Controllable Turbulence using Robust Second Vorticity Confinement
Shengfeng He and Rynson W.H. LauComputer Graphics Forum (CGF), Volume 32, Issue 1, pp. 27–35, February 2013
[PDF] [Bibtex] [Video] [GPU Executable] [Featured Article of CGF]
2011
An Efficient Adaptive Vortex Particle Method for Real-Time Smoke Simulation
Shengfeng He, Hon-Cheng Wong, and Un-Hong WongCAD/Graphics 2011, pp. 317-324, 15-17 Sept. 2011
[PDF]
Real-time Smoke Simulation with Improved Turbulence by Spatial Adaptive Vorticity Confinement
Shengfeng He, Hon-Cheng Wong, Wai-Man Pang, and Un-Hong WongJournal of Computer Animation and Virtual Worlds (CASA2011 Special Issue), vol. 22, pp. 107-114
[PDF] [YouTube]