I am now a staff researcher at Kuaishou Technology, focusing on the tasks of AIGC.
2023.04 - 2024.06, I was a research engineer at Beijing Institute for General Artificial Intelligence (BIGAI)
2021.07 - 2023.04, I was a research engineer at Kuaishou Technology.
2016.09 - 2021.07, I was a Ph.D student at Institute of Computing Technology, CAS, under the supervision of Prof. Shiguang Shan.
2019.10 - 2020.03, I was a visiting researcher at Oulu University under the supervision of Prof. Guoying Zhao.
2012.09 - 2016.07, I was a college student in Nankai University, Tianjin.
Research Interest
My research interests mainly focus on the deep perception and understanding of the real world, especially understanding human face, body and the environment from 2D images and 3D representations. I am also very interested in the human-machine interaction as well as the basic theories of deep learning.
News
One paper on generalized remote physiological measurement accepted by CVPR 2023.
One paper on model compression accepted by ACMMM 2022.
I have successfully defended my doctoral thesis！
One paper on apathy diagnosis accepted by T-CSVT
I obtained the Special Scholarship of ICT (Highest award in ICT).
I obtained the China National Scholarship for Ph.D.
One survey on rPPG-based physiological measurement accepted by Journal of Image and Graphics.
One paper on remote HR estimation accepted by ECCV2020 as oral presentation (top 2%).
One paper on facial anti-spoofing accepted by ECCV2020.
Our remote heart rate estiamtion system has been successfully applied by HUAWEI ("华为智能健康app").
One paper on remote HR estimation accepted by SPL.
Learning an Inference-accelerated Network from a Pre-trained Model with Frequency-enhanced Feature Distillation.
Xuesong Niu, Jili Gu, Guoxin Zhang, Pengfei Wan, Zhongyuan Wang
ACM Multimedia, 2022. [paper]
A Spatio-temporal Approach for Apathy Classification.
Abhijit Das, Xuesong Niu, Antitza Dantcheva, S L Happy, Hu Han, Radia Zeghari, Philippe Robert, Shiguang Shan, Francois Bremond, Xilin Chen
IEEE Transactions on Circuits and Systems for Video Technology (T-CSVT), 2021. [paper]
RhythmNet: End-to-end Heart Rate Estimation from Face via Spatial-temporal Representation
Xuesong Niu, Shiguang Shan, Hu Han, Xilin Chen
IEEE Transactions on Image Processing (TIP), 2020. [paper]
Video-based Remote Physiological Measurement via Cross-verified Feature Disentangling.
(Oral presentation, top 2%)
Xuesong Niu, Zitong Yu, Hu Han, Xiaobai Li, Shiguang Shan, Guoying Zhao
European Conference on Computer Vision (ECCV), 2020. [paper][code]
Face Anti-Spoofing with Human Material Perception.
Zitong Yu, Xiaobai Li, Xuesong Niu, Jingang Shi, Guoying Zhao
European Conference on Computer Vision (ECCV), 2020. [paper]
AutoHR: A Strong End-to-end Baseline for Remote Heart Rate Measurement with Neural Searching.
Zitong Yu, Xiaobai Li, Xuesong Niu, Jingang Shi, Guoying Zhao
IEEE Signal Processing Letters(SPL), 2020. [pdf]
Multi-label Co-regularization for Semi-supervised Facial Action Unit Recognition
Xuesong Niu, Hu Han, Shiguang Shan, Xilin Chen
Advances in Neural Information Processing Systems (NeurIPS), Vancouver, Canada, 2019. [paper][poster][code]
Local Relationship Learning with Person-specific Shape Regularization for Facial Action Unit Detection.
Xuesong Niu, Hu Han, Songfan Yang, Yan Huang, Shiguang Shan
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, 2019. [paper][poster]
Robust Remote Heart Rate Estimation from Face Utilizing Spatial-temporal Attention. (Best poster presentation Award)
Xuesong Niu*, Xingyuan Zhao*, Hu Han, Abhijit Das, Antitza Dantcheva, Shiguang Shan, Xilin Chen
IEEE International Conference on Automatic Face and Gesture Recognition (FG), Lille, France, 2019. [paper][poster]
VIPL-HR: A Multi-modal Database for Pulse Estimation from Less-constrained Face Video.
Xuesong Niu, Hu Han, Shiguang Shan, Xilin Chen
Asian Conference on Computer Vision (ACCV), Perth Western Australia, 2018. [pdf][database][poster]
Automatic Engagement Prediction with GAP Feature.
Xuesong Niu, Hu Han, Jiabei Zeng, Xuran Sun, Shiguang Shan, Yan Huang, Songfan Yang, Xilin Chen
ACM International Conference on Multimodal Interaction (ICMI), Boulder, CO, USA, 2018. [paper][poster]
SynRhythm: Learning a Deep Heart Rate Estimator from General to Specific.
Xuesong Niu, Hu Han, Shiguang Shan, Xilin Chen
International Conference on Pattern Recognition (ICPR), Beijing, China, 2018. [paper][poster]
Continuous Heart Rate Measurement from Face:A Robust rPPG Approach with Distribution Learning.
Xuesong Niu, Hu Han, Shiguang Shan, Xilin Chen
International Joint Conference on Biometrics(IJCB), 2017. [paper][poster]
Projects
Remote heart rate estiamtion system applied by SeetaTech and HUAWEI ("华为智能健康app").
Co-organizer of
the first Challenge on Remote Physiological Signal Sensing (RePSS) with CVPR 2020
Talks
2020.9, Huawei Noah's Ark Lab, "Remote Physiological Measurement from Face Videos"
2021.3, Zhidongxi (Online), "Remote Physiological Measurement from Face Videos"
