About
I’m a first year PhD student at the School of Data Science, The Chinese University of Hong Kong, Shenzhen (CUHK-SZ) supervised by Prof. Guiliang Liu and co-supervised by Prof. Hongyuan Zha.
Before, I received my Bachelor degree at the School of Computer Science, Northwestern Polytechnical University (NWPU) in 2023.
My research focuses on:
Before, I received my Bachelor degree at the School of Computer Science, Northwestern Polytechnical University (NWPU) in 2023.
My research focuses on:
- Inverse Constrained Reinforcement Learning
- Risk-sensitive / Distributional Reinforcement Learning
- Preference-based Reinforcement Learning
NEWS
- [05/2024] One paper was accepted to ICML 2024.
- [01/2024] Two papers were accepted to ICLR 2024.
- [07/2023] I graduated from NWPU with the honor of Outstanding Graduate of Shaanxi Province (top 1%) and Excellent Graduation Thesis (top 5%).
Publications
- Robust Inverse Constrained Reinforcement Learning under Model Misspecification
Sheng Xu, Guiliang Liu.
International Conference on Machine Learning (ICML), 2024
- Uncertainty-aware Constraint Inference in Inverse Constrained Reinforcement Learning
Sheng Xu, Guiliang Liu.
International Conference on Learning Representations (ICLR), 2024
[PDF], [Code] - Enhancing Human-AI Collaboration Through Logic-Guided Reasoning
Chengzhi Cao, Yinghao Fu, Sheng Xu, Ruimao Zhang, Shuang Li.
International Conference on Learning Representations (ICLR), 2024
[PDF], [Code] - An Improved Lightweight YOLOv5 Model Based on Attention Mechanism for Face Mask Detection
Sheng Xu, Zhanyu Guo, Yuchi Liu, Jingwei Fan, Xuxu Liu.
International Conference on Artificial Neural Networks (ICANN), 2022
[PDF], [Code]
Experiences
- 2022.10 - 2023.05, Research Assistant. School of Data Science, CUHK, SZ with Prof. Guiliang Liu.
- Researched on reinforcement learning.
- 2021.10 - 2022.03, Research Intern. Institute of Software, Chinese Academy of Sciences with Prof. Cuixia Ma.
- Researched on object detection.
- 2021.07 - 2021.08, Summer Intern. ASLP@NPU with Prof. Lei Xie.
- Researched on speech enhancement.
Honors and Awards
- Presidential Fellowship, CUHK-SZ, 2023
- Outstanding Graduate of Shaanxi Province, Education Department of Shaanxi Provincial Government, 2023
- NWPU Top Undergraduate Student Award (highest honor of undergraduates, only 10 winners), 2022
- NWPU Top Class Scholorship (only 10 winners) 2022
- National Scholarship (top 1%), 2022 & 2021
- Modern Scientists Scholarship (top 1%), 2022
- Huawei Scholarship (top 1%), 2022
Teaching
- DDA2001 Introduction to Data Science: Spring 2024
Teaching Assistant - DDA4230 Reinforcement Learning: Fall 2023
Teaching Assistant with Prof. Guiliang Liu