I am currently a PhD student in the Intelligent and Distributed Computing (IDC) Laboratory of Huazhong University of Science and Technology (HUST), under the supervision of Prof. Yuhua Li and Prof. Ruixuan Li. Before joining HUST, I got my bachelor’s degree in Beijing University of Posts and Telecommunications (BUPT).

My research interest includes Model Compression and Acceleration, and their applications in Recommender Systems, Distributed Training, and Large Language Models. Recently, I have been working on Parameter-Efficient Fine-Tuning and Inference Acceleration for LLMs.

🔥 News

2025.05: 🎉🎉 One paper was accepted by KDD 2025 ADS Track.
2025.05: 🎉🎉 Two papers were accepted by ICML 2025.
2024.07: 🎉🎉 One paper was accepted by MM 2024.
2024.05: 🎉🎉 One paper was accepted by ICML 2024.

📝 Publications

Xing Tang , Chaohua Yang, Yuwen Fu, Dongyang Ao, Shiwei Li, Fuyuan Lyu, Dugang Liu, and Xiuqiang He. Retrieval Augmented Cross-Domain Life Long Behavior Modeling for Enhancing Click-through Rate Prediction. The 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), August 3-7, 2025. (CCF-A) [paper]
Shiwei Li^*, Xiandi Luo^*, Haozhao Wang^†, Xing Tang^†, Hao Chen, Weihong Luo, Yuhua Li, Xiuqiang He, Ruixuan Li^†. Beyond Zero Initialization: Investigating the Impact of Non-Zero Initialization on LoRA Fine-Tuning Dynamics. The 42nd International Conference on Machine Learning (ICML), Vancouver, Canada, July 13-19, 2025. (CCF-A) [paper] [code]
Shiwei Li^*, Xiandi Luo^*, Haozhao Wang, Xing Tang, Shijie Xu, Weihong Luo, Yuhua Li, Xiuqiang He, Ruixuan Li^†. The Panaceas for Improving Low-Rank Decomposition in Communication-Efficient Federated Learning. The 42nd International Conference on Machine Learning (ICML), Vancouver, Canada, July 13-19, 2025. (CCF-A) [paper] [code]
Shiwei Li, Yingyi Cheng, Haozhao Wang^†, Xing Tang, Shijie Xu, Weihong Luo, Yuhua Li, Dugang Liu, Xiuqiang He, Ruixuan Li. Masked Random Noise for Communication-Efficient Federated Learning. The 32nd ACM International Conference on Multimedia (ACM MM), Melbourne, Australia, October 28 - November 1, 2024. (CCF-A) [paper] [code]
Shiwei Li, Wenchao Xu, Haozhao Wang^†, Xing Tang^†, Yining Qi, Shijie Xu, Weihong Luo, Yuhua Li, Xiuqiang He, Ruixuan Li^†. FedBAT: Communication-Efficient Federated Learning via Learnable Binarization. The 41st International Conference on Machine Learning (ICML), Vienna, Austria, July 21-27, 2024. (CCF-A) [paper] [code]
Shiwei Li^*, Huifeng Guo^*, Xing Tang, Ruiming Tang, Lu Hou, Ruixuan Li^†, Rui Zhang^†. Embedding Compression in Recommender Systems: A Survey. ACM Computing Surveys, 2024, 56(5): 1-21. (Q1, IF=23.8) [paper]
Shiwei Li, Huifeng Guo, Lu Hou, Wei Zhang, Xing Tang, Ruiming Tang, Rui Zhang^†, Ruixuan Li^†. Adaptive Low-Precision Training for Embeddings in Click-Through Rate Prediction. The 37th AAAI Conference on Artificial Intelligence (AAAI), Washington, DC, USA, February 7-14, 2023. (CCF-A) [paper] [code]

😊 Preprint

Shiwei Li, Zhuoqi Hu, Xing Tang, Haozhao Wang, Shijie Xu, Weihong Luo, Yuhua Li, Xiuqiang He, Ruixuan Li^†. Mixed-Precision Embeddings for Large-Scale Recommendation Models. [paper] [code]

📖 Educations

2021.09 - 2026.06 (expected), Ph.D. in Huazhong University of Science and Technology (HUST).
2017.09 - 2021.06, B.S. in Beijing University of Posts and Telecommunications (BUPT).

💻 Internships

2023.06 - 2025.06, [Tencent Financial Technology (FiT)], Shenzhen, China, under the supervision of Xing Tang and Xiuqiang He.
2021.10 - 2022.09, [Huawei Noah’s Ark Lab], Shenzhen, China, under the supervision of Huifeng Guo, Lu Hou, Ruiming Tang and Rui Zhang.

👨‍💻 Service