I am currently a PhD student in the Intelligent and Distributed Computing (IDC) Laboratory of Huazhong University of Science and Technology (HUST), under the supervision of Prof. Yuhua Li and Prof. Ruixuan Li. Before joining HUST, I got my bachelor’s degree in Beijing University of Posts and Telecommunications (BUPT).

My primary research focuses on Efficient Intelligent Computing, encompassing multiple directions such as data selection, model compression, communication compression, training optimization, and inference optimization, with applications spanning recommender systems, federated learning, and large language models.

πŸ”₯ News

  • 2025.09: Β πŸŽ‰πŸŽ‰ Two papers were accepted by NeurIPS 2025.
  • 2025.09: Β πŸŽ‰πŸŽ‰ One paper was accepted by TPDS.
  • 2025.05: Β πŸŽ‰πŸŽ‰ One paper was accepted by KDD 2025 ADS Track.
  • 2025.05: Β πŸŽ‰πŸŽ‰ Two papers were accepted by ICML 2025.
  • 2024.07: Β πŸŽ‰πŸŽ‰ One paper was accepted by MM 2024.
  • 2024.05: Β πŸŽ‰πŸŽ‰ One paper was accepted by ICML 2024.

πŸ“ƒ Publications

  1. Shiwei Li, Xiandi Luo, Haozhao Wang, Xing Tang, Ziqiang Cui, Dugang Liu, Yuhua Li, Xiuqiang He, Ruixuan Li. Beyond Higher Rank: Token-wise Input-Output Projections for Efficient Low-Rank Adaptation. The 39th Annual Conference on Neural Information Processing Systems (NeurIPS), 2025. (CCF-A)

  2. Ziqiang Cui, Yunpeng Weng, Xing Tang, Xiaokun Zhang, Shiwei Li, Peiyang Liu, Bowei He, Dugang Liu, Weihong Luo, Xiuqiang He, Chen Ma. Semantic Retrieval Augmented Contrastive Learning for Sequential Recommendation. The 39th Annual Conference on Neural Information Processing Systems (NeurIPS), 2025. (CCF-A)

  3. Shiwei Li, Qunwei Li, Haozhao Wang, Ruixuan Li†, Jianbin Lin, Wenliang Zhong. FedBiF: Communication-Efficient Federated Learning via Bits Freezing. IEEE Transactions on Parallel and Distributed Systems (TPDS), 2025. (CCF-A) [paper] [code]

  4. Jintao Tong*, Shiwei Li*, Zijian Zhuang*, Jinghan Hu†, Yixiong Zou†. EmoSync: Multi-Stage Reasoning with Multimodal Large Language Models for Fine-Grained Emotion Recognition. MRAC25 Workshop@ACM MM, 2025. (CCF-A)
  5. Xing Tang , Chaohua Yang, Yuwen Fu, Dongyang Ao, Shiwei Li†, Fuyuan Lyu, Dugang Liu, and Xiuqiang He†. Retrieval Augmented Cross-Domain Life Long Behavior Modeling for Enhancing Click-through Rate Prediction. The 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), August 3-7, 2025. (CCF-A) [paper]

  6. Shiwei Li*, Xiandi Luo*, Haozhao Wang†, Xing Tang†, Hao Chen, Weihong Luo, Yuhua Li, Xiuqiang He, Ruixuan Li†. Beyond Zero Initialization: Investigating the Impact of Non-Zero Initialization on LoRA Fine-Tuning Dynamics. The 42nd International Conference on Machine Learning (ICML), Vancouver, Canada, July 13-19, 2025. (CCF-A) [paper] [code]
  7. Shiwei Li*, Xiandi Luo*, Haozhao Wang, Xing Tang, Shijie Xu, Weihong Luo, Yuhua Li, Xiuqiang He, Ruixuan Li†. The Panaceas for Improving Low-Rank Decomposition in Communication-Efficient Federated Learning. The 42nd International Conference on Machine Learning (ICML), Vancouver, Canada, July 13-19, 2025. (CCF-A) [paper] [code]
  8. Shiwei Li, Yingyi Cheng, Haozhao Wang†, Xing Tang, Shijie Xu, Weihong Luo, Yuhua Li, Dugang Liu, Xiuqiang He, Ruixuan Li. Masked Random Noise for Communication-Efficient Federated Learning. The 32nd ACM International Conference on Multimedia (ACM MM), Melbourne, Australia, October 28 - November 1, 2024. (CCF-A) [paper] [code]
  9. Shiwei Li, Wenchao Xu, Haozhao Wang†, Xing Tang†, Yining Qi, Shijie Xu, Weihong Luo, Yuhua Li, Xiuqiang He, Ruixuan Li†. FedBAT: Communication-Efficient Federated Learning via Learnable Binarization. The 41st International Conference on Machine Learning (ICML), Vienna, Austria, July 21-27, 2024. (CCF-A) [paper] [code]
  10. Shiwei Li*, Huifeng Guo*, Xing Tang, Ruiming Tang, Lu Hou, Ruixuan Li†, Rui Zhang†. Embedding Compression in Recommender Systems: A Survey. ACM Computing Surveys, 2024, 56(5): 1-21. (Q1, IF=28.0) [paper]
  11. Shiwei Li, Huifeng Guo, Lu Hou, Wei Zhang, Xing Tang, Ruiming Tang, Rui Zhang†, Ruixuan Li†. Adaptive Low-Precision Training for Embeddings in Click-Through Rate Prediction. The 37th AAAI Conference on Artificial Intelligence (AAAI), Washington, DC, USA, February 7-14, 2023. (CCF-A) [paper] [code]

πŸ“ Preprint

  1. Shiwei Li, Xiandi Luo, Haozhao Wang, Xing Tang, Ziqiang Cui, Dugang Liu, Yuhua Li, Xiuqiang He, Ruixuan Li†. BoRA: Towards More Expressive Low-Rank Adaptation with Block Diversity.
  2. Shiwei Li*, Zhuoqi Hu*, Fuyuan Lyu, Xing Tang, Haozhao Wang, Dugang Liu, Yuhua Li, Xiuqiang He, Rui Zhang, Ruixuan Li†. Mixed-Precision Embeddings for Large-Scale Recommendation Models. [paper] [code]
  3. Ziqiang Cui, Yunpeng Weng, Xing Tang, Peiyang Liu, Shiwei Li, Bowei He, Jiamin Chen, Xiuqiang He, Chen Ma. CORE: Lossless Compression for Retrieval-Augmented LLMs via Reinforcement Learning.

πŸ“– Educations

  • 2021.09 - 2026.06 (expected), Ph.D. in Huazhong University of Science and Technology (HUST).
  • 2017.09 - 2021.06, B.S. in Beijing University of Posts and Telecommunications (BUPT).

πŸ’» Internships

πŸ‘¨β€πŸ’» Service

  • Area Chair: KDD 2025, KDD 2026
  • Reviewer: KDD 2025, NeurIPS 2025, MM 2025, IJCAI 2025, ECAI 2025, AAAI 2026, ICLR 2026

πŸ₯‡ Honors and Awards

  • 2024.12, Huawei Scholarship
  • 2025.09, National Scholarship for Doctoral Students