I am a senior student at College of Computer Science and Technology, Southeast University, majoring in Artificial Intelligence, and will graduate from Southeast University with a B.S. in Engineering in 2025! During my undergraduate studies, I was fortunate to be advised by Prof. Xu Yang and co-work with Yicheng Xiao and Ruoxi Cheng. Additionally, I am an incoming Master student at LAMDA@Nanjing University, advised by Prof. Hanjia Ye.

📝 Publications

AAAI2024 workshop

Reinforcement Learning from Multi-role Debates as Feedback for Bias Mitigation in LLMs

Ruoxi Cheng†, Haoxuan Ma†, Shuirong Cao†, Jiaqi Li, Aihua Pei, Zhiqiang Wang‡, Pengliang Ji, Haoyu Wang, Jiaqi Huo​​ († Equal contribution,)

Project Page

• we propose Reinforcement Learning from Multi-role Debates as Feedback (RLDF), a novel approach for bias mitigation replacing human feedback in traditional RLHF. We utilize LLMs in multi-role debates to create a dataset that includes both high-bias and low-bias instances for training the reward model in reinforcement learning.

NeurIPS2024

Lever LM: Configuring In-Context Sequence to Lever Large Vision Language Models

Xu Yang, Yingzhe Peng, Haoxuan Ma, Shuo Xu, Chi Zhang, Yucheng Han, Hanwang Zhang

Project Page

• We propose to use a tiny Language Model (LM), e.g., a Transformer with 67M parameters, to lever much larger Vision-Language Models (LVLMs) with 9B parameters. Specifically, we use this tiny Lever-LM to configure effective in-context demonstration (ICD) sequences to improve the In-Context Learinng (ICL) performance of LVLMs

🎖 Honors and Awards

• 2025.06 Excellent Undergraduate Thesis Award in Southeast University (东南大学优秀毕业论文)
• 2024.11 President Scholarship (top 1%) in Southeast University, $8,000 CNY (校长奖学金)
• 2023.11 Zhishan Scholarship in Southeast University, $3,000 CNY (至善学子奖学金)
• 2023.09 Suzhou Industrial Scholarship in Southeast University, $5,000 CNY (苏州工业园区奖学金)
• 2023.06 Merit Student in Southeast University (东南大学三好学生)
• 2022.11 Zhishan Scholarship in Southeast University, $3,000 CNY (至善学子奖学金)
• 2022.09 Lenovo Research Institute Scholarship in Southeast University, $5,000 CNY (联想研究院奖学金)

📖 Educations

• *2021.08 - 2025.06 *, Southeast University, College of Computer Science and Technology.
• *2025.09 - 2028.06 *, Nanjing University, College of Artificial Intelligence.

💻 Internships

• [Shanghai AI Lab], Trajectory prediction and policy learning in Embodied AI.
• [Huawei ICT], Conducted pretraining and post-training of LLMs.