Yuling Shi

🙋 About Me

Hi, I am a fourth year Ph.D. student in the LLM for Software Engineering Lab (LLMSE), affiliated with the School of Software at Shanghai Jiao Tong University in China. I’m grateful to be advised by Prof. Xiaodong Gu and Prof. Beijun Shen.

Some of my recent projects can be found in my Github homepage here. Feel free to contact me if you are interested in my work or have any questions.

🧐 Research Interests

• Software Engineering: code generation, code debugging, software issue resolution, code question answering
• Natural Language Processing: post training, retrieval augmented generation, multi-agent systems

📝 Publications

† denotes equal contribution.

Publications

• In Line with Context: Repository-Level Code Generation via Context Inlining
  FSE 2026
  Chao Hu, Wenhao Zeng, Yuling Shi, Beijun Shen, Xiaodong Gu

• From Code to Correctness: Closing the Last Mile of Code Generation with Hierarchical Debugging
  ICSE 2026
  Yuling Shi, Songsong Wang, Chengcheng Wan, Min Wang, Xiaodong Gu

• SWE-Debate: Competitive Multi-Agent Debate for Software Issue Resolution
  ICSE 2026
  Han Li†, Yuling Shi†, Shaoxin Lin, Xiaodong Gu, Heng Lian, Xin Wang, Yantao Jia, Tao Huang, Qianxiang Wang

• EVOC2RUST: A Skeleton-guided Framework for Project-Level C-to-Rust Translation
  ICSE 2026 SEIP
  Chaofan Wang, Tingrui Yu, Chen Xie, Jie Wang, Dong Chen, Wenrui Zhang, Yuling Shi, Xiaodong Gu, Beijun Shen

• HyperAgent: Leveraging Hypergraphs for Topology Optimization in Multi-Agent Communication
  AAMAS 2026
  Heng Zhang, Yuling Shi, Xiaodong Gu, Zijian Zhang, Haochen You, Lubin Gan, Yilei Yuan, Jin Huang

• GraphTracer: Graph-Guided Failure Tracing in LLM Agents for Robust Multi-Turn Deep Search
  AAMAS 2026
  Heng Zhang, Yuling Shi, Xiaodong Gu, Haochen You, Zijian Zhang, Lubin Gan, Yilei Yuan, Jin Huang

• D³MAS: Decompose, Deduce, and Distribute for Enhanced Knowledge Sharing in Multi-Agent Systems
  AAMAS 2026
  Heng Zhang, Yuling Shi, Xiaodong Gu, Haochen You, Zijian Zhang, Lubin Gan, Yilei Yuan, Jin Huang

• LongCodeZip: Compress Long Context for Code Language Models
  ASE 2025
  Yuling Shi, Yichun Qian, Hongyu Zhang, Beijun Shen, Xiaodong Gu

• Between Lines of Code: Unraveling the Distinct Patterns of Machine and Human Programmers
  ICSE 2025
  Yuling Shi, Hongyu Zhang, Chengcheng Wan, Xiaodong Gu

• LastingBench: Defend Benchmarks Against Knowledge Leakage
  EMNLP 2025 Findings
  Yixiong Fang, Tianran Sun, Yuling Shi, Min Wang, Xiaodong Gu

• AttentionRAG: Attention-Guided Context Pruning in Retrieval-Augmented Generation
  ACL 2025 KnowFM
  Yixiong Fang, Tianran Sun, Yuling Shi, Xiaodong Gu

• A Morley-Wang-Xu element method for a fourth order elliptic singular perturbation problem
  Journal of Scientific Computing (Q1), 2021
  Xuehai Huang, Yuling Shi and Wenqing Wang

Preprints

• Progressive Supernet Training for Efficient Visual Autoregressive Modeling
  Preprint
  Xiaoyue Chen†, Yuling Shi†, Kaiyuan Li†, Huandong Wang, Yong Li, Xiaodong Gu, Xinlei Chen, Mingbao Lin

• SWE-Exp: Experience-Driven Software Issue Resolution
  Preprint
  Silin Chen, Shaoxin Lin, Xiaodong Gu, Yuling Shi, Heng Lian, Longfei Yun, Dong Chen, Weiguo Sun, Lin Cao, Qianxiang Wang

• Repository-level Code Question Answering
  Preprint
  Weihan Peng, Yuling Shi, Yuhang Wang, Xinyun Zhang, Beijun Shen, Xiaodong Gu

• Robust Preference Alignment via Directional Neighborhood Consensus
  Preprint
  Ruochen Mao, Yuling Shi, Xiaodong Gu, Jiaheng Wei

• Fed-SE: Federated Self-Evolution for Privacy-Constrained Multi-Environment LLM Agents
  Preprint
  Xiang Chen, Yuling Shi, Qizhen Lan, Yuchao Qiu, Xiaodong Gu

• Pruning the Unsurprising: Efficient Code Reasoning via First-Token Surprisal
  Preprint
  Wenhao Zeng, Yaoning Wang, Chao Hu, Yuling Shi, Chengcheng Wan, Hongyu Zhang, Xiaodong Gu

• Attention as a Compass: Efficient Exploration for Process-Supervised RL in Reasoning Models
  Preprint
  Runze Liu, Jiakang Wang, Yuling Shi, Zhihui Xie, Chenxin An, Kaiyan Zhang, Jian Zhao, Xiaodong Gu, Lei Lin, Wenping Hu, Xiu Li, Fuzheng Zhang, Guorui Zhou, Kun Gai

👨‍💻 Experiences

• Research Intern at ByteDance, 2025.11-Now
  • Grateful to be advised by Dr. Shilin He to work on Post Training for Code LLMs.
• Research Intern at Microsoft Research, 2022.03-2022.09
  • Grateful to be advised by Dr. Yufan Huang and Dr. Maoquan Wang to work on analyzing neural representations of code. Some of my work contributed to the following paper on EMNLP 2023. [pdf]

📣 Invited Talks

• How to understand and debug large and complex programs? at Ant Group, December 2025
• Hierarchical debugging with LLMs. at CCF Synonym, December 2025
• How to compress long code context? at CCF Synonym, December 2025
• Dealing with long context problem in SE. at Software Engineering Lab, ByteDance, October 2025
• Hierarchical debugging with LLMs. at Tongyi Lab, Alibaba, October 2024
• How to detect LLM generated code? at CCF Synonym, August 2024

📚 Teaching

• Teaching Assistant for “Machine Learning” (Fall 2022, Fall 2023, Spring 2024, Spring 2025)
• Teaching Assistant for “Math for Machine Learning” (Spring 2024)
• Teaching Assistant for FL4207 “Application of LLMs” (Fall 2025)

💼 Services

• Conference Reviewer: ICLR 2025, ICLR 2026, ICSE 2026 (Shadow PC), CVPR 2026, ARR Oct 2025
• Journal Reviewer: TMLR

🏆 Awards

• 🏆 National Scholarship
• 🏓 Fifth place in Shanghai Table Tennis Doubles Championship and third place in teams representing my university
• 🏆 First Prize in National Olympiad in Physics at High school (Provincial Area)

📖 Materials to share

• 🔥 A collection of resources for repo-level code generation. [Github]
• A simple script to detect word by word plagiarism for Academic Writing course in SJTU. [Github]

Thank you for visiting my homepage!

The truth is lived, not taught. -Hermann Hesse