đź“– About Me
I received my PhD in Computer Science from the University of Manchester, supervised by Prof. Sophia Ananiadou. Previously, I worked as a Research Scientist at Tencent in Shanghai. I received both my Bachelor’s and Master’s degrees from Shanghai Jiao Tong University, where I was supervised by Prof. Gongshen Liu.
My research focuses on understanding and improving large language models. I follow a diagnose-and-improve paradigm. My research interests include mechanistic interpretability, large language models, and multimodal large language models. In particular, I am interested in understanding how model capabilities emerge, identifying the mechanisms behind their successes and failures, and translating mechanistic insights into more capable, reliable, and effective AI systems.
📝 Publications
-
Back Attention: Understanding and Enhancing Multi-Hop Reasoning in Large Language Models
Zeping Yu, Yonatan Belinkov, Sophia Ananiadou EMNLP 2025 (Main)
-
Locate-then-Merge: Neuron-Level Parameter Fusion for Mitigating Catastrophic Forgetting
Zeping Yu, Sophia Ananiadou EMNLP 2025 (Findings)
-
Interpreting Arithmetic Mechanism in Large Language Models through Comparative Neuron Analysis
Zeping Yu, Sophia Ananiadou EMNLP 2024 (Main)
-
Understanding and Mitigating Gender Bias in LLMs via Interpretable Neuron Editing
Zeping Yu, Sophia Ananiadou preprint
-
Neuron-Level Knowledge Attribution in Large Language Models
Zeping Yu, Sophia Ananiadou EMNLP 2024 (Main)
-
How do Large Language Models Learn In-Context? Query and Key Matrices of In-Context Heads are Two Towers for Metric Learning
Zeping Yu, Sophia Ananiadou EMNLP 2024 (Main)
-
Understanding Multimodal LLMs: the Mechanistic Interpretability of LLaVA in VQA
Zeping Yu, Sophia Ananiadou preprint
-
CodeCMR: Cross-modal retrieval for function-level binary source code matching
Zeping Yu, Wenxin Zheng, Jiaqi Wang, Qiyi Tang, Sen Nie, Shi Wu NeurIPS 2020
-
Order matters: Semantic-aware neural networks for binary code similarity detection
Zeping Yu*, Rui Cao* , Qiyi Tang, Sen Nie, Junzhou Huang, Shi Wu AAAI 2020
-
Adaptive User Modeling with Long and Short-Term Preferences for Personalized Recommendation
Zeping Yu, Jianxun Lian, Ahmad Mahmoody, Gongshen Liu, Xing Xie IJCAI 2019