My Research
My long-term research goal is to develop the science of language models (LMs) by asking and answering the following questions: What role does each hidden representation play in LLMs? When will they malfunction or cause counterintuitive phenomena? How can we adapt the mechanisms to transcend their inherent limits and better serve the downstream tasks?
To this end, I have been working on a theoretical and empirical analysis of LLM hidden representations LMs, with the aim to provide insights and develop useful tools and cures for LMs.
Awards and Honors
News, Service and Experiences
