Sparse Weight Decomposition for Efficient Circuit Extraction
Extracting faithful model circuits through a sparse decomposition of dense neural-network weights.
MPhil in Computer Science
CUHK-Shenzhen
About
I am an MPhil student in Computer Science at CUHK-Shenzhen. I completed my undergraduate studies in Applied Mathematics there, where I was advised by Professors Benyou Wang and Zhongxiang Dai. I am currently mentored by Professor Jie Fu.
My research interests lie broadly in AI safety, with a focus on mechanistic understanding and verifiable reasoning. I am interested in understanding the internal mechanisms that shape model behavior, and in using verifiable feedback to support more reliable and scalable training and evaluation.
Recent Work
All research ↗Extracting faithful model circuits through a sparse decomposition of dense neural-network weights.
Training code agents with objective feedback from a formal verifier.
Learning from distributed pairwise preferences while reducing communication rounds.
Evaluating whether language models can translate real-world problems into executable mathematical models.
* Equal contribution.
More Research
* Equal contribution.