Yiping Wang 王宜平

Yiping Wang Ph.D student Paul G. Allen School of Computer Science & Engineering, University of Washington Email: ypwang61 at cs dot washington dot edu Google Scholar Twitter

About me

I'm a first-year Ph.D. student in Paul G. Allen School of Computer Science & Engineering from University of Washington. I feel very fortunate to have worked under the guidance of Prof. Simon Shaolei Du since 2022 summer.

My main research interest lies in machine learning theory, especially the foundations of deep learning and representation learning. I am also keen on developing practical machine learning algorithms with strong theoretical guarantees, and currently I'm working on designing data selection methods for training foundational models. Furthermore, I always hold a strong enthusiasm for understanding the essence of intelligence and exploring the cross-cutting areas of mathematics, physics, and AI.

Previously, I got my bachelor's degree in Computer Science & Technology from Zhejiang University in 2023, with an honor degree from Chu Kochen Honors College. I also minored in Mathematics at Zhejiang University. During my undergraduate, I was very fortunate to work closely with Dr. Yuandong Tian, Prof. Huaxiu Yao, and Prof. Linjun Zhang on several research projects.

Publications and Preprint

*: indicating equal contribution or alphabetic ordering.

1. Variance Alignment Score: A Simple But Tough-to-Beat Data Selection Method for Multimodal Contrastive Learning [Code]
   *Yiping Wang, *Yifang Chen, Wendan Yan, Kevin Jamieson, Simon Du.
   Preprint.
   

2. JoMA: Demystifying Multilayer Transformers via JOint Dynamics of MLP and Attention
   Yuandong Tian, Yiping Wang, Zhenyu Zhang, Beidi Chen, Simon Du.
   International Conference on Learning Representations (ICLR) 2024
   

3. Scan and Snap: Understanding Training Dynamics and Token Composition in 1-layer Transformer
   Yuandong Tian, Yiping Wang, Beidi Chen, Simon Du.
   Conference on Neural Information Processing Systems (NeurIPS) 2023
   Selected as Oral presentation at High-dimensional learning dynamics workshop at ICML 2023

4. Improved Active Multi-Task Representation Learning via Lasso
   Yiping Wang, Yifang Chen, Kevin Jamieson, Simon Du.
   International Conference on Machine Learning (ICML) 2023

5. C-Mixup: Improving Generalization in Regression [Code]
   *Huaxiu Yao, *Yiping Wang, Linjun Zhang, James Zou, Chelsea Finn.
   Conference on Neural Information Processing Systems (NeurIPS) 2022