Junhao Chen



I am a junior undergraduate at Tsinghua University, currently actively engaged in research with Tsinghua's C3I lab, under the guidance of Professors Bowen Zhou and Ning Ding. I have also had the privilege of being mentored by Professors Zhiyuan Liu and Yulia Tsvetkov throughout my undergraduate years. My research interests lie mainly in the fields of NLP, with a particular focus on long-context models, interpretability, image generation and RL.

Beyond NLP, I am also deeply intrigued by VLMs, especially in the context of efficient architectures for image generation, as well as VLA research--where embodied AI meets reinforcement learning for real-world reasoning and interaction.

Outside of academics, I enjoy playing basketball, jogging, and engaging in board games.

Email  /  CV  /  Scholar

profile photo


Select Publications


MADFormer: Mixed Autoregressive and Diffusion Transformers for Continuous Image Generation
Junhao Chen, Yulia Tsvetkov, Xiaochuang Han
Preprint
arXiv

States Hidden in Hidden States: LLMs Emerge Discrete State Representations Implicitly
Junhao Chen, Shengding Hu, Zhiyuan Liu*, Maosong Sun*
Preprint
arXiv

InfiniteBench: Extending Long Context Evaluation Beyond 100K Tokens
Xinrong Zhang, Yingfa Chen, Shengding Hu, Zihang Xu, Junhao Chen, Moo Khai Hao, Xu Han, Zhen Leng Thai, Shuo Wang, Zhiyuan Liu*, Maosong Sun*
ACL, 2024
arXiv / GitHub

Website design from Jon Barron