Trading Depth for Time in Recurrent Transformers
Zeyi Huang*, Xuehai He*, Yong Jae Lee†, Yelong Shen†
Preprint 2026
Deeper is not the only way to think longer. One latent thinking step lets a 12-layer LRT nearly match a 24-layer LRT and outperform a 36-layer Transformer with fewer parameters.
arXiv / Code
Zeyi Huang*, Xuehai He*, LiLiang Ren, Yiping Wang, Baolin Peng, Hao Cheng, Shuohang Wang, Pengcheng He, Jianfeng Gao, Yong Jae Lee†, Yelong Shen†
EMNLP 2026
Your Transformer, but recurrent and better. With one forward per token, Latent Recurrent Transformer outperforms one-thought PonderLM-2 and matches a three-loop Transformer.
arXiv / Code
Zeyi Huang, Yuyang Ji, Anirudh Sundara Rajan, Zefan Cai, Wen Xiao, Haohan Wang, Junjie Hu, Yong Jae Lee
CVPR 2026
arXiv / Code
Zeyi Huang*, Yuyang Ji*, Xiaofang Wang, Nikhil Mehta, Tong Xiao, Donghyun Lee, Sigmund Vanvalkenburgh, Shengxin Zha, Bolin Lai, Licheng Yu, Ning Zhang, Yong Jae Lee†, Miao Liu†
CVPR 2025
arXiv / Code
Zeyi Huang*, Mu Cai*, Yuheng Li, Haohan Wang, Yong Jae Lee
WACV 2024
arXiv / Code
Zeyi Huang, Andy Zhou, Zijian Lin, Mu Cai, Haohan Wang†, Yong Jae Lee†
ICCV 2023
arXiv / Code
Zeyi Huang*, Haohan Wang*, Dong Huang, Yong Jae Lee†, Eric P. Xing†
CVPR 2022
arXiv / Code
Zeyi Huang*, Haohan Wang*, Eric P. Xing, Dong Huang
ECCV 2020 Oral (2%)
arXiv / Code