Bio

Hello! I’m a Senior Software Engineer at Google Research NY where I work on methods for sequence modeling / NLP and machine learning. My research interests are in all things related to improving, expanding, or rethinking the functionality of Transformers and other state-of-the-art sequence models. Prior to this, I worked on a wide variety of projects across Google including natural language generation for news, fact checking, database visualization, and distributed systems. In a previous life I was a full-stack software developer, and prior to that I attended Brown University as an undergrad (‘16).

Publications

Unifying Language Learning Paradigms (2022)
Yi Tay*, Mostafa Dehghani*, Vinh Q. Tran, Xavier Garcia, Dara Bahri, Tal Schuster, Huaixiu Steven Zheng, Neil Houlsby, Donald Metzler
Preprint

Transformer Memory as a Differentiable Search Index (2022)
Yi Tay, Vinh Q. Tran, Mostafa Dehghani, Jianmo Ni, Dara Bahri, Harsh Mehta, Zhen Qin, Kai Hui, Zhe Zhao, Jai Gupta, Tal Schuster, William W. Cohen, Donald Metzler
Preprint

A New Generation of Perspective API: Efficient Multilingual Character-level Transformers (2022)
Alyssa Lees*, Vinh Q. Tran*, Yi Tay*, Jeffrey Sorensen, Jai Gupta, Donald Metzler, Lucy Vasserman
KDD’22 Applied Data Science

ExT5: Towards extreme multi-task scaling for transfer learning (2021)
Vamsi Aribandi*, Yi Tay*, Tal Schuster, Jinfeng Rao, Huaixiu Steven Zheng, Sanket Vaibhav Mehta, Honglei Zhuang, Vinh Q. Tran, Dara Bahri, Jianmo Ni, Jai Gupta, Kai Hui, Sebastian Ruder, and Donald Metzler.
Proceedings of ICLR 2022

Charformer: Fast Character Transformers via Gradient-based Subword Tokenization (2021)
Yi Tay*, Vinh Q. Tran*, Sebastian Ruder, Jai Gupta, Hyung Won Chung, Dara Bahri, Zhen Qin, Simon Baumgartner, Cong Yu, and Donald Metzler.
Proceedings of ICLR 2022

AgreeSum: Agreement-oriented multi-document summarization (2021)
Richard Yuanzhe Pang*, Adam Lelkes*, Vinh Q. Tran*, and Cong Yu.
ACL Findings 2021

Quiz-Style Question Generation for News Stories (2021)
Adam D. Lelkes*, Vinh Q. Tran*, and Cong Yu
WWW’21

Making the Case for Query-by-Voice with EchoQuery (2016)
Gabriel Lyons, Vinh Q. Tran, Carsten Binnig, Ugur Cetintemel, and Tim Kraska.
SIGMOD’16 Demo