Jiahui Yu, PhD

Research Scientist,
Google Brain

Google Scholar  /  GitHub
LinkedIn  /  Twitter  /  Facebook

I am a Research Scientist at Google Brain. I received my PhD at University of Illinois at Urbana-Champaign in 2020, advised by Professor Thomas Huang. Previously I received a Bachelor with distinction at School of the Gifted Young in Computer Science, University of Science and Technology of China in 2016. I worked at Microsoft Research Asia, Face++/Megvii, Adobe Research, Snap Research, Jump Trading, Baidu Research, Nvidia Research, and Google Brain during my PhD.

My interest is in sequence modeling (language, speech, video, financial data), machine perception (vision), generative models (GANs), and high performance computing.


(Google Scholar Profile)

FastEmit: Low-latency Streaming ASR with Sequence-level Emission Regularization
Jiahui Yu, Chung-Cheng Chiu, Bo Li, Shuo-yiin Chang, Tara N. Sainath, Yanzhang He,
Arun Narayanan, Wei Han, Anmol Gulati, Yonghui Wu, Ruoming Pang.

ArXiv 2020

Dual-mode ASR: Unify and Improve Streaming ASR with Full-context Modeling
Jiahui Yu, Wei Han, Anmol Gulati, Chung-Cheng Chiu, Bo Li, Tara N. Sainath,
Yonghui Wu, Ruoming Pang.

ICLR 2021

Neural Sparse Representation for Image Restoration
Yuchen Fan, Jiahui Yu, Yiqun Mei, Yulun Zhang, Yun Fu, Ding Liu, Thomas Huang.
NeurIPS 2020 / Code

Generative Adversarial Networks for Image and Video Synthesis: Algorithms and Applications
Ming-Yu Liu, Xun Huang, Jiahui Yu, Ting-Chun Wang, Arun Mallya.
Proceedings of the IEEE 2020

BigNAS: Scaling Up Neural Architecture Search with Big Single-Stage Models
Jiahui Yu, Pengchong Jin, Hanxiao Liu, Gabriel Bender, Pieter-Jan Kindermans, Mingxing Tan, Thomas Huang, Xiaodan Song, Ruoming Pang, Quoc Le.
ECCV 2020

ContextNet: Improving Convolutional Neural Networks for ASR with Global Context
Wei Han, Zhengdong Zhang, Yu Zhang, Jiahui Yu, Chung-Cheng Chiu, James Qin, Anmol Gulati, Ruoming Pang, Yonghui Wu.

Conformer: Convolution-augmented Transformer for Speech Recognition
Anmol Gulati, James Qin, Chung-Cheng Chiu, Niki Parmar, Yu Zhang, Jiahui Yu, Wei Han, Shibo Wang, Zhengdong Zhang, Yonghui Wu, Ruoming Pang.

FSNet: Compression of Deep Convolutional Neural Networks by Filter Summary
Yingzhen Yang, Jiahui Yu, Nebojsa Jojic, Jun Huan, Thomas Huang.
ICLR 2020 / OpenReview

Scale-wise Convolution for Image Restoration
Yuchen Fan, Jiahui Yu, Ding Liu, Thomas Huang.
AAAI 2020 / Code

AutoSlim: Towards One-Shot Architecture Search for Channel Numbers
Jiahui Yu and Thomas Huang.
NeurIPS Workshop 2019 / Code

Universally Slimmable Networks and Improved Training Techniques
Jiahui Yu and Thomas Huang.
ICCV 2019 / Code

Free-Form Image Inpainting with Gated Convolution (DeepFill v2)
Jiahui Yu, Zhe Lin, Jimei Yang, Xiaohui Shen, Xin Lu, Thomas Huang.
ICCV 2019 (Oral Presentation) / Code / Live Demo!

Fast Proximal Gradient Descent for Non-convex Optimization
Yingzhen Yang and Jiahui Yu.
UAI 2019 / Code

Foreground-aware Image Inpainting
Wei Xiong, Jiahui Yu, Zhe Lin, Jimei Yang, Xin Lu, Connelly Barnes, Jiebo Luo.
CVPR 2019

Slimmable Neural Networks
Jiahui Yu, Linjie Yang, Ning Xu, Jianchao Yang, Thomas Huang.
ICLR 2019 / Code / OpenReview
Top-10 Rated Papers on OpenReview, ICLR 2019.

Wide Activation for Efficient and Accurate Image Super-Resolution
Jiahui Yu, Yuchen Fan, Jianchao Yang, Ning Xu, Zhaowen Wang, Xinchao Wang, Thomas Huang.
BMVC 2019 (challenge report) / Code
Won 1st in NTIRE Challenge on Single Image Super-Resolution, CVPR 2018.

Improving Object Detection from Scratch via Gated Feature Reuse
Zhiqiang Shen, Honghui Shi, Jiahui Yu, Hai Phan, Rogerio Feris, Liangliang Cao, Ding Liu, Xinchao Wang, Thomas Huang, Marios Savvides.
BMVC 2019 / Code

Generative Image Inpainting with Contextual Attention (DeepFill v1)
Jiahui Yu, Zhe Lin, Jimei Yang, Xiaohui Shen, Xin Lu, Thomas Huang.
CVPR 2018 / Code / Live Demo! (10,000+ trials in 72 hours after release)

Neighborhood Regularized l1-Graph
Yingzhen Yang, Jiashi Feng, Jiahui Yu, Jianchao Yang, Pushmeet Kohli, Thomas Huang.
UAI 2017

Support Regularized Sparse Coding and Its Fast Encoder
Yingzhen Yang, Jiahui Yu, Pushmeet Kohli, Jianchao Yang, Thomas Huang.
ICLR 2017

UnitBox: An Advanced Object Detection Network
Jiahui Yu, Yuning Jiang, Zhangyang Wang, Zhimin Cao, Thomas Huang.
ACMMM 2016
Adapted to official TensorFlow Object Detection API.


  • Baidu Scholarship
  • Thomas and Margaret Huang Research Award
  • Microsoft-IEEE Young Fellowship


  • Conference Reviewer: CVPR, ICCV, ECCV, NeurIPS, ICLR, ICML, SIGGRAPH, ACM Multimedia, AAAI, IJCAI, ICME, PRCV, PG, ACCV.