Jiaao He

Jiaao He

Tsinghua University - Beijing / China
Others
AD Scientific Index ID: 4882233
清华大学
person_outline Jiaao He's MOST POPULAR ARTICLES
1-) Fastmoe: A fast mixture-of-expert training systemJ He, J Qiu, A Zeng, Z Yang, J Zhai, J TangarXiv preprint arXiv:2103.13262, 2021902021
2-) Prague: High-performance heterogeneity-aware asynchronous decentralized trainingQ Luo, J He, Y Zhuo, X QianProceedings of the Twenty-Fifth International Conference on Architectural …, 2020862020
3-) Fastermoe: modeling and optimizing training of large-scale dynamic pre-trained modelsJ He, J Zhai, T Antunes, H Wang, F Luo, S Shi, Q LiProceedings of the 27th ACM SIGPLAN Symposium on Principles and Practice of …, 2022482022
4-) BaGuaLu: targeting brain scale pretrained models with over 37 million coresZ Ma, J He, J Qiu, H Cao, Y Wang, Z Sun, L Zheng, H Wang, S Tang, ...Proceedings of the 27th ACM SIGPLAN Symposium on Principles and Practice of …, 2022552022
5-) SmartMoE: Efficiently Training Sparsely-Activated Models through Combining Offline and Online ParallelizationM Zhai, J He, Z Ma, Z Zong, R Zhang, J Zhai2023 USENIX Annual Technical Conference (USENIX ATC 23), 961-975, 2023202023