Mohammad Shoeybi

nVidia Corporation - Santa Clara / United States

Social Sciences / Linguistics and Literature

AD Scientific Index ID: 4416355

Registration, Add Profile,
Premium Membership

Print Your Certificate

Mohammad Shoeybi's MOST POPULAR ARTICLES

1-) Megatron-lm: Training multi-billion parameter language models using model parallelismM Shoeybi, M Patwary, R Puri, P LeGresley, J Casper, B CatanzaroarXiv preprint arXiv:1909.08053, 20196472019

2-) Bloom: A 176b-parameter open-access multilingual language modelBS Workshop, TL Scao, A Fan, C Akiki, E Pavlick, S Ilić, D Hesslow, ...arXiv preprint arXiv:2211.05100, 20228452022

3-) Deep voice: Real-time neural text-to-speechSÖ Arık, M Chrzanowski, A Coates, G Diamos, A Gibiansky, Y Kang, X Li, ...International conference on machine learning, 195-204, 20177592017

4-) Efficient large-scale language model training on gpu clusters using megatron-lmD Narayanan, M Shoeybi, J Casper, P LeGresley, M Patwary, ...Proceedings of the international conference for high performance computing …, 20217362021

5-) Using deepspeed and megatron to train megatron-turing nlg 530b, a large-scale generative language modelS Smith, M Patwary, B Norick, P LeGresley, S Rajbhandari, J Casper, ...arXiv preprint arXiv:2201.11990, 20226562022

ARTICLES

Add your articles