nlp, parallelism, large-scale, lm, Sooftware NLP - GPT (Generative Pre-trained Transformer)GPT (Generative Pre-trained Transformer) 1 gpt1 먼저 알아보고, gpt2에 대해 알아보겠습니다. GPT1 Improving Language Understanding by Generative Pre-Training…
nlp, parallelism, large-scale, lm, Sooftware NLP - Large Scale LM (2) Distributed ProgrammingLarge Scale LM (2) Distributed Programming (작성중) 이 자료는 [해당 link…
nlp, parallelism, large-scale, lm, Sooftware NLP - Large Scale LM (1) BackgroundLarge Scale LM (1) Background 이 자료는 [해당 link…
nlp, parallelism, paper, Sooftware NLP - Megatron LM Paper ReviewMegatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism Mohammad Shoeybi et al. 2019. NVIDIA Corp. Summary…
