toolkit, llama, parallelism, ondevice, llama.cpp (On device llm inference tool)llama.cpp (On device llm inference tool) 최근에 llama.cpp를 사용해봤는데, 상당히 편리하고 미래에 더 많이 쓰일 툴이라는 생각이 들어서 기록해둔다! llama.cpp란? 대표적인 오픈소스 LLM인 Meta…
nlp, parallelism, large-scale, lm, Sooftware NLP - GPT (Generative Pre-trained Transformer)GPT (Generative Pre-trained Transformer) 1 gpt1 먼저 알아보고, gpt2에 대해 알아보겠습니다. GPT1 Improving Language Understanding by Generative Pre-Training…
nlp, parallelism, large-scale, lm, Sooftware NLP - Large Scale LM (2) Distributed ProgrammingLarge Scale LM (2) Distributed Programming (작성중) 이 자료는 [해당 link…
nlp, parallelism, large-scale, lm, Sooftware NLP - Large Scale LM (1) BackgroundLarge Scale LM (1) Background 이 자료는 [해당 link…
nlp, parallelism, paper, Sooftware NLP - Megatron LM Paper ReviewMegatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism Mohammad Shoeybi et al. 2019. NVIDIA Corp. Summary…
