Subscribe to SOOFTWARE

Stay up to date! Get all the latest & greatest posts delivered straight to your inbox

ondevice

A collection of 1 post

llama.cpp (On device llm inference tool) cover image
toolkit, llama, parallelism, ondevice, 

llama.cpp (On device llm inference tool)

llama.cpp (On device llm inference tool) 최근에 llama.cpp를 사용해봤는데, 상당히 편리하고 미래에 더 많이 쓰일 툴이라는 생각이 들어서 기록해둔다! llama.cpp란? 대표적인 오픈소스 LLM인 Meta…