Subscribe to SOOFTWARE

Stay up to date! Get all the latest & greatest posts delivered straight to your inbox

serving

A collection of 1 post

Sooftware Serving - Triton Inference Server cover image
nlp, serving, 

Sooftware Serving - Triton Inference Server

Sooftware Serving - Triton Inference Server Triton Inference Server는 인공지능 모델의 인퍼런스를 도와주는 오픈소스 소프트웨어다. 다양한 프레임워크(TensorRT, TensorFlow…