From Dev.to
From 46M to 325M: An Inference NPU Now Pretrains a Language Model at GPU Quality
TL;DR Two weeks ago we wrote about VKORE-46M, a small model pretrained on an inference-only NPU. VIDRAFT has now scaled the same idea seven times: VKORE-325M-NPU-Base, a 325.6M-parameter language mo...