From Dev.to
Calling Chinese LLMs from outside China: measure first, then fix latency and stability
If you call a model hosted in mainland China from a server in Europe, the Americas or Southeast Asia, you have probably seen it: the first token takes a while, some requests hang for no clear reason,...