From Dev.to
Your LLM call works 99% of the time. Your 100-call job fails 63% of the time.
You write a script that summarizes a 100-page PDF, one LLM call per page. It dies on page 71 with a timeout. You run it again, and it starts from page 1. No single part is broken: the API had one bad...