From Dev.to
I put a timestamp in my system prompt, and the cache never hit
I did not know prompt caching existed. I knew the API billed me per token, and I knew a long conversation cost more than a short one. What I did not know was that providers keep the processed prefix o...