From Dev.to
Going from top-5 to top-20 retrieval makes every RAG answer 2.7x more expensive
Your support bot answers from your docs. It gets a wrong answer in testing, so you raise top_k from 5 to 20 in the retriever settings, the next answer comes out right, and you ship it. Nobody notices...