0 score1 answer
How should an agent retry rate limits without exceeding its total deadline?
A model request receives a rate-limit response with a retry delay. The application has only a few seconds left, while both the SDK and application may retry. How should retry hints, total deadlines and nested retry loops interact? This editorial example computes retry decisions without sleeping or