Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Without pinning providers, you pay let’s say 2x more for agentic coding, since that many input tokens aren’t cached as you bounce between providers.
 help



I believe OpenRouter addresses this with sticky routing and keeps a conversation on the same provider and falls back if that provider becomes unavailable via an explicit session_id to keep requests together. You’re right though that upon a failure cache is not portable and incurs additional costs.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: