Butter
Dev tools
llm caching proxy
SHOW HN2025
50points
22comments
#1,248of 3,837 in 2025
Top 33%of 2025 by points
How HN took it
CuriousMostly questions and neutral comments
2 positive, 6 neutral or asking, 2 mixed, 2 critical, out of 12 comments about the project. Thread score +0.05.
Idea: 2 for, 2 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
Deterministic RPA with AI fallback is a common approach
From 2 comments
We spoke to a number of browser agent companies who said deterministic RPA with an AI fallback was their "secret" :)
rajit on HNFunny, we are working to implement this same logic in our in-house financial categorization agent. When we have a repeat prompt it goes to a json that stores answers and only…
realitysballs on HN
Objections
Works only in predictable environments; can get in the way of agents
From 1 comment
I also did computer agents with a vc backed startup, ran into the same issues, and we built a fairly similar thing at one point. It’s useful but it has limitations, it seems to…
mountainriver on HN
Caching a bad run could cause persistent failures
From 1 comment
I’d love your opinion here! Right now, we assume first call is correct, and will eagerly take the first match we find while traversing the tree. One of the worst things that…
edunteman on HN
Pricing may not last
From 1 comment
I like the pricing model but I'm skeptical it will last.
puppycodes on HN
Requests
Support for local models
From 1 comment
What local models will it work with ? Also what will be the pricing for local llms?
Jayakumark on HN
Support for OpenRouter
From 1 comment
any plans to support https://openrouter.ai/ ?
felipe-pathwave on HN
Questions
Is caching appropriate when answers depend on context?
From 1 comment
interesting. is the answer not context specific most of the time? even if I ask LLM the same question again and again the answer depends on the context. what are some use cases…
invisibleink on HN
Is it legal given provider terms?
From 2 comments
Interesting... is it legal?
ronbenton on HNit wouldn't be the first API service to disallow someone from selling a cache layer for their API. After all, this should likely result in OpenAI (or whatever provider) making…
ronbenton on HN