edgematic.dev
Infrastructure
caching for llm apis
SHOW HN2024
22points
3comments
#1,827of 3,515 in 2024
Top 52%of 2024 by points
How HN took it
QuietFewer than 5 comments about the project
0 positive, 2 neutral or asking, 0 mixed, 0 critical, out of 2 comments about the project.
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
Objections
No concrete data yet on savings; the 10x claim is anecdotal
From 1 comment
We are still exploring. We don’t have any concrete data yet, but in some instances, we've observed reductions up to ten times. This seems especially relevant to specific areas,…
zaiste on HN
Requests
Share the 'how much will it save' numbers and a demo
From 1 comment
Looks great, do you have any concrete data how much money it will save ? Also, how does it compare to for example GptCache[0] ? or any other semantic cache solution[1] ? [0]…
throwaway888abc on HN
Questions
How does it compare to GptCache and other semantic caches?
From 1 comment
Looks great, do you have any concrete data how much money it will save ? Also, how does it compare to for example GptCache[0] ? or any other semantic cache solution[1] ? [0]…
throwaway888abc on HN
Alternatives named
GptCache
From 1 comment
Looks great, do you have any concrete data how much money it will save ? Also, how does it compare to for example GptCache[0] ? or any other semantic cache solution[1] ? [0]…
throwaway888abc on HN
Portkey semantic cache
From 1 comment
Looks great, do you have any concrete data how much money it will save ? Also, how does it compare to for example GptCache[0] ? or any other semantic cache solution[1] ? [0]…
throwaway888abc on HN