ChainForge
AI
llm evaluation tool
SHOW HN2023
177points
29comments
#331of 3,109 in 2023
Top 11%of 2023 by points
How HN took it
LovedMost comments that take a side are positive
7 positive, 10 neutral or asking, 1 mixed, 0 critical, out of 18 comments about the project. Thread score +0.33.
Idea: 2 for, 0 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
Useful for comparing outputs across models and parameterised queries
From 2 comments
I think you should probably mention that its source is available! [0] I don't personally have a need for this right now, but I can really see the use for the parameterised…
_puk on HNWe just used this on a project and it was very helpful! Cool to see it here on HN
ericskiff on HN
Objections
Licence and citation request considered unclear by some commenters
From 3 comments
"source available" means one thing, but this is properly MIT open source and i believe the authors should receive credit for that in this age of frankenlicenses EDIT: ah: "This…
swyx on HNI didn't want to open that can of worms: "If you use ChainForge for research purposes, or build upon the source code, we ask that you cite this project in any related…
_puk on HNIt says "we ask", not "you have to". I'd say it's open to interpretation that this is an informal request and not legally binding. Also I do want to open the can of worms and say…
7moritz7 on HN
Less community activity than Flowise and langflow
From 2 comments
I can't comment on the features, but ChainForge has some catching up to do...mind share wise. Below are some community insights for langflow, Flowise and ChainForge…
sdesol on HNI sort of know where you are coming from, but I think it is hard to discount the fact that 80 new people took the time to create 99 issues in the last 6 weeks in Flowise. No…
sdesol on HN
Requests
Google Vertex AI support
From 2 comments
I like it! Any plans to add Google Vertex AI support?
koryk on HNI meant for completion, chat and embedding. https://cloud.google.com/vertex-ai/docs/generative-ai/chat/test-chat-prompts#chat-query-drest . Some examples here. Vertex AI has the…
koryk on HN
Function call evaluation
From 2 comments
This looks excellent! It's a great interface for two things I'm struggling to make LlamaIndex do: explain and debug multi-step responses for agent flows, and cache queries…
mabcat on HNThank you for the kind words! Looking at the photo, I think you wouldn’t need the last prompt node there. As far as evaluating functions go, that’s unfortunately a ways off. But,…
fatso784 on HN
Questions
What prompt discovery means
From 2 comments
What exactly is prompt discovery?
maxlamb on HNAFAIK it's finding out what prompts to use for what LLM to get the answer your want E.g. this > Compare response quality across prompt permutations, across models, and across…
toxicFork on HN
How the tool was useful in practice
From 1 comment
May I ask, how was it useful ? I find it cool but I have a hard time justifying using it.
dekervin on HN
Alternatives named
langflow
From 1 comment
It seems to be more powerful than langflow and flowise https://github.com/logspace-ai/langflow https://github.com/FlowiseAI/Flowise
KRAKRISMOTT on HN
Flowise
From 1 comment
It seems to be more powerful than langflow and flowise https://github.com/logspace-ai/langflow https://github.com/FlowiseAI/Flowise
KRAKRISMOTT on HN
LlamaIndex
From 1 comment
This looks excellent! It's a great interface for two things I'm struggling to make LlamaIndex do: explain and debug multi-step responses for agent flows, and cache queries…
mabcat on HN