Checksum
Dev tools
end-to-end testing
SHOW HN2023
How HN took it
4 positive, 4 neutral or asking, 1 mixed, 9 critical, out of 18 comments about the project. Thread score -0.25.
Idea: 2 for, 3 againstDocs: 1 for, 1 againstExecution: 0 for, 2 againstDesign: 0 for, 1 againstPerformance: 0 for, 1 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
Idea seen as promising and interesting.
From 3 comments
Congratulations on all the progress you've made! We are all learning as we're building and talking to users. I know for my team, E2E/Integration testing is our main priority…
jtambunt on HNAwesome idea! Excited to see where this goes
execore-1 on HNCongrats! Definitely think QA farms can be automated using AI! Can you explain more what part Checksum is using AI? Is it for the identification of user sessions that are good…
varunjain99 on HN
Objections
Name 'Checksum' suggests crypto/security rather than testing.
From 1 comment
This is dope, a couple of feedback points from a technical person that is a potential customer (I could be wrong on these!): -- I think the name doesn't sell me or even most…
therealrifath on HN
Unclear how the AI verifies correct behavior and bugs without human oracles.
From 3 comments
Most tool companies making claims about their tools show a shocking lack of knowledge about testing. This generally guarantees that their tools are dismissed by serious…
satisfice on HNSo you are saying that your system needs me to do all the testing (it is infeasible to watch our users, because we test the product before it is released to any users) so it can…
satisfice on HNHow is the product different from the other test generation tools? How do you check if the are testing the intended behavior. My experience with automated testing solutions has…
sachuin23 on HN
Privacy handling of user session data, especially for HIPAA-type apps.
From 2 comments
How do you know what data is sensitive, and how do you anonymize? Thinking of apps that might fall under HIPAA etc
afro88 on HNThat's a great question! We actually use real user sessions to train our model, so when I use the term coverage our main metric is covering as many user behaviors as possible. We…
Bootstrapper909 on HN
No pricing published on the site.
From 1 comment
Nothing on pricing on your site. Makes any other question difficult to formulate.
BillSaysThis on HN
Performance claims were vague.
From 1 comment
> Our impact on performance is non-existent as we use battle-tested open source tools used by Fortune 500 companies What does that mean, exactly? Just because it's open source…
ezekg on HN
Requests
Show example generated tests and a demo of setup and passing tests.
From 2 comments
This is a really compelling idea – but I'm having a little trouble making the leap from the high level description to what it would mean for my projects in more concrete terms.…
JohnFriel on HNThis is dope, a couple of feedback points from a technical person that is a potential customer (I could be wrong on these!): -- I think the name doesn't sell me or even most…
therealrifath on HN
Support for mobile apps such as React Native.
From 1 comment
Does it only support web? What about react native mobile apps?
mackeyja92 on HN
Questions
How does the model handle edge cases absent from training sessions?
From 1 comment
If this is trained on user sessions, how would the model learn to generate tests for edge cases that wouldn’t necessarily show up in the training data?
johnhenning on HN
How does the system decide a test passed, and how does it handle UI changes?
From 2 comments
congrats on the launch. 0 - seriously rethink your branding. I can help. 1 - how does the Ai know when the test is successful? — is it a visual comparison? — if so.. is there a…
artur_makly on HNMost tool companies making claims about their tools show a shocking lack of knowledge about testing. This generally guarantees that their tools are dismissed by serious…
satisfice on HN
How does it differ from other test generation tools?
From 2 comments
How is the product different from the other test generation tools? How do you check if the are testing the intended behavior. My experience with automated testing solutions has…
sachuin23 on HNcongrats on the launch. 0 - seriously rethink your branding. I can help. 1 - how does the Ai know when the test is successful? — is it a visual comparison? — if so.. is there a…
artur_makly on HN
Alternatives named
Meticulous.ai
From 1 comment
congrats on the launch. 0 - seriously rethink your branding. I can help. 1 - how does the Ai know when the test is successful? — is it a visual comparison? — if so.. is there a…
artur_makly on HN