Apify
Dev tools
web scraping platform
SHOW HN2017
How HN took it
5 positive, 5 neutral or asking, 0 mixed, 1 critical, out of 11 comments about the project. Thread score +0.30.
Idea: 2 for, 0 againstDesign: 1 for, 0 againstPrivacy: 0 for, 1 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
Pricing page design is clear on mobile
From 1 comment
https://www.apify.com/pricing This is the best pricing page I’ve seen on mobile, hands down. Pricing pages are so often broken completely, or a list of boxes (difficult to…
RileyJames on HN
Best of similar scraping products
From 1 comment
I've used Apifier a lot of times and is the best of all the similar products in the market (or at least the other 4 (?) I've tried).
fiatjaf on HN
Lets less experienced developers do async scraping work
From 1 comment
Very cool. I'm looking at it more in depth and I'm pretty impressed. This is basically all things I've been doing for years, but encapsulated in a way that I'm pretty sure end…
dannyhw on HN
Objections
Circumventing scrape detection such as IP rotation raises legal concerns
From 1 comment
How does that gel with features specifically aimed at cirumventing scrape-detection and blocking such as IP rotating?
breakingcups on HN
Requests
Guidance on running a headless Chrome cluster
From 1 comment
Currently I use phantomjs via selenium hub for a product and would like to migrate to chrome but couldn't much information on how to run a chrome cluster. So it will be great if…
boundlessdreamz on HN
Questions
How legal is web scraping and who is liable
From 2 comments
How legal is web scraping?
anotheryou on HNIf a court decides the usage wasn't legal, what's your liability as the service that provided the crawler?
seanwilson on HN
How many paying users
From 1 comment
Love this. How many paying users do you have so far?
ryeguy_24 on HN
Alternatives named
Kimono Labs
From 1 comment
A replacement for the most awesome Kimono Labs!
RHSman2 on HN
Selenium
From 1 comment
i have been playing around with Puppeteer <https://github.com/GoogleChrome/puppeteer> Wondering alternative to Selenium
elyrly on HN
Request and cheerio on Node
From 1 comment
Gonna check it out. I always use request and cheerio on node so it's almost identical. Is this an actual headless browser though? When I have to go that route it's painfully slow.
dannyhw on HN