ParseHub
Data
web scraping
SHOW HN2014
143points
69comments
#177of 2,272 in 2014
Top 8%of 2014 by points
How HN took it
MixedNo clear lean
9 positive, 15 neutral or asking, 5 mixed, 10 critical, out of 39 comments about the project. Thread score 0.00.
Execution: 1 for, 3 againstPrivacy: 0 for, 3 againstDocs: 0 for, 3 againstIdea: 2 for, 0 againstPerformance: 2 for, 0 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
Handles dynamic sites like Airbnb better than alternatives
From 2 comments
After using both there is a very large brick wall that prevents usability of kimono labs on most well-known web applications (airbnb, craiglist, etc). Example is data extraction…
blklane on HNWe think Kimono is a great tool, but it is very limited in capability. We specifically focus on handling highly dynamic or interactive websites. Our toolset gives you more…
tsergiu on HN
Visual interface and tutorials are well done
From 2 comments
The demo is magical. Excellent work! One question about this FAQ: ``` > Does ParseHub respect robots.txt? > We're working on an admin panel to give webmasters full transparency…
ihiram on HNThe tutorial was quite excellent. Unfortunately I get stuck at the "zooming" portion. Pressing ctrl+[ does nothing for me. (Firefox 32.0 on Ubuntu 12.04)
michaelmior on HN
Automatic IP rotation is a useful feature
From 1 comment
Agreed on this point. The automatic IP rotation is one of the bigger features I think.
balor123 on HN
Objections
Does not respect robots.txt yet
From 2 comments
Sorry, we'll make the wording more clear. At the moment, ParseHub does not respect robots.txt. We do expect to add this + features for webmasters in the future, but have not had…
tsergiu on HNPlease add this sooner than "in the future". Obeying the robots.txt is a _MUST_ for any robots out there. This also from a content owner. Thank you.
spacefight on HN
Pricing is steep for casual use
From 1 comment
The website looks really interesting and very useful if it works like in the demo. My only issue is $79 / mo starting plan looks a bit steep for casual development (I know there…
superasn on HN
Several docs and pricing pages returned 404
From 3 comments
Pricing page no found: ``` 404 Not Found The resource could not be found. /pricing ```
nivertech on HNAlso 404 https://www.parsehub.com/docs/template
nivertech on HNthanks! I've sent you an email. Also couldn't figure out how to use select boxes, radio buttons, or fill a specific text field on the page. The "expression" page in the doc is…
superasn on HN
Keyboard shortcut for zooming does not work
From 2 comments
The tutorial was quite excellent. Unfortunately I get stuck at the "zooming" portion. Pressing ctrl+[ does nothing for me. (Firefox 32.0 on Ubuntu 12.04)
michaelmior on HNYeah, I'm having the same problem. It might be related to the fact that Ctrl + ] is also the keyboard shortcut to nagivate back in firefox [1], so when I try it I end up going…
jotaass on HN
Requests
Respect robots.txt and label the bot
From 2 comments
Please add this sooner than "in the future". Obeying the robots.txt is a _MUST_ for any robots out there. This also from a content owner. Thank you.
spacefight on HN"Our goal here is to be able to distinguish between the good type and bad type of scraping and give webmasters full transparency. Obviously this is a hard problem. If you have…
spacefight on HN
Chrome extension
From 1 comment
Love the tool, wish I had this over a lot of other scrapers on multiple projects. Is a chrome extensions in the works at all?
jbhatab on HN
Offline or local deployment
From 2 comments
Does this work in a website with password? e.g. can I fill a form and give user/pwd as the first step? (I did the tutorials but couldn't figure it out) Also are you thinking on…
zzleeper on HNExcellent! How about creating google now replica but for offline use + more private data dashboard. - Use your platform to parse dynamic website which are completely under…
nextbig on HN
Support for select boxes, radio buttons and text fields
From 1 comment
thanks! I've sent you an email. Also couldn't figure out how to use select boxes, radio buttons, or fill a specific text field on the page. The "expression" page in the doc is…
superasn on HN
Questions
Does it work with login forms and passwords
From 1 comment
Does this work in a website with password? e.g. can I fill a form and give user/pwd as the first step? (I did the tutorials but couldn't figure it out) Also are you thinking on…
zzleeper on HN
Is scraping Google search results legal
From 1 comment
Is this legal? Can I use this to scrape and store Google Search results?
Kiro on HN
How does it compare to Kimono Labs
From 1 comment
Looks powerful. Just curious, how does it compare to Kimono Labs?
ar7hur on HN
Alternatives named
Kimono Labs
From 2 comments
Looks powerful. Just curious, how does it compare to Kimono Labs?
ar7hur on HNHow does ParseHub compare to Kimono [1]? I use Kimono daily (scraping government expense docs), and I love how it works on static sites. If you've managed to replicate that on…
fnbr on HN
scrape.it
From 2 comments
https://scrape.it requires chrome extension. We have had no problems or found it "restrictive" in anyway.
notastartup on HNUnlimited scraping at https://scrape.it is $20/month which has no restrictions in how many projects you can create or how many pages you can scrape.
notastartup on HN
SelectorGadget
From 1 comment
Very cool! Another useful tool is http://selectorgadget.com
tectonic on HN
PhantomJS
From 1 comment
Scraping is always such a pain, this looks incredibly well done. I've personally have had a really good experience with PhantomJS. What does your backend look like? (What happens…
plingamp on HN