CoolQLCool

Dev tools

web scraping api

SHOW HN2018

124points
22comments
#342of 2,155 in 2018
Top 16%of 2018 by points

How HN took it

LovedMost comments that take a side are positive

4 positive, 8 neutral or asking, 0 mixed, 0 critical, out of 12 comments about the project. Thread score +0.28.

Idea: 1 for, 0 againstExecution: 1 for, 0 against

The thread, comment by comment

Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.

positive neutral or mixed critical about another commenter or something else the maker

What HN said

What people liked

  • Great name and project

    From 3 comments
    • Awesome name, awesome project!
      VMG on HN
    • Great project! I can imagine this may greatly improve web certain classes of scraping. @gavino I'm curious what tooling and architecture you used to put this together?
      conceptpad on HN
    • Give this man an internet.
      powerslacker on HN
  • waitForSelector feature is cool

    From 1 comment
    • I've previously written a very similar project called "graphql-scraper" (which is arguably a far less cool name...), you can check it out at…
      lachenmayer on HN

Objections

  • Unclear how it handles throttling or captchas

    From 1 comment
    • Not sure what to make of this. How does it handle throttling or captchas?
      nurettin on HN
  • Page not loading in Materialistic Android reader

    From 1 comment
    • Page isn't loading in Materialistic (HN reader on Android/F-Droid repo), but: do you have this exact verbiage on it? It's very concise!
      acct1771 on HN

Requests

  • Help selecting table td by nth selector

    From 1 comment
    • I've been looking for something like this! I'm trying to play around with it but can't seem to get the selector right. How do I grab a table `td` by its nth selector (tried…
      pdxandi on HN
  • Swap cheerio for a remote browser

    From 1 comment
    • Are you planning to build anything on top of this - service,company? I was thinking it would be a good way to build an api for some projects I've been thinking of working on,…
      bryanrasmussen on HN

Questions

  • What are the use cases?

    From 1 comment
  • How does it handle throttling or captchas?

    From 1 comment
    • Not sure what to make of this. How does it handle throttling or captchas?
      nurettin on HN

Alternatives named

  • graphql-scraper

    From 1 comment
    • I've previously written a very similar project called "graphql-scraper" (which is arguably a far less cool name...), you can check it out at…
      lachenmayer on HN
  • GDOM

    From 2 comments
    • Nice! There is also similar project GDOM - https://github.com/syrusakbary/gdom written in Python.
      maio on HN
    • I remember seeing GDOM a while back when I first started this project, but forgot to write it down as a source of inspiration. I'm gonna add all of these as alternatives, because…
      gavino on HN
  • Yahoo Pipes

    From 1 comment
    • You're probably thinking about Yahoo Pipes: https://en.wikipedia.org/wiki/Yahoo!_Pipes
      pnevares on HN

Category, keywords, summaries and labels on this page were made by AI (Thread Reader v2) and not checked by hand. Each point links to the comments it came from.

Add a badge to your READMEShown on HackerShow
[![Shown on HackerShow](https://hackershow.org/badge.svg)](https://hackershow.org/show/18714461)