Apify SDK

Dev tools

web scraping library

SHOW HN2018

Apify SDK

A scalable web crawling and scraping library for JavaScript

github.com

#web scraping#web crawler#javascript#puppeteer#headless chrome

78points
8comments
#555of 2,155 in 2018
Top 26%of 2018 by points

How HN took it

QuietFewer than 5 comments about the project

3 positive, 1 neutral or asking, 0 mixed, 0 critical, out of 4 comments about the project.

Idea: 1 for, 0 againstDocs: 1 for, 0 against

The thread, comment by comment

Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.

positive neutral or mixed critical about another commenter or something else the maker

What HN said

What people liked

  • Solves a real problem for crawling users

    From 1 comment
    • I wish I could upvote this more. This solves a huge problem for me and will definitely be taking a peek at this over the weekend. Thank you so much for making and sharing this!
      rajangdavis on HN
  • Extensive documentation

    From 1 comment
    • Thanks, this looks solid, with a really extensive documentation. I will give it a try for my next crawling/bot project :)
      darekkay on HN
  • Timely for replacing an old scraper

    From 1 comment
    • This comes just in time when I needed to replace an old scraper! Does it have to run on an instance or can we also use a serverless environnement?
      raitom on HN

Requests

  • Clarify whether it runs in serverless environments

    From 1 comment
    • This comes just in time when I needed to replace an old scraper! Does it have to run on an instance or can we also use a serverless environnement?
      raitom on HN

Questions

  • Can it run on serverless platforms instead of an instance?

    From 1 comment
    • This comes just in time when I needed to replace an old scraper! Does it have to run on an instance or can we also use a serverless environnement?
      raitom on HN

Alternatives named

  • Scrapy (Python)

    From 1 comment
    • Hey guys, today we’re showing HN a new open-source library that we have been working on for almost a year. It incorporates lessons learned from scraping of thousands of websites…
      jancurn on HN

Category, keywords, summaries and labels on this page were made by AI (Thread Reader v2) and not checked by hand. Each point links to the comments it came from.

Add a badge to your READMEShown on HackerShow
[![Shown on HackerShow](https://hackershow.org/badge.svg)](https://hackershow.org/show/18064493)