node-unfluff
Languages and libraries
web content extraction library
SHOW HN2014
How HN took it
2 positive, 4 neutral or asking, 0 mixed, 1 critical, out of 7 comments about the project. Thread score +0.10.
Idea: 1 for, 1 againstDesign: 1 for, 0 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
Simple, easy-to-use command line interface
From 1 comment
I love it! Very simple and straightforward interface. Makes it very easy to incorporate into a bigger workflow. You've followed the "do one thing well" command line tool…
christiangenco on HN
Install and use in seconds with no dependencies
From 1 comment
I'm sure Apache Tika is much more capable. For example, it supports html, csv, ppt, etc instead of just html. But it also requires Java/Maven and the installation process is far…
ageitgey on HN
Objections
Written in CoffeeScript, so transpiled output is hard to read
From 1 comment
> Unfluff is a small, simple .js library it's written in CoffeeScript (The transpiled JS files lack comments and meaningful new lines of the original CoffeeScript source.)
frik on HN
Extraction accuracy is unproven without a demo or measurement
From 2 comments
I fear you're exaggerating the success-rate of your algorithm. Have you tried to test it, if so: How did you measure a successful extract? The reason for my skepticism is Arc90's…
michaelmcmillan on HNI wish there was an online demo. I'd like to compare it to diffbot.com(a saas tool we pay for).
zaidf on HN
Requests
Provide an online demo
From 1 comment
I wish there was an online demo. I'd like to compare it to diffbot.com(a saas tool we pay for).
zaidf on HN
Use multiple pages from the same site to weight article content
From 1 comment
Nice! As an aid to extracting the right body content, have you considered comparing multiple pages from the same site, and giving greater weight to content that differs (the…
JoshTriplett on HN
Questions
How does it compare to Apache Tika
From 1 comment
How does this compare to Apache Tika? There is also a Node wrapper for Tika but don't remember the name of the module off the top of my head.
rpedela on HN
What is the unique value compared to other web scrapers
From 1 comment
whats the unique value proposition of this compared to the bajillion other web scrapers out there?
jgmmo on HN
Alternatives named
Apache Tika
From 1 comment
How does this compare to Apache Tika? There is also a Node wrapper for Tika but don't remember the name of the module off the top of my head.
rpedela on HN
Boilerpipe
From 2 comments
Most basic scraping libraries require you to input a bunch of regexs or css selectors to manually specify what you want to extract from a page. They require custom coding for…
ageitgey on HNthere is the boilerpipe library which I used to do a test on New Scientist a while back - we wanted to use ML to identify usefull clusters of content.
walshemj on HN
Goose
From 1 comment
Most basic scraping libraries require you to input a bunch of regexs or css selectors to manually specify what you want to extract from a page. They require custom coding for…
ageitgey on HN
Readability
From 1 comment
I fear you're exaggerating the success-rate of your algorithm. Have you tried to test it, if so: How did you measure a successful extract? The reason for my skepticism is Arc90's…
michaelmcmillan on HN
diffbot
From 1 comment
I wish there was an online demo. I'd like to compare it to diffbot.com(a saas tool we pay for).
zaidf on HN