Scholar Ninja

Learning and science

academic search engine

SHOW HN2014

98points
20comments
#278of 2,272 in 2014
Top 13%of 2014 by points

How HN took it

CuriousMostly questions and neutral comments

3 positive, 4 neutral or asking, 0 mixed, 1 critical, out of 8 comments about the project. Thread score +0.17.

Idea: 3 for, 1 against

The thread, comment by comment

Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.

positive neutral or mixed critical about another commenter or something else the maker

What HN said

What people liked

  • Distributed design guarantees non-centrality and is a valuable alternative to Google-like services.

    From 2 comments
    • I hope you carry on with this project. If there's any search engine that can beat Google (long into the future) it's a P2P one. Speaking of the devil, are you aware you can't…
      higherpurpose on HN
    • This is really great and is fully complementary to our Content Mine (contentmine.org). Its' very similar to what I proposed as "the World Wide Molecular Matrix" (WWMM) about 10…
      petermurrayrust on HN
  • Complementary to ContentMine's scraping work.

    From 2 comments
    • Jure, your projects never cease to impress me. Really looking forward to talking in depth at OKfest. This idea is so close to what we've been doing that it's a real shame we…
      Blahah on HN
    • This is really great and is fully complementary to our Content Mine (contentmine.org). Its' very similar to what I proposed as "the World Wide Molecular Matrix" (WWMM) about 10…
      petermurrayrust on HN

Objections

  • Scraping publisher pages may violate publisher rights, including sui generis database rights.

    From 3 comments
    • It seems like nothing like this currently exists in a centralized, non-distributed way. Why add the complexity of a p2p network into an unproven concept? Is it purely to save on…
      yid on HN
    • > This is not crawling, only scraping from an already rendered page. They really can't complain. You may want to have a look at…
      gioele on HN
    • The problem is that the phrase "This is not crawling, only scraping" is to be taken with a grain of salt. If you find a page with a lot of information and you "just scrape it",…
      gioele on HN
  • Unclear whether a P2P approach is needed for an unproven concept.

    From 1 comment
    • It seems like nothing like this currently exists in a centralized, non-distributed way. Why add the complexity of a p2p network into an unproven concept? Is it purely to save on…
      yid on HN

Requests

  • Index open-access full texts such as CC-BY content.

    From 1 comment
    • Jure, your projects never cease to impress me. Really looking forward to talking in depth at OKfest. This idea is so close to what we've been doing that it's a real shame we…
      Blahah on HN
  • Use preprint sources via OAI harvesting or Common Crawl.

    From 2 comments
    • Why not index preprints, which are generally available via OAI harvesting? I'm not following the field closely at the moment, but I'm pretty sure PLOS at least has an OAI…
      nl on HN
    • What about http://commoncrawl.org/? Why not use it?
      hershel on HN

Questions

  • Why never index full texts?

    From 1 comment
    • Jure, your projects never cease to impress me. Really looking forward to talking in depth at OKfest. This idea is so close to what we've been doing that it's a real shame we…
      Blahah on HN
  • Is P2P needed for cost savings?

    From 1 comment
    • It seems like nothing like this currently exists in a centralized, non-distributed way. Why add the complexity of a p2p network into an unproven concept? Is it purely to save on…
      yid on HN

Alternatives named

  • Zotero translators

    From 1 comment
    • > I've been building a library of ScraperJSON definitions for academic publisher sites, and I've converged on some formats that work for a majority of publishers with no…
      kanzure on HN
  • Mendeley

    From 1 comment
    • This is really great and is fully complementary to our Content Mine (contentmine.org). Its' very similar to what I proposed as "the World Wide Molecular Matrix" (WWMM) about 10…
      petermurrayrust on HN
  • Common Crawl

    From 1 comment

Category, keywords, summaries and labels on this page were made by AI (Thread Reader v2) and not checked by hand. Each point links to the comments it came from.

Add a badge to your READMEShown on HackerShow
[![Shown on HackerShow](https://hackershow.org/badge.svg)](https://hackershow.org/show/7926005)