choppingboard.recipes

Web and SaaS

recipe scraping api

SHOW HN2017

208points
105comments
#155of 2,242 in 2017
Top 7%of 2017 by points

How HN took it

MixedNo clear lean

6 positive, 17 neutral or asking, 1 mixed, 11 critical, out of 35 comments about the project. Thread score -0.09.

Idea: 3 for, 4 againstDesign: 0 for, 5 againstExecution: 3 for, 2 against

The thread, comment by comment

Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.

positive neutral or mixed critical about another commenter or something else the maker

What HN said

What people liked

  • Works on many recipe sites and non-English pages

    From 2 comments
    • Impressively, it also works for languages other than English (albeit having trouble with formatting here and there). Is there a behind-the-scenes somewhere? Is this regex magic…
      bomdo on HN
    • Very impressed, works fine on websites in Swedish even.
      staticelf on HN
  • Structured recipe data is needed

    From 2 comments
    • It looks good and seems to work with some arbitrarily picked recipes on the usual large recipe websites, although more obscure links cause some bugs¹. Is the source code on…
      Freak_NL on HN
    • This is sorely needed, so many recipe blogs follow that tired format of 'long diatribe about something moderately health or family related' then the recipe. Cool!
      borne0 on HN

Objections

  • Fails on some sites with JSON parse errors

    From 3 comments
    • Not sure if this is supposed to work, but german recipe site "chefkoch.de"[1] gave me a "Unexpected token in JSON at position 1611" error. [1]…
      moepstar on HN
    • The first recipe I tried gave me an unexpected json error. Seems to only work with a few sites. Cool idea though.
      zackify on HN
    • It looks good and seems to work with some arbitrarily picked recipes on the usual large recipe websites, although more obscure links cause some bugs¹. Is the source code on…
      Freak_NL on HN
  • Scraping may violate recipe sites' terms and copyright

    From 2 comments
    • It looks good and seems to work with some arbitrarily picked recipes on the usual large recipe websites, although more obscure links cause some bugs¹. Is the source code on…
      Freak_NL on HN
    • This falls under the category of unethical scraping
      Dowwie on HN
  • Ingredient strings lack structured quantity and unit data

    From 2 comments
    • This really seems to be an exercise in 'structuring recipe data' rather than the ins-and-outs of scraping. Seems like a much-needed task; is there anything approaching a…
      oneeyedpigeon on HN
    • This standard is not unique to Google. It's part of the Schema.org initiative to add semantics to the web. The full definition is here: http://schema.org/Recipe The biggest…
      blackskad on HN
  • Unit conversion and volume-to-weight ambiguity

    From 2 comments
    • MyFitnessPal has the same issue where the quantity values mixed between different units, but also between volume(cup) vs weight(grams). So its a pain in the neck to know how…
      simooooo on HN
    • Well, as surprising as it might sound there seem to be many units in the kitchen which are not so easy to convert. One example: How many milliliters does a table spoon have?…
      JepZ on HN

Requests

  • Structured ingredients with quantity, unit and preparation

    From 1 comment
    • This really seems to be an exercise in 'structuring recipe data' rather than the ins-and-outs of scraping. Seems like a much-needed task; is there anything approaching a…
      oneeyedpigeon on HN
  • Recipe yield and scaling to number of servings

    From 2 comments
    • What I'm missing the most in this context is for how many people those ingredients actually are. That's necessary if you want to scale the recipe to fewer or more people.
      ygra on HN
    • It's kinda weird that it's not included yet. The schema.org spec has a field 'recipeYield' specifically for this purpose and it's present in the meatball example on the site. It…
      blackskad on HN
  • Unit conversion

    From 1 comment
    • Two things that would be so nice would be easy scaling, and unit conversion (even better if that's automatic)
      askvictor on HN
  • Clean up HTML entities in output

    From 1 comment
    • It looks good and seems to work with some arbitrarily picked recipes on the usual large recipe websites, although more obscure links cause some bugs¹. Is the source code on…
      Freak_NL on HN

Questions

  • Is the source code on GitHub?

    From 1 comment
    • It looks good and seems to work with some arbitrarily picked recipes on the usual large recipe websites, although more obscure links cause some bugs¹. Is the source code on…
      Freak_NL on HN
  • Does it use bespoke code per site or generic parsing?

    From 2 comments
    • It looks good and seems to work with some arbitrarily picked recipes on the usual large recipe websites, although more obscure links cause some bugs¹. Is the source code on…
      Freak_NL on HN
    • Impressively, it also works for languages other than English (albeit having trouble with formatting here and there). Is there a behind-the-scenes somewhere? Is this regex magic…
      bomdo on HN
  • Is there a standard for recipe data?

    From 2 comments
    • This really seems to be an exercise in 'structuring recipe data' rather than the ins-and-outs of scraping. Seems like a much-needed task; is there anything approaching a…
      oneeyedpigeon on HN
    • There is a standard of sorts, if you trust Google: https://developers.google.com/search/docs/data-types/recipes
      Jaruzel on HN

Alternatives named

  • schema.org Recipe markup

    From 2 comments
    • http://schema.org/Recipe
      arthurpaul on HN
    • This standard is not unique to Google. It's part of the Schema.org initiative to add semantics to the web. The full definition is here: http://schema.org/Recipe The biggest…
      blackskad on HN
  • hRecipe microformat

    From 2 comments
    • Back when microformats were all the rage there was h-recipe http://microformats.org/wiki/hrecipe
      kozhevnikov on HN
    • Yes, this one is the most used http://microformats.org/wiki/h-recipe
      lpasselin on HN
  • Copy Me That

    From 1 comment
    • I made a recipe scraper that doesn't look at the structured (schema) data, but instead "reads" the whole page to detect the recipe. I found that there are too many recipe sites…
      tinebak on HN
  • PantryPlan

    From 1 comment
    • Check out PantryPlan: https://pantryplan.io. It does exactly that and not just meal-by-meal but entire menus. Disclaimer: I made it. :) Let me know your thoughts.
      madamelic on HN
  • Supercook

    From 1 comment
    • http://www.supercook.com (Enter ingredients, get recipes)
      lprubin on HN

Category, keywords, summaries and labels on this page were made by AI (Thread Reader v2) and not checked by hand. Each point links to the comments it came from.

Add a badge to your READMEShown on HackerShow
[![Shown on HackerShow](https://hackershow.org/badge.svg)](https://hackershow.org/show/14794949)