Data Engineering Book

Learning and science

open source book

SHOW HN2026

251points
30comments
#194of 4,366 in 2026
Top 5%of 2026 by points

How HN took it

CuriousMostly questions and neutral comments

3 positive, 7 neutral or asking, 1 mixed, 3 critical, out of 14 comments about the project. Thread score 0.00.

Docs: 2 for, 3 against

The thread, comment by comment

Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.

positive neutral or mixed critical about another commenter or something else the maker

What HN said

What people liked

  • High-quality translation and useful later chapters

    From 2 comments
    • Thank you so much for this book! I'm finding the translation is very high quality. I am a complete novice in training LLMs, and have been trying to train a novel architecture for…
      fudged71 on HN
    • I'm not sure whether this is an artefact of translation, but things like this don't inspire confidence: > The "Modern Data Stack" (MDS) is a hot concept in data engineering in…
      hliyan on HN
  • Good RAG sections

    From 1 comment
    • I'm not sure whether this is an artefact of translation, but things like this don't inspire confidence: > The "Modern Data Stack" (MDS) is a hot concept in data engineering in…
      hliyan on HN

Objections

  • Text reads as LLM-generated with fake warmth

    From 2 comments
    • I think it was. It's a wall of information, lots of summary tables, fake warmth, and has that LLM smell to it. I'd be very surprised if this wasn't generated text. Whether it's…
      nimonian on HN
    • this is great and i bookmarked it so i can read it later. i’m just curious though, was the readme written by chatgpt? i can’t tell if im paranoid thinking everything is written…
      osamabinladen on HN
  • Modern Data Stack intro is unclear from translation

    From 1 comment
    • I'm not sure whether this is an artefact of translation, but things like this don't inspire confidence: > The "Modern Data Stack" (MDS) is a hot concept in data engineering in…
      hliyan on HN
  • Missing table formats like Delta and Iceberg

    From 1 comment
    • Parquet alone is not for modern data engineering. Delta, Iceberg should be in the list
      alexott on HN
  • Figures were in Chinese in some chapters

    From 1 comment
    • The figures in the different chapters are in english (it's not the case for the image in README_en.md).
      guillem_lefait on HN

Requests

  • Cover table and storage formats like Lance and Vortex

    From 1 comment
    • It's important in a book treating an emerging field (data eng for LLMs) to mention emerging categories related to it such as storage formats purpose built for the full ML…
      cpard on HN
  • Cover hybrid search and reranking

    From 1 comment
    • The 'Vector DB vs Keyword Search' section caught my eye. In your testing for RAG pipelines, where do you draw the line? We've found keyword search (BM25) often beats semantic…
      13pixels on HN
  • Add code-focused datasets and tooling

    From 1 comment
    • Thank you so much for this book! I'm finding the translation is very high quality. I am a complete novice in training LLMs, and have been trying to train a novel architecture for…
      fudged71 on HN

Questions

  • Was the readme written by ChatGPT?

    From 1 comment
    • this is great and i bookmarked it so i can read it later. i’m just curious though, was the readme written by chatgpt? i can’t tell if im paranoid thinking everything is written…
      osamabinladen on HN
  • Why is a Chinese publication on the HN front page?

    From 1 comment

Alternatives named

  • Lance

    From 1 comment
    • It's important in a book treating an emerging field (data eng for LLMs) to mention emerging categories related to it such as storage formats purpose built for the full ML…
      cpard on HN
  • Vortex

    From 1 comment
    • It's important in a book treating an emerging field (data eng for LLMs) to mention emerging categories related to it such as storage formats purpose built for the full ML…
      cpard on HN
  • Delta Lake and Iceberg

    From 1 comment
    • Parquet alone is not for modern data engineering. Delta, Iceberg should be in the list
      alexott on HN

Category, keywords, summaries and labels on this page were made by AI (Thread Reader v2) and not checked by hand. Each point links to the comments it came from.

Add a badge to your READMEShown on HackerShow
[![Shown on HackerShow](https://hackershow.org/badge.svg)](https://hackershow.org/show/47008163)