ScratchDB

Data

managed olap database

SHOW HN2023

261points
56comments
#187of 3,109 in 2023
Top 7%of 2023 by points

How HN took it

CuriousMostly questions and neutral comments

4 positive, 21 neutral or asking, 1 mixed, 7 critical, out of 33 comments about the project. Thread score -0.03.

Idea: 1 for, 3 againstExecution: 0 for, 2 againstPricing: 0 for, 2 against

The thread, comment by comment

Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.

positive neutral or mixed critical about another commenter or something else the maker

What HN said

What people liked

  • Simple JSON-in, SQL-out workflow

    From 1 comment
    • Not the parent poster, but I wouldn't race to solve the problem via supporting many more connectors that require lots of config options. You'll just spend time supporting lots of…
      NortySpock on HN
  • Open-source with strong developer experience

    From 2 comments
    • > Philosophically, I think there is a lot of room for open-source software that also has an amazing UI and developer experience. +1 to that! Welcome to the ClickHouse community!
      tbragin on HN
    • ScratchDB has save my business and it's awesome. I think if you need a columnar store, you should really try these guys
      wkoszek on HN

Objections

  • 'Open-Source Snowflake' name implies feature parity that the project does not aim for

    From 2 comments
    • I too was confused by the title. If it doesn't support feature-parity, nor approach the problem space from the same perspective as Snowflake, I don't think it's the open source…
      skeeter2020 on HN
    • Calling it "Open-Source Snowflake" implies you are trying to be a drop-in replacement for Snowflake for at least a subset of features, SQL syntax, etc.
      willseth on HN
  • Storage pricing appears high compared with BigQuery

    From 2 comments
    • Why is your storage 10X that of bigtable? How does your compute price compare to bigtable?
      ddorian43 on HN
    • I wrote wrong, I meant bigquery, sorry. It's 9x of bigquery.
      ddorian43 on HN
  • Nested JSON flattening has edge cases such as key collisions

    From 2 comments
    • What happens with this? ``` { "some_key": "1" "some": { "key": "2" } } ```
      zepolen on HN
    • I tested it with the “explode” flattening mode, and it resulted in { “some_key”: “2” }
      mosen on HN

Requests

  • Support for CSV, Parquet, Avro or Protobuf ingestion

    From 1 comment
    • Thanks for sharing. Looks very clean and simple to use. Do you plan on supporting non-JSON data types for insertion? For example, inserting CSV files, parquet files, Avro or…
      pitah1 on HN
  • Ability to define explicit schemas and compression per column

    From 1 comment
    • Congrats with the launch. This looks great. Inferring schemas on the fly is awesome to get started quickly, but are there ways to explicitly define a schema if I wanted to? For…
      gbrits on HN
  • Use a standard JSON flattening approach

    From 1 comment
    • maybe use the json flattening RFC instead of inventing your own?
      lionkor on HN

Questions

  • How the project differs from Tinybird and GraphJSON

    From 2 comments
    • Disclaimer: I work at ClickHouse. Thank you! Looks really interesting! I personally agree that real-time OLAP databases have potential to better serve workloads currently in…
      tbragin on HN
    • > how you see your project differs from GraphJSON (https://www.graphjson.com/) and Tinybird (https://www.tinybird.co/)? Not OP, but neither of these appear to be open source?
      mike_d on HN
  • What the AGPL license means for hosted use

    From 1 comment
    • What does the license mean, if I don't change any of the code you provide, but use it to provide a public-facing service? Like if I use it for a forum, for instance, but am using…
      shrubble on HN
  • How primary keys are chosen for auto-created tables

    From 1 comment
    • This looks great. I have one question. When you are automatically creating tables, how do you choose primary keys order for clickhouse table?
      jed_sanders12 on HN

Alternatives named

  • Tinybird

    From 1 comment
    • Disclaimer: I work at ClickHouse. Thank you! Looks really interesting! I personally agree that real-time OLAP databases have potential to better serve workloads currently in…
      tbragin on HN
  • GraphJSON

    From 1 comment
    • Disclaimer: I work at ClickHouse. Thank you! Looks really interesting! I personally agree that real-time OLAP databases have potential to better serve workloads currently in…
      tbragin on HN
  • Snowflake

    From 1 comment
    • Can you explain what "open-source Snowflake" means, since you don't explain it in this description, in the repo, or on the site? Is your goal explicitly to replicate all…
      CharlesW on HN
  • Google BigQuery

    From 1 comment
    • Why is your storage 10X that of bigtable? How does your compute price compare to bigtable?
      ddorian43 on HN
  • TiDB with TiFlash

    From 1 comment
    • TiDB is an HTAP whose OLAP component (TiFlash) was based on Clickhouse: https://news.ycombinator.com/item?id=23584022 If you have analyzed the competition, what are your selling…
      esafak on HN

Category, keywords, summaries and labels on this page were made by AI (Thread Reader v2) and not checked by hand. Each point links to the comments it came from.

Add a badge to your READMEShown on HackerShow
[![Shown on HackerShow](https://hackershow.org/badge.svg)](https://hackershow.org/show/38038239)