Serverless Analytics (Statsbot / Cube.js)

Data

web analytics

SHOW HN2018

114points
47comments
#380of 2,155 in 2018
Top 18%of 2018 by points

How HN took it

CuriousMostly questions and neutral comments

4 positive, 16 neutral or asking, 0 mixed, 5 critical, out of 25 comments about the project. Thread score +0.02.

Idea: 1 for, 2 againstExecution: 1 for, 2 againstPerformance: 0 for, 1 against

The thread, comment by comment

Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.

positive neutral or mixed critical about another commenter or something else the maker

What HN said

What people liked

  • Interesting and nicely presented

    From 1 comment
    • Interesting and nicely presented! I built a prototype of something very similar, but using Google BigQuery to store and extract data[0] but never took it beyond the concept…
      gingerlime on HN
  • Clever meta idea of a serverless analytics tool featured on HN

    From 1 comment
    • Build serverless app to track web stats. Get it featured on Hacker News and use the flood of traffic to demo what was done. Very meta. Nice job.
      code4tee on HN

Objections

  • Cannot replicate Google Analytics session and user metrics

    From 1 comment
    • I mean as a POC its not bad, but google analytics is not the same as analyzing server logs (contrary to what most people would suggest). Most of the value of ga comes from…
      soared on HN
  • Vulnerable to bot and scanner traffic corrupting data

    From 2 comments
    • This sort of thing works until you have one person run a security scan on your site, corrupting your user agents and event types.
      teej on HN
    • > google analytics is not the same as analyzing server logs This is what most people don’t get with ga. Google Analytics does the heavy lift by removing incoherent , corrupted or…
      asien on HN
  • Endless loading bug

    From 1 comment
  • The term serverless is misleading

    From 2 comments
    • "serverless" is really the misnomer of the year.
      lucb1e on HN
    • I hope this one won't stick. I never call it serverless because it doesn't make any sense to me (I call it "shared hosting", the term everyone already knows). Then, by pointing…
      lucb1e on HN

Requests

  • Cost estimate at some traffic level

    From 1 comment
    • I'd be curious to see a cost estimate for some traffic level. I wonder if there's a way to put the pixel in s3 and process the access logs more cheaply.
      cheriot on HN
  • Explain what Cube.js does in the pipeline

    From 2 comments
    • Please explain what is cube.js doing in this? I mean, what exactly cubejs does.
      InGodsName on HN
    • Why do you need to select all rows in your Cubejs section when you can directly run query in athena and get back the aggregates you need. Basically you select all rows then cubjs…
      InGodsName on HN

Questions

  • Why use Cube.js when Athena can be queried directly

    From 2 comments
    • Why do you need to select all rows in your Cubejs section when you can directly run query in athena and get back the aggregates you need. Basically you select all rows then cubjs…
      InGodsName on HN
    • Here is some more data: http://highscalability.com/blog/2018/4/2/how-ipdata-serves-25m-api-calls-from-10-infinitely-scalable.html I don't understand what's cubejs doing in this…
      InGodsName on HN
  • Why not use S3 access logs or Fastly instead

    From 2 comments
    • Is fastly free? Why would they use fastly and not s3?
      InGodsName on HN
    • I’ve seen folks put their pixel endpoint behind Fastly and process the access log delivered in S3. A Fastly VCL can handle the same transform that this Lambda is doing.
      teej on HN

Alternatives named

  • Snowplow

    From 1 comment
    • Side note: If you want to build your own mid-size event analytics data pipeline, then I recommend looking at snowplow: https://github.com/snowplow/snowplow
      manigandham on HN
  • Google Analytics

    From 1 comment
    • Genuine question. What does this do that just inserting vanilla GA code in the page doesn't? Trying to understand the "why".
      tyingq on HN
  • BigQuery-based GA clone

    From 2 comments
    • Interesting and nicely presented! I built a prototype of something very similar, but using Google BigQuery to store and extract data[0] but never took it beyond the concept…
      gingerlime on HN
    • Interesting. I once built a ga clone using appengine, cloud dataflow, and big query. I guess that would count as serverless? Benchmarked it against the official dumps to big quey…
      jimktrains2 on HN

Category, keywords, summaries and labels on this page were made by AI (Thread Reader v2) and not checked by hand. Each point links to the comments it came from.

Add a badge to your READMEShown on HackerShow
[![Shown on HackerShow](https://hackershow.org/badge.svg)](https://hackershow.org/show/18725485)