Arroyo

Data

stream processing

SHOW HN2023

115points
32comments
#552of 3,109 in 2023
Top 18%of 2023 by points

How HN took it

CuriousMostly questions and neutral comments

2 positive, 10 neutral or asking, 1 mixed, 1 critical, out of 14 comments about the project. Thread score +0.02.

Design: 1 for, 1 againstPerformance: 1 for, 0 against

The thread, comment by comment

Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.

positive neutral or mixed critical about another commenter or something else the maker

What HN said

What people liked

  • Good to see non-JVM streaming projects and SQL-first API

    From 1 comment
    • Between Flink, Spark and KSQL, streaming is very JVM centric. It is nice to see more non JVM projects emerge. I am not sure about your premise that the operations side is…
      benjaminwootton on HN
  • Support for Nomad is welcome

    From 1 comment
    • This looks great, and it’s very cool that it recommends Nomad to run it in production. I wish more products would support (or at least document how to run on) Nomad.
      httgp on HN

Objections

  • Late-arriving events are silently dropped by watermarks

    From 1 comment
    • In the watermarks documentation it mentions that events arriving after the watermark are dropped. Are there any plans to make this configurable (to disable dropping or trigger…
      jsty on HN
  • Watermarks appear to be fixed length

    From 1 comment
    • Unbounded streams, but with watermarks (which right now seem fixed length?): https://doc.arroyo.dev/concepts#watermarks Also works based on fixed, pre-built pipelines. This is…
      thom on HN

Requests

  • Configurable handling of late-arriving data and alerts

    From 1 comment
    • In the watermarks documentation it mentions that events arriving after the watermark are dropped. Are there any plans to make this configurable (to disable dropping or trigger…
      jsty on HN
  • Nexmark or performance benchmarks against Flink and DBSP

    From 1 comment
    • As an aside - we are evaluating different streaming engines to power data projections for Prisma.io. Excited to see support for Debezium coming in v0.4.0. Would be interesting to…
      sorenbs on HN

Questions

  • How does it compare to Flink in pros and cons and resource use

    From 1 comment
    • Very interesting project, Arroyo has been on my watch list for a while! How would you say does Arroyo compare to Apache Flink, i.e. what are pros and cons? For instance, given…
      gunnarmorling on HN
  • How does it compare to Materialize

    From 1 comment
  • Is it an alternative to Confluent KSQL

    From 1 comment
  • How does feature parity compare with Tinybird

    From 1 comment
    • Very exciting, how is feature parity with tinybird? https://www.tinybird.co/
      KRAKRISMOTT on HN

Alternatives named

  • Apache Flink

    From 1 comment
    • Very interesting project, Arroyo has been on my watch list for a while! How would you say does Arroyo compare to Apache Flink, i.e. what are pros and cons? For instance, given…
      gunnarmorling on HN
  • Confluent KSQL

    From 1 comment
  • DBSP

    From 1 comment
    • This is a really exciting project! I recently learned about https://github.com/vmware/database-stream-processor which builds on a new theoretical foundation and claims to be 9x…
      sorenbs on HN
  • Benthos

    From 1 comment
    • Looks cool. What is the difference between this tools and benthos (https://www.benthos.dev/)?
      yevpats on HN
  • Materialize

    From 1 comment
  • Tinybird

    From 1 comment
    • Very exciting, how is feature parity with tinybird? https://www.tinybird.co/
      KRAKRISMOTT on HN

Category, keywords, summaries and labels on this page were made by AI (Thread Reader v2) and not checked by hand. Each point links to the comments it came from.

Add a badge to your READMEShown on HackerShow
[![Shown on HackerShow](https://hackershow.org/badge.svg)](https://hackershow.org/show/36214393)