Vector on HackerShow

Infrastructure

log and metric routing

SHOW HN2019

Legend

A High-Performance Log and Metric Router Written in Rust

Shown by zhs on Jul 2, 2019. Click the card to turn it over.

322points

63comments

#89of 2,195 in 2019

Top 5%of 2019 by points

How HN took it

CuriousMostly questions and neutral comments

12 positive, 27 neutral or asking, 1 mixed, 11 critical, out of 51 comments about the project. Thread score +0.12.

Idea: 3 for, 3 againstExecution: 2 for, 2 againstPerformance: 1 for, 3 againstDocs: 1 for, 2 against

Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.

positive neutral or mixed critical about another commenter or something else the maker

Fewer inputs and outputs than established tools
From 1 comment
- There already are a lot of projects in this space. While better performance is always great, most are already plenty fast for the majority of use cases. The main power comes from…
  the_duke on HN
Benchmarks against Logstash appear unfair due to default memory config
From 2 comments
- They are using the default config with 1GB memory. Sadly that's absolutely nothing for Logstash. Reported an issue in their test harness.
  the_duke on HN
- It's perfectly valid to mention the higher memory requirements as a considerable drawback. But this is far from the possible performance that Logstash offers, so the comparison…
  the_duke on HN

Add Clickhouse sink
From 2 comments
- We use a rather bespoke syslog -> clickhouse log sink (https://github.com/discordapp/punt/tree/clickhouse) we wrote in house because logstash (and then subsequently elastic…
  jhgg on HN
- Absolutely, this is likely the next integration we'll be working on. There were a few features schema-wise that we needed support before we started, but we're _very_ close. We'd…
  binarylogic on HN
Add metrics sources and sinks such as Graphite and Datadog
From 1 comment
- Thank you! Very glad it looks useful to you. It's still slightly rough around the edges, but Vector can actually ingest metrics today in addition to deriving metrics from log…
  lukes386 on HN

How does it compare to Telegraf
From 1 comment
- How does this compare to telegraf? https://github.com/influxdata/telegraf Biggest thing that pops out to me is LUA engine (seems amazing :) )
  dm03514 on HN
Does it handle back pressure
From 1 comment
- How do you handle back pressure? Do you have specific module for it?
  rishiloyola on HN

Filebeat
From 2 comments
- I was dragging my feet to build a log shipper solution. I was going to use Filebeat -> ElasticSearch -> Kibana. This looks great. My primary attraction is possibly low memory…
  reacharavindh on HN
- You better use something reliable and tested like Filebeat, it's written in Go and is fast enough / low memory usage.
  Thaxll on HN
Telegraf
From 1 comment
- How does this compare to telegraf? https://github.com/influxdata/telegraf Biggest thing that pops out to me is LUA engine (seems amazing :) )
  dm03514 on HN
Veneur
From 1 comment
- Seems similar to Veneur (like many other projects mentioned in comments here; didn't realize this space was so crowded!) - down to the first two letters of the name:…
  kalkin on HN
mtail
From 1 comment
- What you're asking for kinda exist, it's called mtail, check it out !
  navaati on HN
Logstash
From 1 comment
- Well logstash is now supporting good persistent queue. https://www.elastic.co/guide/en/logstash/current/persistent-queues.html#durability-persistent-queues I don't know why…
  rishiloyola on HN