Quickwit
Data
search engine for logs
SHOW HN2024
145points
51comments
#584of 3,515 in 2024
Top 17%of 2024 by points
How HN took it
CuriousMostly questions and neutral comments
8 positive, 16 neutral or asking, 0 mixed, 6 critical, out of 30 comments about the project. Thread score -0.04.
Pricing: 2 for, 2 againstExecution: 1 for, 1 againstDesign: 0 for, 2 againstIdea: 1 for, 1 againstPerformance: 1 for, 0 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
Cost savings and performance compared with Elasticsearch
From 2 comments
> To give you a concrete example, one company is ingesting hundreds of terabytes of logs daily and migrating from Elasticsearch to Quickwit. They divided their compute costs by…
dikei on HNGlad this is getting some love. This is seriously good software. Have you guys supported generic substring search yet? I recall it was not supported as of a few months ago.
marsupialtail_2 on HN
Object-storage design allows horizontal scaling with S3-compatible storage
From 1 comment
The most interesting part of Quickwit for me has been that because it stores the index in object stores, you can theoretically abstract away a lot of the horizontal scaling with…
jszymborski on HN
AGPL seen as a fitting free license for internal use
From 2 comments
I find AGPL perfect for this use case, and my org (>100k hosts) can use it without any problem as we are using it for internal purposes, and not, say, rebranding it and offering…
dvfjsdhgfv on HNThe GNU AGPL is considered a Free Software licence by the OSI, FSF, and the Debian project. That's good enough for me.
dwb on HN
Objections
Deployment seems complex with Kafka and other dependencies
From 1 comment
Looking at the docker compose, this seems like a very complicated tool to run. You'd need Kafka, zookeeper, and Jaeger. All would need to be HA. Then also this service. Not…
figmert on HN
Licence criticised as not truly open source or commercially restrictive
From 2 comments
That license is not FOSS. Users beware of the impending subscription costs to come.
besus on HNI find presenting this as an open source alternative to commercial solutions a little disingenuous when any commercial use of it also requires a paid license. Like many other…
jcwayne on HN
Lacks substring search and cardinality aggregation
From 2 comments
Glad this is getting some love. This is seriously good software. Have you guys supported generic substring search yet? I recall it was not supported as of a few months ago.
marsupialtail_2 on HNQuickwit is compatible with S3-compatible object storages yes. I don't remember the feedback for R2 specifically, but we have users running Quickwit on S3, GFS, Azure, MinIO,…
fulmicoton on HN
Requests
Kibana/OpenDashboard compatibility
From 2 comments
What I am really missing in these (really nice) alternatives to ELK is Kibana and its Lens. I tried to tapping this with Grafana but never learned to have graphs as easily as…
BrandoElFollito on HNGood point. Several users are asking us the OpenDashboard/Kibana compatibility, and this is on the 2024 roadmap. That being said, we also hear users complaining about…
francoismassot on HN
Elasticsearch Query DSL compatibility
From 1 comment
How far away is the ES Query DSL compatibility?
m1sta_ on HN
Support for updates and deletes
From 2 comments
So yes, currently we only support infrequent deletes for GDPR reasons mainly. It's possible to add updates/deletes to Quickwit, but this is a lot of work, and for now, we have…
francoismassot on HNOh, just run-of-the-mill full-text search of web crawls. Some web pages update frequently, so I would need something that can handle that. I do understand that you seem to be…
jszymborski on HN
Analytics and retention analysis
From 2 comments
I am impressed with this work, especially given our current use of Loki with Prometheus and Grafana. Few questions come to mind. Firstly, is Quickwit compatible with any S3…
matesz on HNQuickwit is compatible with S3-compatible object storages yes. I don't remember the feedback for R2 specifically, but we have users running Quickwit on S3, GFS, Azure, MinIO,…
fulmicoton on HN
Questions
How easy is it to run and maintain compared with Kafka-based setups
From 2 comments
Looking at the docker compose, this seems like a very complicated tool to run. You'd need Kafka, zookeeper, and Jaeger. All would need to be HA. Then also this service. Not…
figmert on HNAccording to the documentation[1] Kafka is just one of the supported inputs for ingestion, so it should be possible to run Quickwit without it if you're not intending to write…
PaoloBarbolini on HN
How it compares with SigNoz
From 2 comments
How is it compared to Signoz, which is also open source?
wiradikusuma on HNSigNoz maintainer here. We also have traces, metrics and logs in a single application which makes correlation across them much easier. From what I can understand from Quickwit…
pranay01 on HN
Whether it works with S3-compatible storage such as R2
From 2 comments
I am impressed with this work, especially given our current use of Loki with Prometheus and Grafana. Few questions come to mind. Firstly, is Quickwit compatible with any S3…
matesz on HNQuickwit is compatible with S3-compatible object storages yes. I don't remember the feedback for R2 specifically, but we have users running Quickwit on S3, GFS, Azure, MinIO,…
fulmicoton on HN
Alternatives named
Elasticsearch
From 2 comments
> To give you a concrete example, one company is ingesting hundreds of terabytes of logs daily and migrating from Elasticsearch to Quickwit. They divided their compute costs by…
dikei on HNElasticsearch was written in Java. No one cared. We still used it because it was good software.
laserbeam on HN
SigNoz
From 2 comments
When open source providers say 'alternative' to a commercial solution, do they consider the serious engineering needed to scale such systems? I mean I used SigNoz, and it's…
sidcool on HNHow is it compared to Signoz, which is also open source?
wiradikusuma on HN
ClickHouse
From 1 comment
Why don't you use clickhouse or some columnar storage for the logs? You get indexing or querying for free.
debarshri on HN
Grafana
From 1 comment
What I am really missing in these (really nice) alternatives to ELK is Kibana and its Lens. I tried to tapping this with Grafana but never learned to have graphs as easily as…
BrandoElFollito on HN