Willow Inference Server
AI
speech recognition inference server
SHOW HN2023
13points
13comments
#2,112of 3,109 in 2023
Top 68%of 2023 by points
How HN took it
CuriousMostly questions and neutral comments
3 positive, 3 neutral or asking, 0 mixed, 0 critical, out of 6 comments about the project. Thread score +0.32.
Idea: 2 for, 0 againstPerformance: 1 for, 0 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
Fast response times on low-cost GPUs
From 2 comments
Thanks! Yes, "realtime multiple" is audio/speech length divided by actual inference time. You got it! The demo video is showing the slowest response times because it is using the…
kkielhofner on HNThank you! Unfortunately the oldest GPUs we support are Pascal and your GTX 960 is Maxwell. We have this cutoff for GPU hardware support for two reasons: 1) Nvidia doesn't…
kkielhofner on HN
Privacy-respecting alternative to Amazon Echo
From 2 comments
Thanks for this, I've been looking forward to it. I used Amazon Echo devices during their first 6 months of public availability before I got sufficiently creeped out to pull the…
kunwon1 on HNBrilliant. Willow looks like a game-changer to me, thanks a million!
morehamish on HN
Objections
Older GPUs such as Maxwell are unsupported
From 1 comment
Thank you! Unfortunately the oldest GPUs we support are Pascal and your GTX 960 is Maxwell. We have this cutoff for GPU hardware support for two reasons: 1) Nvidia doesn't…
kkielhofner on HN
Requests
Support for older GPUs like the GTX 960
From 1 comment
It looks amazing, I'll definitely try it out! Quick question: would a GTX 960 also work for inference? I happen to have one lying around and could whip up a system with it.…
unverbraucht on HN
A Willow Application Server
From 2 comments
Thanks for this, I've been looking forward to it. I used Amazon Echo devices during their first 6 months of public availability before I got sufficiently creeped out to pull the…
kunwon1 on HNThanks! One note - if you're going to self-host WIS (YOU SHOULD) I suggest making good use of the more powerful hardware otherwise and putting HA on it. HA on Raspberry Pi (while…
kkielhofner on HN
Questions
Whether realtime multiple means speed relative to real time
From 1 comment
Looks fantastic! A question re. benchmarks: the "realtime multiple" means "how many times faster the model is processing the audio compared to real time" here? (I.e. the opposite…
morehamish on HN
Whether larger beam sizes improve quality
From 1 comment
Looks fantastic! A question re. benchmarks: the "realtime multiple" means "how many times faster the model is processing the audio compared to real time" here? (I.e. the opposite…
morehamish on HN
Alternatives named
Amazon Echo
From 1 comment
Thanks for this, I've been looking forward to it. I used Amazon Echo devices during their first 6 months of public availability before I got sufficiently creeped out to pull the…
kunwon1 on HN
Home Assistant on Raspberry Pi
From 2 comments
Thanks for this, I've been looking forward to it. I used Amazon Echo devices during their first 6 months of public availability before I got sufficiently creeped out to pull the…
kunwon1 on HNThanks! One note - if you're going to self-host WIS (YOU SHOULD) I suggest making good use of the more powerful hardware otherwise and putting HA on it. HA on Raspberry Pi (while…
kkielhofner on HN