LiveKit Agents
AI
voice agent framework
SHOW HN2024
How HN took it
4 positive, 16 neutral or asking, 2 mixed, 4 critical, out of 26 comments about the project. Thread score +0.04.
Idea: 1 for, 2 againstPricing: 1 for, 1 againstPerformance: 0 for, 1 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
Useful for voice AI and the ChatGPT-style voice experience
From 2 comments
Is there anyone besides OpenAI working on a speech to speech model? I find it incredibly useful and it's the sole reason that I pay for their service but I do find it very…
spuz on HNOlivier, Michelle, and Romain gave you guys a shoutout like 3 times in our DevDay recap podcast if you need more testimonial quotes :) https://www.latent.space/p/devday-2024
FanaHOVA on HN
Objections
Audio is sent to the model continuously, so costs are high until turn detection is added
From 2 comments
Super cool! Didn't realize OpenAI is just using LiveKit. Does the pricing breakdown to be the same as having a OpenAI Advanced Voice socket open the whole time? It's like $9/hr!…
pj_mukh on HNCurrently it does: all audio is sent to the model. However, we are working on turn detection within the framework, so you won't have to send silence to the model when the user…
davidz on HN
Users report choppy audio in ChatGPT voice mode, possibly due to load
From 1 comment
80% of the times I’m experiencing choppy audio on my iPhone 15 Pro Max (18.1b) on Voice Mode (Standard and Advanced). My internet connection is FTTH and WiFi 7 state of the art…
gastonmorixe on HN
Requests
Voice activity detection so silence is not sent to the model
From 2 comments
Currently it does: all audio is sent to the model. However, we are working on turn detection within the framework, so you won't have to send silence to the model when the user…
davidz on HNCan I currently put a VAD module in the pipeline and only send audio when there is an active conversation? Feel like just that would solve the problem?
pj_mukh on HN
Better end-of-turn detection
From 1 comment
currently we are using silero VAD to detect speech: https://github.com/livekit/agents/blob/main/livekit-plugins/livekit-plugins-silero/livekit/plugins/silero/vad.py it works well…
davidz on HN
Questions
Whether WebRTC is needed for backend-only applications
From 1 comment
so the WebRTC helps with the unreliable network between the mobile clients and the server side. if the application is backend only, would it make sense to use WebRTC or should I…
lolpanda on HN
Whether the Realtime API uses the same model as Advanced Voice
From 1 comment
Nice they have many partners on this. I see Azure as well. There is a common consensus that the new Realtime API is not actually using the same Advanced Voice model / engine - or…
gastonmorixe on HN
Alternatives named
Moshi by Kyutai
From 1 comment
Yes. Kyutai released an opened model called moshi : https://github.com/kyutai-labs/moshi There's also llama-omni and a few others. None of them are even close to 4o from an LLM…
Ey7NFZ3P0nzAe on HN
Ultravox by Fixie
From 1 comment
There’s Ultravox as well (from one of the creators of WebRTC): https://github.com/fixie-ai/ultravox Their model builds a speech-to-speech layer into Llama. Last I checked they…
russ on HN