this post was submitted on 12 Jun 2023
25 points (100.0% liked)

Technology

1928 readers
7 users here now

Rumors, happenings, and innovations in the technology sphere. If it's technological news, it probably belongs here.

Subcommunities on Beehaw:


This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago
MODERATORS
 

cross-posted from: https://sh.itjust.works/post/55351

This is a cool project for an ESP32-S3-Box which can give really good voice support to Homeassistant or Openhab. Once installed on supported hardware, you can host the Inference Server yourself, use their cloud based version, or perform local actions on the device.

you are viewing a single comment's thread
view the rest of the comments
[โ€“] [email protected] 1 points 1 year ago (1 children)

Oh wow, I didn't even hear it was discontinued, interesting.

Does it use a large language model? it says "Willow users can now self-host the Willow Inference Server for lightning-fast language inference tasks with Willow and other applications (even WebRTC) including STT, TTS, LLM, and more!"

but i'm not sure if that refers to using a large language model or if LLM refers to something else

[โ€“] cyberscribe 1 points 1 year ago

Yes - I have not tested it out yet but the author of this project suggests Llama derivatives like Vicuna. I am excited to see how this project evolves alongside Homeasisstant's voice goals. The author of Rhasspy is working for Nabu Casa so im sure that will grow too!