this post was submitted on 14 May 2024
149 points (98.7% liked)

Open Source

31411 readers
17 users here now

All about open source! Feel free to ask questions, and share news, and interesting stuff!

Useful Links

Rules

Related Communities

Community icon from opensource.org, but we are not affiliated with them.

founded 5 years ago
MODERATORS
top 11 comments
sorted by: hot top controversial new old
[–] [email protected] 27 points 6 months ago (2 children)

I look forward to more voice assistants that arent as laughably broken as Google/Alexa.

My Google Nest can't even subtract from a timer (it can add, though!). Such a blatant surveillance device.

[–] [email protected] 11 points 6 months ago

can't even subtract from a timer (it can add, though!)

"Ok, Google, add -5 minutes to the timer"

It either explodes, or you start getting notifications in the past. Seems like a possible win, either way.

[–] [email protected] 5 points 6 months ago (1 children)

While this is certainly a cool concept, local voice assistants like this are currently a novelty. Cool to play around with, though!

You can expect around 5 seconds processing time to start generating the response to a basic question on a very basic model like Llama 3 8B.

For context, using Moondream2 (as recommended) on a RasPi 5, it takes around 50 seconds to process an image taken by the Camera and start generating a description.

[–] [email protected] 2 points 6 months ago

Interesting, using whisper-fast on Home Assistant on my server computer takes like 2-3 seconds to process and delivery an output in English.

Useful in the smart home space.

Laughably broken in most other languages other than English, but then again, google and Alexa barely work in other languages.

[–] [email protected] 10 points 6 months ago

Very slick. It looks like a thin wrapper around some pretty powerful tools, and I'm impressed that they're still useful on such a low-power device.

I wrote an assistant a while back before Whisper was a thing, but now that I see what you've done, I'm going to have to go back and refactor.

[–] [email protected] 6 points 6 months ago

Awesome job...I have a Pi5 arriving later this week so I now know what will be my first test project!

Are there any videos of Pi-card in action?

[–] [email protected] 2 points 6 months ago

Nice!

Now I need T.A.R.S

Why nobody is doing T.A.R.S? I would if I could but I can’t…

[–] [email protected] 2 points 6 months ago

Ohh can I get it to use the voice from the Star Trek computer, Majel Barret?

[–] [email protected] -5 points 6 months ago (2 children)

Why isn't this an app?

The main reason for this is that I wanted to create a voice assistant that is completely offline and doesn't require any internet connection. This is because I wanted to ensure that the user's privacy is protected and that the user's data is not being sent to any third party servers.

Weird reasoning, why constrain the assistant to pi’s power and memory when you can use it for interaction and utilize another, more powerful server at home

[–] Murdoc 11 points 6 months ago

While the system is designed to be entirely local, it is also possible to easily connect it to some external APIs or services if you want to enhance the conversation

[–] [email protected] 2 points 6 months ago

As an answer to your question I will remind you that unicycles still exist.