Oskar

joined 1 month ago
sorted by: new top controversial old
Mac Studio 2025 in c/localllama
[–] [email protected] 1 points 3 days ago (1 children)

Interesting, lots of "bang for the buck". I'll check it out

Mac Studio 2025 in c/localllama
[–] [email protected] 1 points 4 days ago (1 children)

of course, I haven't looked at models >9B for now. So I have to decide if I want to run larger models quickly or even larger models quickly-but-not-as-quick-as-on-a- Mac-Studio.

Or I could just spend the money on API credits :D

10
Mac Studio 2025 (piefed.social)
 

Thinking about a new Mac, my MPB M1 2020 16 GB can only handle about 8B models and is slow.

Since I looked it up I might as well shared the LLM-related specs:
Memory bandwidth
M4 Pro (Mac Mini): 273GB/s M4 Max (Mac Studio): 410 GB/s

Cores cpu / gpu
M4 pro 14 / 20
M4 Max 16 / 40

Cores & memory bandwidth is of course important, but with the Mini I could have 64 GB ram instead of 36 (within my budget that is fixed for tax reasons).

Feels like the Mini with more memory would be better. What do you think?

Pixelfed ebbing in c/[email protected]
[–] [email protected] 1 points 1 week ago

For lots of people it'll be less confusing. They open their app store and search for this Pixelfed they've heard of and find an official app. That's what they expect.

Models specialized on only one programming language in c/[email protected]
[–] [email protected] 1 points 2 weeks ago

I finally found a Python-specific model. Searching is tricky when almost everything around local llms involve Python. https://huggingface.co/codellama/CodeLlama-13b-Python-hf

15
Models specialized on only one programming language (piefed.social)
 

There are lots of general-purpose models to use locally, and also coding-specific models.

But are there models specialized in one programming language? My thought was that a model that only needs to handle one language (e.g. Python) could be faster, or be better for a given size.

E.g If I need to code in Rust and is limited to an 8B model to run locally, I was hoping to get better results with a model that is narrower. I don't need it to be able to help with Java.

This approach would of course require switching models, but that's no problem for me.

The best instance to host a big community in Finnish? in c/[email protected]
[–] [email protected] 4 points 2 weeks ago (1 children)

I don't have any recommendations, but I'm sharing information about train travel through a Mastodon account in Swedish https://mastodonsweden.se/@interrailinfosvenska I wish you good luck creating a new community in the Fediverse! And I have posted a challenge for a similar thing in Sweden.