brucethemoose

joined 6 months ago
[–] [email protected] 2 points 1 hour ago

Twitter screenshot of this linked in slack that evening.

The modern internet in a nutshell, lol.

[–] [email protected] 1 points 4 hours ago* (last edited 4 hours ago)

The movement to X isn't universal, it's more of a "last resort" where a few communities flounder.

Discord is the dominant destination though.

[–] [email protected] 20 points 1 day ago (2 children)

Where’s a Johnny cab when you need it

Or a Delamain.

[–] [email protected] 13 points 1 day ago* (last edited 1 day ago) (15 children)

I would only use the open source models anyway, but it just seems rather silly from what I can tell.

I feel like the last few months have been an inflection point, at least for me. Qwen 2.5, and the new Command-R, really make a 24GB GPU feel "dumb, but smart," useful enough so I pretty much always keep Qwen 32B loaded on the desktop for its sheer utility.

It's still in the realm of enthusiast hardware (aka a used 3090), but hopefully that's about to be shaken up with bitnet and some stuff from AMD/Intel.

Altman is literally a vampire though, and thankfully I think he's going to burn OpenAI to the ground.

[–] [email protected] 17 points 1 day ago

Discord is even worse, as you need to find an invite to a specific Discord, and sometimes go through a lengthy sign up process for each Discord.

Some won't let you sign up without a phone #.

[–] [email protected] 12 points 1 day ago* (last edited 1 day ago) (1 children)

Matrix.

And... Lemmy.

It doesn't matter though, the problem is the critical mass is migrating to Discord and shunting everything out of view. Honestly that's much worse than being on Reddit, even now.

[–] [email protected] 51 points 1 day ago* (last edited 1 day ago) (10 children)

I'm a bit salty this was apparently announced through Discord. Was it even posted anywhere else?

The future of social media is fragmented siloes, I guess.

[–] [email protected] 6 points 1 day ago* (last edited 1 day ago)

Ideally they would subscribe and then watch a different service.

Thats so cynical and self defeating. "They'll use our competition and save us money." But you're not wrong, they could totally be thinking that rofl.

Or maybe it’s a retroactive contract negotiation tactic. Basically negotiate or you won’t get any residuals.

Very possible. I guess all that is even more behind-the-curtain than cable, as when shows disappear there is no reason given, no "protest" like some channels will do.

I feel like streaming has made all this stuff even more opaque.

[–] [email protected] 6 points 1 day ago* (last edited 1 day ago) (2 children)

But... wouldn't that "take up" the views of other shows?

In other words, the consumer has X amount of time for HBO Max, so they'd either be paying for more views on another show or a potential lost subscriber who can't find anything to watch, right?

And, with all due respect, there's no way cartoons are more expensive-per-view than other shows.

[–] [email protected] 7 points 2 days ago* (last edited 2 days ago)

...But I believe Jaws can save the world

[–] [email protected] 50 points 3 days ago (11 children)

Israel’s “Special Military Operation”

Even Russia learned their lesson in this part of the world.

[–] [email protected] 34 points 3 days ago (2 children)

I mean, as long as the bots click on ads, everyone is happy? Riiight?

 

cross-posted from: https://lemmy.world/post/19925986

https://huggingface.co/collections/Qwen/qwen25-66e81a666513e518adb90d9e

Qwen 2.5 0.5B, 1.5B, 3B, 7B, 14B, 32B, and 72B just came out, with some variants in some sizes just for math or coding, and base models too.

All Apache licensed, all 128K context, and the 128K seems legit (unlike Mistral).

And it's pretty sick, with a tokenizer that's more efficient than Mistral's or Cohere's and benchmark scores even better than llama 3.1 or mistral in similar sizes, especially with newer metrics like MMLU-Pro and GPQA.

I am running 34B locally, and it seems super smart!

As long as the benchmarks aren't straight up lies/trained, this is massive, and just made a whole bunch of models obsolete.

Get usable quants here:

GGUF: https://huggingface.co/bartowski?search_models=qwen2.5

EXL2: https://huggingface.co/models?sort=modified&search=exl2+qwen2.5

13
submitted 2 weeks ago* (last edited 2 weeks ago) by [email protected] to c/localllama
 

https://huggingface.co/collections/Qwen/qwen25-66e81a666513e518adb90d9e

Qwen 2.5 0.5B, 1.5B, 3B, 7B, 14B, 32B, and 72B just came out, with some variants in some sizes just for math or coding, and base models too.

All Apache licensed, all 128K context, and the 128K seems legit (unlike Mistral).

And it's pretty sick, with a tokenizer that's more efficient than Mistral's or Cohere's and benchmark scores even better than llama 3.1 or mistral in similar sizes, especially with newer metrics like MMLU-Pro and GPQA.

I am running 34B locally, and it seems super smart!

As long as the benchmarks aren't straight up lies/trained, this is massive, and just made a whole bunch of models obsolete.

Get usable quants here:

GGUF: https://huggingface.co/bartowski?search_models=qwen2.5

EXL2: https://huggingface.co/models?sort=modified&search=exl2+qwen2.5

 

Obviously there's not a lot of love for OpenAI and other corporate API generative AI here, but how does the community feel about self hosted models? Especially stuff like the Linux Foundation's Open Model Initiative?

I feel like a lot of people just don't know there are Apache/CC-BY-NC licensed "AI" they can run on sane desktops, right now, that are incredible. I'm thinking of the most recent Command-R, specifically. I can run it on one GPU, and it blows expensive API models away, and it's mine to use.

And there are efforts to kill the power cost of inference and training with stuff like matrix-multiplication free models, open source and legally licensed datasets, cheap training... and OpenAI and such want to shut down all of this because it breaks their monopoly, where they can just outspend everyone scaling , stealiing data and destroying the planet. And it's actually a threat to them.

Again, I feel like corporate social media vs fediverse is a good anology, where one is kinda destroying the planet and the other, while still niche, problematic and a WIP, kills a lot of the downsides.

 

cross-posted from: https://lemmy.world/post/19242887

I can run the full 131K context with a 3.75bpw quantization, and still a very long one at 4bpw. And it should barely be fine-tunable in unsloth as well.

It's pretty much perfect! Unlike the last iteration, they're using very aggressive GQA, which makes the context small, and it feels really smart at long context stuff like storytelling, RAG, document analysis and things like that (whereas Gemma 27B and Mistral Code 22B are probably better suited to short chats/code).

 

I can run full 131K context with a 3.75bpw quantization, and still a very long one at 4bpw. And it should barely be fine-tunable in unsloth as well.

It's pretty much perfect! Unlike the last iteration, they're using very aggressive GQA, which makes the context small, and it feels really smart at long context stuff like storytelling, RAG, document analysis and things like that (whereas Gemma 27B and Mistral Code 22B are probably better suited to short chats/code).

 

Senior U.S., Qatari, Egyptian and Israeli officials will meet on Thursday under intense pressure to reach a breakthrough on the Gaza hostage and ceasefire deal.

he heads of the Israeli security and intelligence services told Netanyahu at the meeting on Wednesday that time is running out to reach a deal and emphasized that delay and insistence on certain positions in the negotiations could cost the lives of hostages, a senior Israeli official said.

 

HP is apparently testing these upcoming APUs in a single, 8-core configuration.

The Geekbench 5 ST score is around 2100, which is crazy... but not what I really care about. Strix Halo will have a 256 -bit memory bus and 40 CUs, which will make it a monster for local LLM inference.

I am praying AMD sells these things in embedded motherboards with a 128GB+ memory config. Especially in an 8-core config, as I'd rather not burn money and TDP on a 16 core version.

 

cross-posted from: https://lemmy.world/post/16629163

Supposedly for petty personal reasons:

The woman who controls the company, Shari Redstone, snatched defeat from the jaws of victory last week as she scuttled a planned merger with David Ellison's Skydance Media.

Redstone had spent six months negotiating a complicated deal that would have given control of Paramount to Ellison and RedBird Capital, only to call it off as it neared the finish line.

The chief reason for her decision: Her reluctance to let go of a family heirloom she fought very hard to get.

I cross posted this from c/Avatar, but I am a Trekkie too and don't like this one bit.

FYI previous articles seemed to imply the Sony deal is dead.

 

Supposedly for petty personal reasons:

The woman who controls the company, Shari Redstone, snatched defeat from the jaws of victory last week as she scuttled a planned merger with David Ellison's Skydance Media.

Redstone had spent six months negotiating a complicated deal that would have given control of Paramount to Ellison and RedBird Capital, only to call it off as it neared the finish line.

The chief reason for her decision: Her reluctance to let go of a family heirloom she fought very hard to get.

The fandom doesn't want to talk about it, but the Avatar franchise is in trouble.

 

Avatar Studios seems to be part of Paramount Media, aka the "pay television channels" that I assume Sony is not interested in: https://en.wikipedia.org/wiki/Paramount_Global

And in light of this article: https://deadline.com/2024/05/paramount-sale-hollywood-studio-takeover-history-lessons-1235910245/

That doesn't look good for Avatar Studios. If they are left behind in a Sony sale, it seems the probability of them getting shut down (or just going down with whatever is left of Paramount) is very high.

 

The article is a very fast read because it's Axios, but in a nutshell, either:

  • Skydance gets Paramount intact, but possibly with financial trouble and selling some IP.

  • Sony gets Paramount, but restructures the company and also possibly sells some parts.

  • Nothing happens... and Paramount continues its downward spiral, probably accelerated by a failed sale.

The can of worms opened today, as now Paramount is officially open to a buyout from sony.

I don't like this at all. Avatar is a high budget IP, animesque fantasy, and not historically, proveably profitable like Star Trek/Spongebob. Avatar Studios is a real candidate to be chopped off.

view more: next ›