Thats a good one
pebbles
joined 7 months ago
Yes with llamacpp its easy to put just the experts on the CPU. Since only some of the experts are used every time, the GB moved to RAM slows things down way less than moving parts of the model that are used every time. And now parts that are used every time get to stay on the GPU. I was able to get llama4 scout running at around 15 T/s on 96GB RAM and 24GB VRAM with a large context. The whole GGUF was about 80GB.
Also they actually are a Chinese company. I am pretty sure it is the company that makes RedNote (Chinese tiktok) and thats why they had access to so much non-synthetic data. I tried the demo on huggingface and never got any Chinese characters.
I also really enjoyed it's prose. I think this will be a winner for creative writing.
Huge if true. No one has ever tried making a log out button before.
Yo they look so lumpy. I never see fellas as lumpy as this.
I've not heard anyone ever complain about it other than in media.
Maybe you need to be more upper class to relate.
I didn't realize how skilled one could be in water coloring. Folks on that community are amazing wow. Thanks for sharing!
Yeah reasonable. I added the arms and legs cause it would make my girlfriend laugh.
Though I'll admit at time I do feel like this guy on the inside while looking like a goofy little guy on the outside.
Well they get to use my friends social inertia against me. Hard to move off of snap even if I wanted to and so they can just change the TOS and get my data.
But they don't have to do it that way.
It could be a pretty bomb model though.
Oh cool, thanks for sharing! Biofilm is exactly where I tend to find them. I think they need a decent bit of oxygen, and if there is algae then they'll eat the bacteria attracted to algae's oxygen.
My most stentor populated samples were pond samples with a good bit of dirt and leaves that I sat on a shelf for a few days.
Once they've sat you'll see a film start to form at the top that wasn't there before. For me that film was made of really long bacteria all tangled together and tons of other life attached to and living around it.
This video doesn't have stentors, but it is of my thickest biofilm, a lot of stentors were found in the same sample: https://youtu.be/T3Bbg-ObTok
Good luck microbe hunting!
I never watch Doctor Who, but I know the last human when I see them.
Very peaceful!