These are good sources, to add one more, the GPTQ paper talks a lot about perplexity at several quantization and model sizes:
Note, "safe chatbots" in this case doesn't necessarily mean how people often think of it, it's useful also for if say you need to make sure the chatbot doesn't access (or hallucinate that it's accessing) a different users data and returning it
What do you mean blocked wiki access? O.o
Really nice to see these models making records even if the benchmarks need to be taken with mountains of salt, any empirical data is better than no data
Man these 70B models just make me want a new GPU tho 🥲
People may not love the model or its outputs, but it's hard to deny the impact to the open-source community that releases like this bring, such a positive bonus and really happy they're continuing
Anyone else see 11 comments on the post count but only 2 comments..?
Hey thanks for the detailed writeup, this is great! Probably worth including a couple of the llama 1 models just because they're more mature and ready to be used even tho licensing is awkward
Also if you'd like I maintain a few docker images for a couple tools (namely oobabooga, koboldcpp, and lollms-webui) that might be good for beginners to get their feet wet, can find them pinned at https://github.com/noneabove1182
For me it's gotta be immich, it replicates Google photos SO well and it's all local and self hosted, absolutely floored by how great it is
For browsing my photos on my device I use Aves which is also a great app, especially since it's the only app I've ever found that handles Sony burst format properly
finally, great to see some reviewers thinking outside the box for one (/s)
For sure! I'm actually just in the market for watches in general, I love the ticwatch dual display (but don't love that my tichwatch pro 3's software is.. collecting dust on the proverbial shelf..) but the samsung watches always seemed so spiffy and clean! So you'd say overall we're still pretty incremental then in terms of meaningful changes from the watch 4?
The article doesn't address it, maybe someone here can.. what does "consumed" mean? Where does the water go after it's used to cool? Surely it's reusable, right?
Another question now, how do the hinges in the new foldables feel? We've had some good competition in that space so I'm hoping we see some refinement from Samsung this year. Which of the two would you most like to daily drive?