For me I have to run down at a measly 13B, so I've been using mainly wizard and airoboros, hoping though that the new orca (or dolphin) models will work well, especially down to 7B, want to create a highly specialized home AI and would be so handy if I could QLora a really powerful but small model
Yeah no problem! First issue however is that apple silicon plays kinda funny with this kind of setup, so I may need to make you a custom image to use. Otherwise you should have no problem running the -cpu build.
As for running the image itself, you can either run it form the command line with docker run, or you can make yourself a docker compose file
I personally tend to go the latter, and for that you can copy my docker-compose.yml file from here: https://hub.docker.com/r/noneabove1182/text-gen-ui-cpu
I'll work on making a mac-specific image and you can test it for me ;)
even going from my xperia 1 iv to xperia 1 v, i'm so sad I don't have a notification LED anymore, when it's plugged in to charge I have no idea if it's charging, fully charged, or what.. without enabling my AOD which I don't want to do, i have no way of knowing if there are any notifications without turning on my display
ahh okay interesting, well hopefully with it being in Pixel that means that mainline android might get some features that support using it, and for manufacturers like sony and motorola that mostly just keep clean mainline android, maybe we'll get some cool developments :)
the sony 1 V has been an absolute dream of a phone, it's rekindled my love of smartphones from back when i was an enthusiast with nexus and first gen pixel
That said, when I plug my Sony into a dock with display port, it does forward my display.. so is this actually new or new pixel?
Kinda a weird announcement with 0 content.. anyone have any idea what this could mean?
Haven't seen it yet but hoping it does go up
not a bad deal, happy to at least see displayport on it, been looking at budget 24" IPS monitors and it's criminal how many are only 1x HDMI and 1x VGA.. I approve including VGA, but only having 2 inputs and only a single digital input on a 160$ monitor feels awful
What's your used market like? You're probably better off getting something from a couple years ago
That's a crazy price isn't it? I guess it's QLC but still
This mildly surprised me, doesn't seem explicit enough, a thumbs up can represent having received but not necessarily agreed, strange new world