this post was submitted on 27 Sep 2023
27 points (90.9% liked)

Trees

6752 readers
13 users here now

A community centered around cannabis.

In the spirit of making Trees a welcoming and uplifting place for everyone, please follow our Commandments.

  1. Be Cool.
  2. I'm not kidding. Be nice to each other.
  3. Avoid low-effort posts

founded 1 year ago
MODERATORS
 

EDIT: the image in the title is the important one, you have to click on it if you're on desktop

EDIT2: appears I was wrong, I only had bad internet and it didn't load

Usually I got this:

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 2 points 1 year ago

Surprisingly good comment on running such language models locally. Thanks, I will try to run the 70B model as well. So far I have only used up to 13B with Oobabooga.