LocalLLaMA

2274 readers

3 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 2 years ago

MODERATORS

SkySyrup

pax

noneabove1182

Chai is running their own open source leaderboard (self.localllama)

submitted 1 year ago* (last edited 1 year ago) by noneabove1182 to c/localllama

7 comments fedilink hide all child comments

Text from them:

Calling all model makers, or would-be model creators! Chai asked me to tell you all about their open source LLM leaderboard:

Chai is running a totally open LLM competition. Anyone is free to submit a llama based LLM via our python-package 🐍 It gets deployed to users on our app. We collect the metrics and rank the models! If you place high enough on our leaderboard you'll win money 🥇

We've paid out over $10,000 in prizes so far. 💰

Come to our discord and check it out!

https://discord.gg/chai-llm

Link to latest board for the people who don't feel like joining a random discord just to see results:

https://cdn.discordapp.com/attachments/1134163974296961195/1138833170838589471/image1.png

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 11 points 1 year ago* (last edited 1 year ago) (2 children)

Me at first: wow, that's cool, I wonder how models are ranked

Come to our discord and check it out!

OK, bye

[–] noneabove1182 3 points 1 year ago* (last edited 1 year ago) (2 children)

lmao a reasonable request, I'm pretty disappointed they don't have it hosted anywhere..

here's a link to their latest image of the leaderboard for what it's worth:

https://cdn.discordapp.com/attachments/1134163974296961195/1138833170838589471/image1.png

[–] [email protected] 2 points 1 year ago

TYVM, OP :)

Wizard is at the top of every leaderboard I saw so far, I should really check it out

[–] [email protected] 2 points 1 year ago

How is it ranked I’m not familiar with any of those except Wizard

[–] noneabove1182 2 points 1 year ago

There's apparently a pip command to display the leaderboard, if this ends up being of interest to people I could make a post and just update it every so often with the latest leaderboard