147
this post was submitted on 14 Mar 2024
147 points (96.8% liked)
Technology
59719 readers
2362 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Were the research papers used to train Ibm's language model not public? If the papers are public and there are no restrictions, Chatgpt and Gemini can use those right? If Chatgpt and Gemini used those, what's the benefit of using Ibm's language model?
Odd that heliophysics (sun physics) was specified. It's under astrophysics.
Presumably they gave higher weight to the papers and lower weight to blogspam and reddit
I can tell Chatgpt to use scientific sources only, right? :)
Not really? It doesn't have sources, all the information is just thrown into a heap in its neural net. You can somewhat trick it by telling it that it's an expert in the field, but it's far from foolproof
Let me mansplain this.
There are 2 main ways to alter the way llms like chatgpt respond: 1) training & fine-tuning and 2) prompting.
Prompting means feeding the LLM information in the form of text, so it has actual stuff in what you could call its "short-term memory". That can be done interactively and only allows you to feed it a limited number of words.
Training and tuning are much slower processes and are used to build up and refine the "long-term" memory and to give importance and detail to specific topics, or to reinforce some kind of trait, like tone or type of answers it can produce.
I'm pretty sure what ibm and nasa did was a round of fine-tuning with material in that area of knowledge, not just prompting.