this post was submitted on 15 Nov 2024
1245 points (99.5% liked)

Science Memes

11148 readers
1833 users here now

Welcome to c/science_memes @ Mander.xyz!

A place for majestic STEMLORD peacocking, as well as memes about the realities of working in a lab.

Rules

  1. Don't throw mud. Behave like an intellectual and remember the human.
  2. Keep it rooted (on topic).
  3. No spam.
  4. Infographics welcome, get schooled.

This is a science community. We use the Dawkins definition of meme.

Research Committee

Other Mander Communities

Science and Research

Biology and Life Sciences

Physical Sciences

Humanities and Social Sciences

Practical and Applied Sciences

Memes

Miscellaneous

founded 2 years ago
MODERATORS
[email protected]
[email protected]
[email protected]
1245
[Thread] Mental Math (mander.xyz)
submitted 1 week ago by [email protected] to c/[email protected]
114 comments fedilink hide all child comments
 

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 1 points 1 week ago (2 children)

I experimented with rules like : "Summarize everything of our discussion into one text you can use as memory below your answer." And "summarize and remove unnecessary info from this text, if contradictions occur act curious to solve them"... simply to mimic a short term memory.

It kind of worked better for problem solving but it ate tokens like crazy and the answers took longer and longer. The current GPT4 models seem to do something similar in the background.

[–] [email protected] 1 points 1 week ago

I think that's still different from what I'm thinking of of interim steps, though.

...but as I think how to explain I realize I'm about to blather about things I don't understand, or at least haven't had time to think about! So I'd better leave it there!

[–] [email protected] 1 points 1 week ago

I would really like to get into LLM and AI development but the math.....woosh right over my head.