this post was submitted on 11 Jul 2023
219 points (97.0% liked)
Best of Mastodon
2285 readers
1 users here now
Share the best posts you find on mastodon. Add a link to the original toot
Related communities:
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
There have been a number of papers recently ("TinyStories" and "Textbooks are all you need" are two that come to mind) showing that higher quality training data for LLMs leads to significantly better models. So yes, this is technically true.
I took it the other way, instead of us teaching the machines, we should have the machines teaching us, or develop the machines to teach us at least.
What's the point of having all the information in the world at our fingertips if we're just going to ignore it in preference of what we already agree with?
Oh, I guess that's a valid interpretation. Especially since we are doing that too! I haven't been reading up on the intelligent tutoring systems side of AI/pedagogy in a while but I know that we have already attempted to teach math and computer science using them. I am technically working with a research team on creating a creativity support tool/tutoring system for analyst tasks using LLMs right now. Or I would be if I got off Lemmy 😆