this post was submitted on 18 Apr 2025
3 points (58.8% liked)
Asklemmy
49137 readers
452 users here now
A loosely moderated place to ask open-ended questions
Search asklemmy ๐
If your post meets the following criteria, it's welcome here!
- Open-ended question
- Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
- Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
- Not ad nauseam inducing: please make sure it is a question that would be new to most members
- An actual topic of discussion
Looking for support?
Looking for a community?
- Lemmyverse: community search
- sub.rehab: maps old subreddits to fediverse options, marks official as such
- [email protected]: a community for finding communities
~Icon~ ~by~ ~@Double_[email protected]~
founded 6 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Retrieval-Augmented Generation (RAG) is probably the tech youโd want. It basically involves a knowledge library being built from the documents you upload, which is then indexed when you ask questions.
NotebookLM by Google is an off the shelf tool that is specialized in this, but you can upload documents to ChatGPT, Copilot, Claude, etc., and get the same benefit.
If you self hosted, Open WebUI with Ollama supports this, but far from the only one.
Thanks, I got NotebookLM working pretty quickly. I think RAG is what I'm after. I'll continue to look.
If you want to try the openwebui route, This guide might be helpful.
Edit: in fact I don't think this is for openwebui specifically, but I remember the chapter at the timestamp is what helped me increase the context window. That's the important bit if you're wanting to ask it questions about documents.