this post was submitted on 07 Feb 2024
29 points (96.8% liked)
LocalLLaMA
2269 readers
4 users here now
Community to discuss about LLaMA, the large language model created by Meta AI.
This is intended to be a replacement for r/LocalLLaMA on Reddit.
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
It is awesome to have such models opensourced and competed with chatgpt4 but main feature why people still like closed source chatgpt is access to internet for such models. Is there any model have it now?
Sure. I think what you're looking for are "AI agents" or "RAG" (Retrieval Augmented Generation). It's not the model itself that does it, but the framework and software around it that provides the internet search capabilities.
And it's not unique to ChatGPT. It's been available also to open-weight / local models for years. I've lost track of all of the frameworks we have and what features they have. So I don't know what to recommend. But you can look it up, there are several frameworks available that provide such capabilities to any model. Maybe your preferred solution even has a plugin available.
The underlying method is probably the same for how ChatGPT works internally, and all the other ones. And it's related to how companies have always fed internal data to their chatbots since all of this started.
You can try one example on hf.co/chat Another solution would be something like h2ogpt. It can do web-search and also index all of the PDFs on your harddrive and answer questions about them and do vision tasks, look at pictures or generate them.