this post was submitted on 19 Apr 2025
6 points (87.5% liked)

Large Language Models

208 readers
3 users here now

A place to discuss large language models.

Rules

  1. Please tag [not libre software] and [never on-device] services as such (those not green in the License column here).
  2. Be useful to others

Resources

github.com/ollama/ollama
github.com/open-webui/open-webui
github.com/Aider-AI/aider
wikipedia.org/wiki/List_of_large_language_models

founded 2 years ago
MODERATORS
 

I'm running ollama with llama3.2:1b smollm, all-minilm, moondream, and more. I am able to integrate it with coder/code-server, vscode, vscodium, page assist, cli, and also created a discord ai user.

I'm an infrastructure and automation guy, not a developer so much. Although my field is technically devops.

Now, I hear that some llms have "tools." How do I use them? How do I find a list of tools for a model?

I don't think I can simply prompt "Hi llama3.2, list your tools." Is this part of prompt engineering?

What, do you take a model and retrain it or something?

Anybody able to point me in the right direction?

you are viewing a single comment's thread
view the rest of the comments
[โ€“] [email protected] 2 points 1 month ago (5 children)

Tools are usually sent in your request to the provider, tools are nothing more than identifiers that your code can handle if the llm requests it.

An example would be, you want to allow the llm to turn on or off the light in your bedroom. You could pass a tool (literally just the word toggle_light in this case) to the llm request along with whatever your input is (this could be a part of a chat, voice command, whatever) then if the llm determines that the input has somehow warranted the light toggle (say the input is a user saying "turn on the light") it will "use" the tool. Using the tool means literally sending a response back to your code that initiated the required that says "hey run the light toggle code with these parameters" your code is responsible for actually executing that action and telling the llm the response

Tool use is the single most useful thing llms do today imo

[โ€“] [email protected] 1 points 1 month ago

Love it. Very clear and to the point. Thank you.

load more comments (4 replies)