this post was submitted on 19 Apr 2024
473 points (97.6% liked)

Technology

59958 readers
3322 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 2 years ago
MODERATORS
 

Well, Microsoft is getting ready to annoy its faithful Windows 10 user base with yet another prompt. This time, Microsoft wants Windows 10 users to switch from using a local account to their online Microsoft account.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 2 points 8 months ago* (last edited 8 months ago) (1 children)

If only AMD would get their asses to release a stable and functional ROCM implementation, I could migrate 100% to Linux.

[–] [email protected] 2 points 8 months ago (1 children)

have you tried the rocm docker containers that amd makes for your needs? it pretty much makes installing rocm on the base OS unneeded for me. https://hub.docker.com/u/rocm https://github.com/ROCm/ROCm-docker

[–] [email protected] 1 points 8 months ago (1 children)

AFAIK, cards older than GFX1030 require manual setup, including building parts of ROCM with modified flags, since v5.1

[–] [email protected] 2 points 8 months ago* (last edited 8 months ago)

There is one extra step. I have an 6700xt, and with the docker containers, you just have to pass the environment variable HSA_OVERRIDE_GFX_VERSION=10.3.0 to allow that card to work. For cards other than 6000 series, you would need to look up the version to pass for your generation.

Here's an example compose file that I use for ollama that runs ai models on my 6700xt.

version: '3'
services:
  ollama:
    image: ollama/ollama:rocm
    container_name: ollama
    devices:
      - /dev/kfd:/dev/kfd
      - /dev/dri:/dev/dri
    group_add:
      - video
    ports:
      - "11434:11434"
    environment:
      - HSA_OVERRIDE_GFX_VERSION=10.3.0
    volumes:
      - ollama_data:/root/.ollama

volumes:
  ollama_data: