Open Source

31411 readers

43 users here now

All about open source! Feel free to ask questions, and share news, and interesting stuff!

Useful Links

Rules

Posts must be relevant to the open source ideology
No NSFW content
No hate speech, bigotry, etc

Related Communities

Community icon from opensource.org, but we are not affiliated with them.

founded 5 years ago

MODERATORS

[email protected]

228

LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime (github.com)

submitted 3 months ago by [email protected] to c/[email protected]

14 comments fedilink hide all child comments

LibreCUDA is a project aimed at replacing the CUDA driver API to enable launching CUDA code on Nvidia GPUs without relying on the proprietary CUDA runtime. It achieves this by communicating directly with the hardware via ioctls, (specifically what Nvidia's open-gpu-kernel-modules refer to as the rmapi), as well as QMD, Nvidia's MMIO command queue structure. LibreCUDA is capable of uploading CUDA ELF binaries onto the GPU and launching them via the command queue.

you are viewing a single comment's thread
view the rest of the comments

[–] mindbleach 5 points 3 months ago (1 children)

Nvidia's grip on CUDA needs breaking, one way or another.

[–] [email protected] 1 points 3 months ago

Nvidia can keep CUDA, we just need libraries to be written with the option to use Intel or AMD - I can't speak for AMD but it generally takes 10 minutes to port libraries that explicitly use cuda in pytorch to intel oneapi so it's not even that hard to do, I can't speak for AMD though