Machine Learning

1765 readers

1 users here now

founded 4 years ago

MODERATORS

[email protected]

[Solved] PyTorch Lightning is bottlenecked by the CPU (lemmy.ml)

submitted 1 year ago* (last edited 1 year ago) by [email protected] to c/[email protected]

2 comments fedilink hide all child comments

When I train my PyTorch Lightning model on two GPUs on jupyter lab with strategy="ddp_notebook", only two CPUs are used and their usages are 100%. How can I overcome this CPU bottleneck?

Edit: I tested with PyTorchProfiler and it was because of old ssds used on the server

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 3 points 1 year ago

Yup this, if you would like more help we need the code, or at least a minimal viable reproduction scenario.

permalink
fedilink
source
parent