this post was submitted on 12 Nov 2023
0 points (50.0% liked)

Hardware

33 readers
1 users here now

A place for quality hardware news, reviews, and intelligent discussion.

founded 11 months ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 1 points 10 months ago

Depends strongly on the type of data analysis.

My employer does a form of analysis with many different algorithms on numerous subsets, and compare which one does best. It's not always the same one that works best.

This means that for one specific desired result, you need to do dozens of calculations, and they can be done perfectly in parallel. Doing it single-threaded takes days.

We could easily max out a machine like this on our data files for hours or days on end just to go through the permutations, if the data isn't carefully vetted first.