crazycomputer84

joined 10 months ago
sorted by: new top controversial old
Petabyte level storage setup? in c/[email protected]
[โ€“] [email protected] 1 points 9 months ago

tend to compress and dedupe very well

do you have any pointer?

by my term cheep it is comparing to solution nvidia DDN node

and what do you mean by the term "Once you delve deep into these questions"? because this assume i have some general knowledge about the storage stack that can scale to petabyte level storage. because i bet it safe to assume that truenas scale won't scale to a petabyte or more

Petabyte level storage setup? in c/[email protected]
[โ€“] [email protected] 1 points 9 months ago (2 children)

ML dataset,
i have no plan for software for now

yes it dose need to be an enterprise system it onsite

this must be self hosted

for the buget it provided by my uni

1
Petabyte level storage setup? (alien.top)
 

Hi there, I am trying to setup a high-availability high-performance Storage and I have no idea where to start at all. and I have a list of question i hope you could help me with.

Do i need SAN or DAS that connect to multiple control node?
What file system? and I want to avoid Lusterfs
What hardware do i need?
What Os do i use? i ideally want to use truenas but i am comfortable with another distro.

the storage need to beable to scale to petabyte level and ideally FAST