/r/filesystems

Photograph via snooOG

Links about usage of file systems, FS implementation and theory behind implementations. Floss or proprietary, legacy or alpha-stage.

Links about usage of file systems, FS implementation and theory behind implementations. Floss or proprietary, legacy or alpha-stage.

Subreddits related to filesystems:

/r/filesystems

2,465 Subscribers

0

Is 5Gb too large for a file?

Hi,

I am working with files of around 5Gb and in order to test my code, I need inputs. The input comes from those files and it is hard to transfer them. Streaming them from the servers is even worse, so I would rather have them in my computer. I am currently transferring 60Gb and it is taking 30 minutes, then I have to transfer them back to the other computer. That's another 30 minutes.

I think no file containing data should have more than 500Mb, but I am told that it is better to have a merging step that makes our final files to have these 4-6 Gb in size. For me, that's unnecessary and just causes problems.

I even tried transferring those files and the transfer failed because the drive was formatted as FAT32 and those filesystems cannot take more than 4Gb files. So, if there are file systems, mainstream ones, that cannot even take stuff above 4Gb, It seems excessive to go that far up.

11 Comments
2025/01/29
02:57 UTC

3

Operating systems that actually read filenames longer than 260 characters.

It seems that all major operating ​systems today ​will only read the fir​st 255 or at most 260 characters of a filename and ignore the rest, by design. Nothing wrong with this, of course, but I ​was wondering, are there operating​ systems that can read filenames with much lengthier filena​mes ? For instance, Rei​serFS supports filenames with upto 4032 chars in length (!!).​​ ​What OS can read such a filename without truncating it? ​If there is none today, was there ever such an OS? Please mention it. ​Otherwise, what was the point of supporting fIlenames with so many characters? ​I know there must be a reason, but it beats me.

Thanks

5 Comments
2024/12/19
21:56 UTC

2

Trying to understand the different file systems and their features. What are my best resources?

1 Comment
2024/12/17
02:34 UTC

1

Is there any viable alternatives to File Explorer?

It is really slow and changes from Windows 10 to 11, is there anything else out there... or are we alone.. forced to use such crud?

Sorry for the dramatic flare, if there is anything out there please let me know.
i hope this post does not get stopped by automod because of my low karma

3 Comments
2024/12/17
00:24 UTC

Back To Top