/r/filesystems
Links about usage of file systems, FS implementation and theory behind implementations. Floss or proprietary, legacy or alpha-stage.
/r/filesystems
Hi,
I am working with files of around 5Gb and in order to test my code, I need inputs. The input comes from those files and it is hard to transfer them. Streaming them from the servers is even worse, so I would rather have them in my computer. I am currently transferring 60Gb and it is taking 30 minutes, then I have to transfer them back to the other computer. That's another 30 minutes.
I think no file containing data should have more than 500Mb, but I am told that it is better to have a merging step that makes our final files to have these 4-6 Gb in size. For me, that's unnecessary and just causes problems.
I even tried transferring those files and the transfer failed because the drive was formatted as FAT32 and those filesystems cannot take more than 4Gb files. So, if there are file systems, mainstream ones, that cannot even take stuff above 4Gb, It seems excessive to go that far up.
It seems that all major operating systems today will only read the first 255 or at most 260 characters of a filename and ignore the rest, by design. Nothing wrong with this, of course, but I was wondering, are there operating systems that can read filenames with much lengthier filenames ? For instance, ReiserFS supports filenames with upto 4032 chars in length (!!). What OS can read such a filename without truncating it? If there is none today, was there ever such an OS? Please mention it. Otherwise, what was the point of supporting fIlenames with so many characters? I know there must be a reason, but it beats me.
Thanks
It is really slow and changes from Windows 10 to 11, is there anything else out there... or are we alone.. forced to use such crud?
Sorry for the dramatic flare, if there is anything out there please let me know.
i hope this post does not get stopped by automod because of my low karma