Best file system for external (USB) hard drives/USB memory media

Question

Almost all external USB hard drive and USB memory media/sticks come today preformatted with FAT32.

As far as I know the only advantage of the file system is the compatibility among OSes and devices.

Is it reasonable to reformat it with exFAT or even NTFS? How this would affect the performance and security?

Solution 1

Here is an article where extensive testing on usb drives comparing performance of FAT32, NTFS, and exFAT.

Conclusion from the testing:

"For Copying to the USB drive FAT32 took the least amount of time, with NTFS coming in second and ExFat taking on average the longest time to Copy to the drive.

Copying From and Reading From the drives were very similar in their results though, most of the time the File Systems were close, with at points NTFS taking a bit longer while FAT32 and ExFAT were nearly identical."

As far as file system security goes, if you reformat to NTFS or exFAT you will gain File System Permissions on your USB drive. Which I have never had a need for on a USB drive, because I am the only person using the drive and I do not want to limit access to my data.

Solution 2

It's not only reasonable, but sometimes even necessary. FAT32 doesn't allow files >4GB.

As for choice between NTFS and exFAT. Well, neither vanilla XP nor vanilla Linux support exFAT, but they do support NTFS.

Solution 3

Security isn't affected at all[1], because someone can always plug the device into another machine (that ignores all the file permissions) and go to town on your data. Performance might be better, or it might not -- depends on the OS, filesystem, and hardware involved. Best to benchmark on your likely workload and see what works best.

[1] OK, if you're using an encrypted filesystem you can get better security, but that's not really in the scope of the question, and performance will almost certainly be adversely affected.

Solution 4

You may also be interested in UDF (Universal Disk Format). See UDF OS compatibility table on Wikipedia.

The only downside to UDF 2.01 is that there is no native write support for Windows XP (at least without third party utilities). However, writing with Windows 7 and later are natively supported.

I recently found myself researching this very topic, and I wrote a script to automate the process of formatting in UDF. See format-udf on GitHub.

Solution 5

Slashdot: File Systems that Suck less?

Basically you don't want fat32 because you only get 2GB file size and it's non-journaling

"A journaling file system is a file system that logs changes to a journal (usually a circular log in a dedicated area) before committing them to the main file system. Such file systems are less likely to become corrupted in the event of power failure or system crash." - Wikipedia

Now if you want Windows/Linux/Mac support you're basically stuck with NTFS.

If you want Mac compatibility then you'll need http://www.ntfs-3g.org/. Same applies for Linux (You should have an ntfs-3g package available)

Caveat: The Mac ntfs-3g software has been a little flakey for me as far as permissions go and you can only run Time Machine from an HFS+ formatted drive.

So yeah until there's an agreed upon universal filesystem it looks like NTFS is going to be the fallback for some time.

View more solutions