On Wed, Jan 15, 2025 at 05:53:18AM +0100, tomas@tuxteam.de wrote:
On Tue, Jan 14, 2025 at 03:26:17PM -0500, Michael Stone wrote:On Tue, Jan 14, 2025 at 06:13:44PM +0000, Adam Weremczuk wrote: > I'm giving exfat a shot and so far I'm impressed with 160 MB/s average > transfer rate (HDD -> NVMe). > > That's significantly faster than before. > > Partially because I'm using "rsync -avh --no-perms --no-group --no-owner > ..." this time. fuse is slow in general and that applies to ntfs-3g. There's a kernel exfat module which will offer performance similar to any other native filesystem.[...]See the other thread. The problem isn't speed or ntfs-3g.
Note that the message I replied to said that "I'm impressed with 160 MB/s average transfer rate...That's significantly faster than before.". My response addressed why that would be the case: ntfs-3g will never be fast because it runs via fuse. I've used exfat at several hundred MB/s and was limited by the speed of the external drive rather than the speed of the fs driver. If transfer rate is important, and ntfs is a requirement, I would use the ntfs3 kernel driver rather than ntfs-3g. (Which would require a fairly recent debian kernel.)
It is most probably that the NTFS is running out of mft records [1], a resource you set up when making the ntfs file system. Man mkntfs(8), option
I'm skeptical of this and feel it's more likely an ntfs-3g issue, as it's not normal for people to have to reformat ntfs volumes with special options in order to copy files. The thread you linked seems to support that hypothesis. I personally wouldn't pursue trying to fix this for reasons I discussed previously (vs using a different solution) which is why I haven't addressed it.