Martin Cracauer via plug on 14 Nov 2025 05:26:04 -0800


[Date Prev] [Date Next] [Thread Prev] [Thread Next] [Date Index] [Thread Index]

Re: [PLUG] XFS limits


Walt Mankowski via plug wrote on Mon, Nov 10, 2025 at 11:11:32AM -0500: 
> Hi all,
> 
> Anyone have any experience using XFS? I just ran into a weird error.
> I'm wondering if maybe there's a limit of 4 TB of files in a single
> directory.
> 
> An rsync job just quietly stopped working. To be specific, it acted
> like it was still working and no errors were reported, but at some
> point overnight files stopped being stored on the remote box.
> 
> I was trying to transfer 4.9 TB of files, all in a single directory.
> (Don't ask.) I thought it was getting close to finishing, but when I
> looked closer I saw that the last file on the remote box had a
> timestamp from around 2 AM this morning.
> 
> It's also possible we hit a 4 TB quota, but then I'd have expected to
> get an error.

Maybe a 32 bit executable is involved that has been compiled without
#define_LARGEFILE_SOURCE

Although, that would be a per-file limit, not for the contents of a
directory.

I would run the rsync under strace.

Martin
-- 
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
Martin Cracauer <cracauer@cons.org>   http://www.cons.org/cracauer/
___________________________________________________________________________
Philadelphia Linux Users Group         --        http://www.phillylinux.org
Announcements - http://lists.phillylinux.org/mailman/listinfo/plug-announce
General Discussion  --   http://lists.phillylinux.org/mailman/listinfo/plug