| Walt Mankowski via plug on 10 Nov 2025 10:57:49 -0800 |
[Date Prev] [Date Next] [Thread Prev] [Thread Next] [Date Index] [Thread Index]
| Re: [PLUG] XFS limits |
It turns out that the very next file bumps the total size above 4 TB. Regardless of the cause, it's clear that the limit exists for me. Which is fine. I already knew going in that I was going to have to transfer the files in multiple batches. Whether I split at 4 TB or 5 TB doesn't matter. I made a small tweak to my script to generate directories of symlinks, and I'm good to go. Walt On Mon, Nov 10, 2025 at 11:53:42AM -0500, Walt Mankowski via plug wrote: > On Mon, Nov 10, 2025 at 11:40:42AM -0500, Keith C. Perry wrote: > > I've never run into any limits with XFS. I have encrypted containers (i.e. a single file) that are 4Tb and larger. I also have paths that often contain more than 4Tb. > > Thanks. That's more or less what I expected. > > > Perhaps you somehow set a quota or file/path exclusions (on the source) ? > > I didn't, but it's possible the sysadmin set the quota. > > Walt > > > > ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ > > Keith C. Perry, MS E.E. > > Managing Member, DAO Technologies LLC > > (O) +1.215.525.4165 x2033 > > (M) +1.215.432.5167 > > [ http://www.daotechnologies.com/ | www.daotechnologies.com ] > > > > ----- Original Message ----- > > From: "Philadelphia Linux User's Group Discussion List" <plug@lists.phillylinux.org> > > To: "Philadelphia Linux User's Group Discussion List" <plug@lists.phillylinux.org> > > Sent: Monday, November 10, 2025 11:11:32 AM > > Subject: [PLUG] XFS limits > > > > Hi all, > > > > Anyone have any experience using XFS? I just ran into a weird error. > > I'm wondering if maybe there's a limit of 4 TB of files in a single > > directory. > > > > An rsync job just quietly stopped working. To be specific, it acted > > like it was still working and no errors were reported, but at some > > point overnight files stopped being stored on the remote box. > > > > I was trying to transfer 4.9 TB of files, all in a single directory. > > (Don't ask.) I thought it was getting close to finishing, but when I > > looked closer I saw that the last file on the remote box had a > > timestamp from around 2 AM this morning. > > > > It's also possible we hit a 4 TB quota, but then I'd have expected to > > get an error. > > > > Thanks. > > > > Walt > > ___________________________________________________________________________ > > Philadelphia Linux Users Group -- http://www.phillylinux.org > > Announcements - http://lists.phillylinux.org/mailman/listinfo/plug-announce > > General Discussion -- http://lists.phillylinux.org/mailman/listinfo/plug > ___________________________________________________________________________ > Philadelphia Linux Users Group -- http://www.phillylinux.org > Announcements - http://lists.phillylinux.org/mailman/listinfo/plug-announce > General Discussion -- http://lists.phillylinux.org/mailman/listinfo/plug ___________________________________________________________________________ Philadelphia Linux Users Group -- http://www.phillylinux.org Announcements - http://lists.phillylinux.org/mailman/listinfo/plug-announce General Discussion -- http://lists.phillylinux.org/mailman/listinfo/plug