gabriel rosenkoetter on Fri, 5 Apr 2002 15:00:15 +0200


[Date Prev] [Date Next] [Thread Prev] [Thread Next] [Date Index] [Thread Index]

Re: [PLUG] Moveing large files


On Fri, Apr 05, 2002 at 02:06:07AM -0500, Chuck Peters wrote:
> If Ian is moving 7 gigs of data from milaukee wisconsin it seems likely
> the network will cause a problem and drop the transfer. rsync has
> compression, uses rsh and it will pick up where it left off if your use
> the --partial option.

A valid point.

> I don't know if rsync has the 2 gig file limitation.  A year old post on
> the rsync page http://rsync.samba.org/rsync/fom-serve/cache/50.html lists
> an unanswered question about the 2 gig limit on AIX.  I have transferred
> more than 2 gigs at a time with rsync, but it was a lot of files.  On one
> occasion I had a problem with rsync when I tried to transfer a 20 gig disk
> with thousands of files, the machine ran out of memory building the file
> listing.

I think it's more likely that AIX problems with >2 GB files come
from AIX's libc than from anything rsync did or didn't do.

Neither transferring many files totalling >2 GBs nor failing to
transfer many files because rsync couldn't build a file list to
parse on the other end says much about sizeof(blksize_t) for that
operating system on that architecture. (But I think you know that.)

-- 
gabriel rosenkoetter
gr@eclipsed.net

Attachment: pgp688kY6G4bx.pgp
Description: PGP signature