Re: [PLUG] 3-way data mirror?

["Gavin W. Burris" <bug@sas.upenn.edu>]

I would consider using revision control, like SVN, if your data files
aren't too large, especially if the raw data doesn't change much.  The
problem is that changes in binary files do not benefit from diffs, with
each change requiring a complete upload/sync of the file.
http://subversion.apache.org/

Another option that would apply to future, more data intensive
collaboration, would be iRODS.  This is a more comprehensive solution
that builds a "data grid" for distributed projects.
https://www.irods.org/index.php/What_is_iRODS%3F

Cheers.


On 12/12/2010 12:52 AM, JP Vossen wrote:
> I have a situation where I have 2 labs that need to keep ~150G of data
> in sync, but they can't talk to each other.  They can talk to a 3rd
> machine, which is also backed up, so...
> 
> What I think I'd like to do is have:
> 
>     Lab1 <--> COLO <--> Lab2
> 
> The problem is that lab1 and lab2 are both read-write, so there is a
> real possibility of stepping on changes.  COLO is read-only.
> 
> I'd try to just relay through the COLO, but that's also where the backup
> will happen.  And I can't get the FW rules changed.
> 
> Any better ideas?
> 
> Any suggestions on tools?  I'd strongly prefer something already in the
> CentOS-5 or EPEL repos.
> 
> Thanks,
> JP
> ----------------------------|:::======|-------------------------------
> JP Vossen, CISSP            |:::======|      http://bashcookbook.com/
> My Account, My Opinions     |=========|      http://www.jpsdomain.org/
> ----------------------------|=========|-------------------------------
> "Microsoft Tax" = the additional hardware & yearly fees for the add-on
> software required to protect Windows from its own poorly designed and
> implemented self, while the overhead incidentally flattens Moore's Law.
> ___________________________________________________________________________
> Philadelphia Linux Users Group         --        http://www.phillylinux.org
> Announcements - http://lists.phillylinux.org/mailman/listinfo/plug-announce
> General Discussion  --   http://lists.phillylinux.org/mailman/listinfo/plug
> 

-- 
Gavin W. Burris
Senior Systems Programmer
Information Security and Unix Systems
School of Arts and Sciences
University of Pennsylvania
___________________________________________________________________________
Philadelphia Linux Users Group         --        http://www.phillylinux.org
Announcements - http://lists.phillylinux.org/mailman/listinfo/plug-announce
General Discussion  --   http://lists.phillylinux.org/mailman/listinfo/plug