K.S. Bhaskar on 1 Apr 2011 16:39:25 -0700


[Date Prev] [Date Next] [Thread Prev] [Thread Next] [Date Index] [Thread Index]

Re: [PLUG] gnu parallel and tar


Switch from bz2 to gzip and you may get home before Monday morning!
bzip2 is terribly slow for large byte streams - I once found it faster
move data uncompressed than to use bz2 (gzip was faster yet).  bzip2
is great if you have to download a disk image over a 110 Baud modem.

Sorry, I don't know about parallelizing tar.

-- Bhaskar

On Fri, Apr 1, 2011 at 6:03 PM, Julien Vehent <julien@linuxwall.info> wrote:
> Hey guys,
>
> I'm currently stuck at work on a friday evening at 6pm because of a tar/bz
> that is taking forever.
> It wouldn't be a problem if my computer was actually used properly for this
> task, but it is not. Out of 4 cores, only one is used.
>
> I've been looking at gnu parallel [1] for quite a while and tonight
> situation tickle my "there must be a better way to do this" side. So, I'm
> consulting the GNUs : Do you guys know of a way to use multiple core in a
> tar -cjvf ?
>
>
> Thanks,
>
> Julien
>
> [1] http://www.gnu.org/software/parallel/
> ___________________________________________________________________________
> Philadelphia Linux Users Group     --    Âhttp://www.phillylinux.org
> Announcements - http://lists.phillylinux.org/mailman/listinfo/plug-announce
> General Discussion Â-- Â http://lists.phillylinux.org/mailman/listinfo/plug
>



-- 
Windows does to computers what smoking does to humans
___________________________________________________________________________
Philadelphia Linux Users Group         --        http://www.phillylinux.org
Announcements - http://lists.phillylinux.org/mailman/listinfo/plug-announce
General Discussion  --   http://lists.phillylinux.org/mailman/listinfo/plug