Re: [PLUG] Linux networking really slow on copy

[Christopher Barry <christopher.r.barry@gmail.com>]

On Mon, 14 Nov 2016 12:31:08 -0500
JP Vossen <jp@jpsdomain.org> wrote:

>I'm trying to copy about 3TB from a physical machine to a VM running
>on Debian8 + VMware Workstation 10, and it's going badly.
<...snip>
>
>Clues?
>


You're writing to a vm which is going to have much slower network
and disk io than on the bare metal.

Here's what I recommend you try:

setup rsync to behave as a server on the debian 8 box outside of the vm.
You'll need to create a configuration for the 'share' that you'll see
from the source box. You'll need to create a password file as well.

>From the source, you'll push directly without ssh using the rsync
protocol. no compression, no encryption.

Once you have the data on the debian 8 box, you can decide how you want
to access that data from the vm, or if you really want to copy the data
into the vm. Personally, I would create a logical volume on the debian 8
host box, and attach to that like a scsi disk from the vm.

You could setup the rsync server on the vm rather than it's host if you
really wanted to, but there will be a lot more overhead and it will be
much slower.

I've used this rsync server technique to backup hundreds of multi-TB
mysql databases over the wire, and it is by far the fastest way I have
found to do that kind of thing.


-- 
Regards,
Christopher
___________________________________________________________________________
Philadelphia Linux Users Group         --        http://www.phillylinux.org
Announcements - http://lists.phillylinux.org/mailman/listinfo/plug-announce
General Discussion  --   http://lists.phillylinux.org/mailman/listinfo/plug