Christopher Barry on 14 Nov 2016 10:23:33 -0800 |
[Date Prev] [Date Next] [Thread Prev] [Thread Next] [Date Index] [Thread Index]
Re: [PLUG] Linux networking really slow on copy |
On Mon, 14 Nov 2016 12:31:08 -0500 JP Vossen <jp@jpsdomain.org> wrote: >I'm trying to copy about 3TB from a physical machine to a VM running >on Debian8 + VMware Workstation 10, and it's going badly. <...snip> > >Clues? > You're writing to a vm which is going to have much slower network and disk io than on the bare metal. Here's what I recommend you try: setup rsync to behave as a server on the debian 8 box outside of the vm. You'll need to create a configuration for the 'share' that you'll see from the source box. You'll need to create a password file as well. >From the source, you'll push directly without ssh using the rsync protocol. no compression, no encryption. Once you have the data on the debian 8 box, you can decide how you want to access that data from the vm, or if you really want to copy the data into the vm. Personally, I would create a logical volume on the debian 8 host box, and attach to that like a scsi disk from the vm. You could setup the rsync server on the vm rather than it's host if you really wanted to, but there will be a lot more overhead and it will be much slower. I've used this rsync server technique to backup hundreds of multi-TB mysql databases over the wire, and it is by far the fastest way I have found to do that kind of thing. -- Regards, Christopher ___________________________________________________________________________ Philadelphia Linux Users Group -- http://www.phillylinux.org Announcements - http://lists.phillylinux.org/mailman/listinfo/plug-announce General Discussion -- http://lists.phillylinux.org/mailman/listinfo/plug