| Lee H. Marzke on 14 Nov 2016 11:39:32 -0800 |
[Date Prev] [Date Next] [Thread Prev] [Thread Next] [Date Index] [Thread Index]
| Re: [PLUG] Linux networking really slow on copy |
A few years ago I was moving ISO files to storage through a VM to a mounted disk and found that transferring the ISO via vCenter directly to the NFS storage layer was 100X faster. So again, if you can mount the storage directly to your machine it might be faster. With NFS, there is no problem in writing to storage the VM is using , but you can't do that easily with iSCSI or local disk unless the VM is down. Lee ----- Original Message ----- > From: "Tone Montone" <tonemontone@gmail.com> > To: "Philadelphia Linux User's Group Discussion List" <plug@lists.phillylinux.org> > Sent: Monday, November 14, 2016 1:04:13 PM > Subject: Re: [PLUG] Linux networking really slow on copy > I have a small esxi server running vms, and just transferring iso images seem to > take forever. Internal home class c network. I always thought it was vmware's > networking layers. I would be interested in what you find and how you resolve. > > Mike > > Sent from my iPhone > >> On Nov 14, 2016, at 12:31 PM, JP Vossen <jp@jpsdomain.org> wrote: >> >> I'm trying to copy about 3TB from a physical machine to a VM running on Debian8 >> + VMware Workstation 10, and it's going badly. I'm copying 2,000+ MythTV >> files; half are the tiny PNG thumbnail pics and half are *.mpg ranging up to a >> single 21G file. >> >> I've had a lot of load and general slowness and since that same host and VMware >> runs my main "services" server that's not good. I tried to cut out the >> overhead of SSH and Rsync as follows: >> source: tar cv . | nc -q 1 192.168.80.81 5123 >> target: nc -q 1 -l -p 5123 | pv -pterb -s 3T | tar xv >> >> The data is now moving over a cross-over cable on dedicated NICs on IPAs that >> are not on my LAN, so I know the traffic is flowing on the x-over cable. The >> physical machine has eth1 connected to eth1 on the Debian host. That NIC has >> no IP on the host, but is bridged to vmnet2 in VMware and the target VM's eth1 >> is connected to that. >> >> Target VM: # mii-tool >> eth0: negotiated 1000baseT-FD flow-control, link ok >> eth1: negotiated 1000baseT-FD flow-control, link o >> >> The physical machine: # mii-tool >> eth0: negotiated 100baseTx-FD, link ok >> eth1: negotiated 1000baseT-FD flow-control, link ok >> >> eth0 is odd because it's connected to the same core GigE switch everything else >> is and all the other ports (e.g. the Debian host) are 1000baseT-FD as expected. >> The 100baseT is also part of the reason to try the dedicated x-over cable, >> which is 1000baseT-FD as expected. >> >> In ALL cases I've tried so far, transfer speed starts out about as expected but >> then rapidly tanks to nothing and/or then flails around. >> >> Examples: >> Originally with rsync: 11MB/s down to ~192KB/s >> Originally with netcat: same >> Cross-over and netcat: 100MB/s to ~192KB/s but now all over >> >> All over is ranging as I watch it from 74MB/s to 850KB/s but often hovering in >> the 15MB/s or 25MB/s range. >> >> The source is an old PE2950 running Mythbuntu 14.04, the target is a slightly >> less old R710 running Debian8 + VMWst 10 and the target VM is booted into >> mythbuntu-14.04.1-desktop-amd64.iso with the appropriate VM file systems >> mounted into /mnt/. >> >> WTH? Note I have not tuned the stock network stack on any machine involved. So >> this looks like maybe I have a buffering or flow-control problem, but I don't >> know where or how to fix it. >> >> Clues? >> >> Thanks, >> JP >> -- ------------------------------------------------------------------- >> JP Vossen, CISSP | http://www.jpsdomain.org/ | http://bashcookbook.com/ >> ___________________________________________________________________________ >> Philadelphia Linux Users Group -- http://www.phillylinux.org >> Announcements - http://lists.phillylinux.org/mailman/listinfo/plug-announce >> General Discussion -- http://lists.phillylinux.org/mailman/listinfo/plug > ___________________________________________________________________________ > Philadelphia Linux Users Group -- http://www.phillylinux.org > Announcements - http://lists.phillylinux.org/mailman/listinfo/plug-announce > General Discussion -- http://lists.phillylinux.org/mailman/listinfo/plug -- "Between subtle shading and the absence of light lies the nuance of iqlusion..." - Kryptos Lee Marzke, lee@marzke.net http://marzke.net/lee/ IT Consultant, VMware, VCenter, SAN storage, infrastructure, SW CM +1 800-393-5217 office +1 484-348-2230 fax +1 252 627-9531 sms ( 252 MARZKE1 ) ___________________________________________________________________________ Philadelphia Linux Users Group -- http://www.phillylinux.org Announcements - http://lists.phillylinux.org/mailman/listinfo/plug-announce General Discussion -- http://lists.phillylinux.org/mailman/listinfo/plug