Try enabling the gso and the tso but keeping the gro disabled El 16/12/2014 19:38, "Georgios Dimitrakakis" <gior...@acmac.uoc.gr> escribió:
> I have changed that on both the node and the VMs and actually made things > worse. > > I did that on both eth1 and br100 interfaces on the physical node. > > The transfer speed now is 15MB/s half of the one I had before! > > Have I missed something? I believe that this is not an expected behaviour? > > > Here are the outputs for both br100 and eth1 on the node in case I have > missed something: > > > # ethtool -k br100 > Features for br100: > rx-checksumming: off [fixed] > tx-checksumming: on > tx-checksum-ipv4: off > tx-checksum-unneeded: off > tx-checksum-ip-generic: on > tx-checksum-ipv6: off > tx-checksum-fcoe-crc: off [fixed] > tx-checksum-sctp: off [fixed] > scatter-gather: on > tx-scatter-gather: on > tx-scatter-gather-fraglist: on [fixed] > tcp-segmentation-offload: off > tx-tcp-segmentation: off > tx-tcp-ecn-segmentation: on > tx-tcp6-segmentation: on > udp-fragmentation-offload: on [fixed] > generic-segmentation-offload: off > generic-receive-offload: off > large-receive-offload: off [fixed] > rx-vlan-offload: off [fixed] > tx-vlan-offload: off [fixed] > ntuple-filters: off [fixed] > receive-hashing: off [fixed] > highdma: on [fixed] > rx-vlan-filter: off [fixed] > vlan-challenged: off [fixed] > tx-lockless: on [fixed] > netns-local: on [fixed] > tx-gso-robust: off [fixed] > tx-fcoe-segmentation: off [fixed] > tx-gre-segmentation: on [fixed] > tx-udp_tnl-segmentation: on [fixed] > fcoe-mtu: off [fixed] > loopback: off [fixed] > > > # ethtool -k eth1 > Features for eth1: > rx-checksumming: on > tx-checksumming: on > tx-checksum-ipv4: off > tx-checksum-unneeded: off > tx-checksum-ip-generic: on > tx-checksum-ipv6: off > tx-checksum-fcoe-crc: off [fixed] > tx-checksum-sctp: off [fixed] > scatter-gather: on > tx-scatter-gather: on > tx-scatter-gather-fraglist: off [fixed] > tcp-segmentation-offload: off > tx-tcp-segmentation: off > tx-tcp-ecn-segmentation: off > tx-tcp6-segmentation: off > udp-fragmentation-offload: off [fixed] > generic-segmentation-offload: off > generic-receive-offload: off > large-receive-offload: off [fixed] > rx-vlan-offload: on [fixed] > tx-vlan-offload: on [fixed] > ntuple-filters: off [fixed] > receive-hashing: off [fixed] > highdma: on [fixed] > rx-vlan-filter: off [fixed] > vlan-challenged: off [fixed] > tx-lockless: off [fixed] > netns-local: off [fixed] > tx-gso-robust: off [fixed] > tx-fcoe-segmentation: off [fixed] > tx-gre-segmentation: off [fixed] > tx-udp_tnl-segmentation: off [fixed] > fcoe-mtu: off [fixed] > loopback: off [fixed] > > > > > Best, > > > George > > > > > > Disabling it only on the nodes should boost the speed but disabling it >> in the vms too improves greatly the speed >> El 16/12/2014 19:13, "Georgios Dimitrakakis" escribió: >> >> Ooops...It seems that I have been confused.. >>> >>> The pasted part is indeed from the node when I was looking >>> somewhere else.... >>> >>> Thanks a lot for noticing that Adrian!!!! >>> >>> I will turn it off on the nodes and test again! >>> >>> Should it be off on both the nodes and the VMs? >>> >>> Regards, >>> >>> George >>> >>> That shows that those 3 offload settibgs are enabled. >>>> El 16/12/2014 19:01, "Georgios Dimitrakakis" escribió: >>>> >>>> I believe that they are already disabled. >>>>> >>>>> Here is the ethtool output: >>>>> >>>>> # ethtool --show-offload eth1 >>>>> Features for eth1: >>>>> rx-checksumming: on >>>>> tx-checksumming: on >>>>> tx-checksum-ipv4: off >>>>> tx-checksum-unneeded: off >>>>> tx-checksum-ip-generic: on >>>>> tx-checksum-ipv6: off >>>>> tx-checksum-fcoe-crc: off [fixed] >>>>> tx-checksum-sctp: off [fixed] >>>>> scatter-gather: on >>>>> tx-scatter-gather: on >>>>> tx-scatter-gather-fraglist: off [fixed] >>>>> tcp-segmentation-offload: on >>>>> tx-tcp-segmentation: on >>>>> tx-tcp-ecn-segmentation: off >>>>> tx-tcp6-segmentation: on >>>>> udp-fragmentation-offload: off [fixed] >>>>> generic-segmentation-offload: on >>>>> generic-receive-offload: on >>>>> large-receive-offload: off [fixed] >>>>> rx-vlan-offload: on [fixed] >>>>> tx-vlan-offload: on [fixed] >>>>> ntuple-filters: off [fixed] >>>>> receive-hashing: off [fixed] >>>>> highdma: on [fixed] >>>>> rx-vlan-filter: off [fixed] >>>>> vlan-challenged: off [fixed] >>>>> tx-lockless: off [fixed] >>>>> netns-local: off [fixed] >>>>> tx-gso-robust: off [fixed] >>>>> tx-fcoe-segmentation: off [fixed] >>>>> tx-gre-segmentation: off [fixed] >>>>> tx-udp_tnl-segmentation: off [fixed] >>>>> fcoe-mtu: off [fixed] >>>>> loopback: off [fixed] >>>>> >>>>> Regards, >>>>> >>>>> George >>>>> >>>>> Disable offloading on the nodes with: ethtool -K interfaceName >>>>>> gro >>>>>> off >>>>>> gso off tso off >>>>>> >>>>>> And then try it again >>>>>> El 16/12/2014 18:36, "Georgios Dimitrakakis" escribió: >>>>>> >>>>>> Hi all! >>>>>>> >>>>>>> In my OpenStack installation (Icehouse and use nova legacy >>>>>>> networking) the VMs are talking to each other over a 1Gbps >>>>>>> network >>>>>>> link. >>>>>>> >>>>>>> My issue is that although file transfers between physical >>>>>>> (hypervisor) nodes can saturate that link transfers between >>>>>>> VMs >>>>>>> reach very lower speeds e.g. 30MB/s (approx. 240Mbps). >>>>>>> >>>>>>> My tests are performed by scping a large image file >>>>>>> (approx. >>>>>>> 4GB) >>>>>>> between the nodes and between the VMs. >>>>>>> >>>>>>> I have updated my images to use e1000 nic driver but the >>>>>>> results >>>>>>> remain the same. >>>>>>> >>>>>>> What are any other limiting factors? >>>>>>> >>>>>>> Does it has to do with the disk driver I am using? Does it >>>>>>> play >>>>>>> significant role the filesystem of the hypervisor node? >>>>>>> >>>>>>> Any ideas on how to approach the saturation of the 1Gbps >>>>>>> link? >>>>>>> >>>>>>> Best regards, >>>>>>> >>>>>>> George >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Mailing list: >>>>>>> >>>>>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack >>>>>> >>>>>>> [1] >>>>>>> [1] [1] >>>>>>> Post to : openstack@lists.openstack.org [2] [2] [2] >>>>>>> Unsubscribe : >>>>>>> >>>>>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack >>>>>> >>>>>>> [3] >>>>>>> [3] [3] >>>>>>> >>>>>> >>>>>> Links: >>>>>> ------ >>>>>> [1] >>>>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack >>>>>> [4] >>>>>> [4] >>>>>> [2] mailto:openstack@lists.openstack.org [5] [5] >>>>>> [3] >>>>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack >>>>>> [6] >>>>>> [6] >>>>>> [4] mailto:gior...@acmac.uoc.gr [7] [7] >>>>>> >>>>> >>>> Links: >>>> ------ >>>> [1] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack >>>> [8] >>>> [2] mailto:openstack@lists.openstack.org [9] >>>> [3] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack >>>> [10] >>>> [4] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack >>>> [11] >>>> [5] mailto:openstack@lists.openstack.org [12] >>>> [6] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack >>>> [13] >>>> [7] mailto:gior...@acmac.uoc.gr [14] >>>> [8] mailto:gior...@acmac.uoc.gr [15] >>>> >>> >> >> Links: >> ------ >> [1] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack >> [2] mailto:openstack@lists.openstack.org >> [3] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack >> [4] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack >> [5] mailto:openstack@lists.openstack.org >> [6] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack >> [7] mailto:gior...@acmac.uoc.gr >> [8] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack >> [9] mailto:openstack@lists.openstack.org >> [10] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack >> [11] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack >> [12] mailto:openstack@lists.openstack.org >> [13] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack >> [14] mailto:gior...@acmac.uoc.gr >> [15] mailto:gior...@acmac.uoc.gr >> [16] mailto:gior...@acmac.uoc.gr >> > >
_______________________________________________ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : openstack@lists.openstack.org Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
