lagg speed trouble
i have sever with two 1G links (em) aggregated by lagg0 after 1700Megabits i have collisions/errors on lagg0 port, but not on em0 or em1 I'm using nginx in own CDN. and server don't limited my mbufs, irq, or anything else.. only lagg0 errors ( netstat -w 1 -I em0 input (em0) output packets errs idrops bytespackets errs bytes colls 43871 0 02726437 38304 0 108063773 0 43417 0 02700512 39084 0 109215143 0 43474 0 02701344 39303 0 108373730 0 43755 0 02717689 39023 0 108766820 0 43960 0 02733462 39476 0 109030307 0 44675 0 02776654 38708 0 107313936 0 44082 0 02734293 39089 0 108897889 0 netstat -w 1 -I em1 input (em1) output packets errs idrops bytespackets errs bytes colls 43754 0 02722677 38943 0 108504216 0 44561 0 02778854 39107 0 108418763 0 44773 0 02784606 39006 0 108799148 0 45134 0 02814622 39137 0 108557494 0 44604 0 02770745 38998 0 107942619 0 44813 0 02789991 38901 0 108438247 0 netstat -w 1 -I lagg0 input(lagg0) output packets errs idrops bytespackets errs bytes colls 87964 0 05474019 78172 1964 20549 0 88842 0 05533987 78852 1811 222578109 0 87687 0 05454717 77279 2416 86391 0 87995 0 05471653 78090 2040 223488046 0 88314 0 05493348 78495 1994 222548964 0 88411 0 05502818 78228 1949 14374 0 how i can get full link speed on this server? ___ freebsd-net@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
Re: lagg speed trouble
>Do the ports on the switch report any layer 2 error, by chance ? I don't have access to swith, but without lagg0 i have near 980Mbit's on one em0 network link. ___ freebsd-net@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
Re: lagg speed trouble
2012/7/5 Eugene Grosbein > 04.07.2012 18:30, Vyacheslav Kulikovskyy пишет: > > i have sever with two 1G links (em) aggregated by lagg0 > > > > after 1700Megabits i have collisions/errors on lagg0 port, but not on em0 > > or em1 > > > > I'm using nginx in own CDN. and server don't limited my mbufs, irq, or > > anything else.. only lagg0 errors ( > > lagg0 by default uses way too small output FIFO queue, 50 slots. > You definitely want to increase this to sum of your em intefaces > txd buffers at least. So, if you use hw.em.txd=4096, you should > use 8192 for lagg or more. I prefer 10K, in /boot/loader.conf: > > net.link.ifqmaxlen=10240 > > Reboot is required. > > Eugene Grosbein > This is solution don't help me hw.em.txd: 4096 net.link.ifqmaxlen: 10240 # netstat -w 1 -I lagg0 input(lagg0) output packets errs idrops bytespackets errs bytes colls 77600 0 04771508 7117570 208916199 0 79747 0 04885070 73101 242 218847447 0 84956 0 05262540 74504 455 213752515 0 81333 0 04998499 73836 229 215808086 0 and no errors on em0,em1 more info: FreeBSD 9.0-STABLE #0: AMD64 ps after small test i'll try patch from Andrew Thompson ___ freebsd-net@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
Re: lagg speed trouble
this patch don't help (, on switch errors not found. 2012/7/4 Andrew Thompson > On 4 July 2012 23:30, Vyacheslav Kulikovskyy wrote: > > i have sever with two 1G links (em) aggregated by lagg0 > > > > after 1700Megabits i have collisions/errors on lagg0 port, but not on em0 > > or em1 > > > > I'm using nginx in own CDN. and server don't limited my mbufs, irq, or > > anything else.. only lagg0 errors ( > > > netstat -w 1 -I lagg0 > > input(lagg0) output > >packets errs idrops bytespackets errs bytes colls > > 87964 0 05474019 78172 1964 20549 0 > > 88842 0 05533987 78852 1811 222578109 0 > > 87687 0 05454717 77279 2416 86391 0 > > 87995 0 05471653 78090 2040 223488046 0 > > 88314 0 05493348 78495 1994 222548964 0 > > 88411 0 05502818 78228 1949 14374 0 > > > > how i can get full link speed on this server? > > This probably means the packet could not be queued on the lagg > interface send queue. Please try this patch. > > > Andrew > ___ freebsd-net@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
Re: lagg speed trouble
2012/7/5 Andrew Thompson > On 6 July 2012 04:43, Vyacheslav Kulikovskyy wrote: > > 2012/7/4 Andrew Thompson > >> > >> On 4 July 2012 23:30, Vyacheslav Kulikovskyy > wrote: > >> > i have sever with two 1G links (em) aggregated by lagg0 > >> > > >> > after 1700Megabits i have collisions/errors on lagg0 port, but not on > >> > em0 > >> > or em1 > >> > > >> > I'm using nginx in own CDN. and server don't limited my mbufs, irq, or > >> > anything else.. only lagg0 errors ( > >> > >> > netstat -w 1 -I lagg0 > >> > input(lagg0) output > >> >packets errs idrops bytespackets errs bytes colls > >> > 88314 0 05493348 78495 1994 222548964 0 > >> > 88411 0 05502818 78228 1949 14374 0 > >> > > >> > how i can get full link speed on this server? > >> > >> This probably means the packet could not be queued on the lagg > >> interface send queue. Please try this patch. > >> > > this patch don't help (, on switch errors not found. > > > > Can you be more specific. Did the patch fail to work or was there no > change in the speed? I don't know what you mean by "on switch errors > not found" > > i'm install patch and rebuild kernel, after reboot nothing changed. by "switch errors" i mean that data center support send me interface counters with 0 errors. today i was try change laggproto to roundrobin and this help me +100Mbit... to my 1700Mbit ___ freebsd-net@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
