Hi Stuart,
Thank you for response.
What would be the "warning value"?
See pfctl -vvsq after pf is enabled below.
Currently the router does not drop any packets.
I will wait for it to start :-(, and check again.
Regards,
Ivo
queue root_em2 on em2 bandwidth 300Mb priority 0 cbq( wrr root )
{net56_out, net200_out, net501_out, net600_out, net801_out, net804_out,
net805_out, net806_out, net810_out, net811_out, nopay_out, default_out}
[ pkts: 502297 bytes: 223243919 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 859.8 packets/s, 3.39Mb/s ]
queue net56_out on em2 bandwidth 5Mb {net56_gl, net56_bg}
[ pkts: 0 bytes: 0 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.0 packets/s, 0 b/s ]
queue net56_gl on em2 bandwidth 1Mb cbq( red )
[ pkts: 129 bytes: 30357 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.1 packets/s, 120.43 b/s ]
queue net56_bg on em2 bandwidth 4Mb cbq( red borrow )
[ pkts: 194 bytes: 28950 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.2 packets/s, 141.90 b/s ]
queue net200_out on em2 bandwidth 5Mb {net200_gl, net200_bg}
[ pkts: 0 bytes: 0 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.0 packets/s, 0 b/s ]
queue net200_gl on em2 bandwidth 1Mb cbq( red )
[ pkts: 2092 bytes: 2390900 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 193 ]
[ measured: 3.5 packets/s, 33.19Kb/s ]
queue net200_bg on em2 bandwidth 4Mb cbq( red borrow )
[ pkts: 12474 bytes: 16934890 dropped pkts: 7 bytes:
10046 ]
[ qlength: 0/ 50 borrows: 4417 suspends: 543 ]
[ measured: 79.4 packets/s, 902.76Kb/s ]
queue net501_out on em2 bandwidth 5Mb cbq( red )
[ pkts: 596 bytes: 463752 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.2 packets/s, 259.24 b/s ]
queue net600_out on em2 bandwidth 10Mb {net600_gl, net600_bg}
[ pkts: 0 bytes: 0 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.0 packets/s, 0 b/s ]
queue net600_gl on em2 bandwidth 2Mb cbq( red )
[ pkts: 21385 bytes: 5735682 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 24.2 packets/s, 44.33Kb/s ]
queue net600_bg on em2 bandwidth 8Mb cbq( red borrow )
[ pkts: 9 bytes: 630 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.0 packets/s, 20.49 b/s ]
queue net801_out on em2 bandwidth 10Mb {net801_gl, net801_bg}
[ pkts: 0 bytes: 0 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.0 packets/s, 0 b/s ]
queue net801_gl on em2 bandwidth 2Mb cbq( red )
[ pkts: 3916 bytes: 465471 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.5 packets/s, 283.50 b/s ]
queue net801_bg on em2 bandwidth 8Mb cbq( red borrow )
[ pkts: 439 bytes: 147398 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.1 packets/s, 685.00 b/s ]
queue net804_out on em2 bandwidth 10Mb {net804_gl, net804_bg}
[ pkts: 0 bytes: 0 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.0 packets/s, 0 b/s ]
queue net804_gl on em2 bandwidth 5Mb cbq( red )
[ pkts: 139901 bytes: 57214725 dropped pkts: 180 bytes:
134485 ]
[ qlength: 0/ 50 borrows: 0 suspends: 2155 ]
[ measured: 340.7 packets/s, 1.25Mb/s ]
queue net804_bg on em2 bandwidth 5Mb cbq( red borrow )
[ pkts: 38655 bytes: 4112994 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 47.0 packets/s, 42.11Kb/s ]
queue net805_out on em2 bandwidth 10Mb {net805_gl, net805_bg}
[ pkts: 0 bytes: 0 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.0 packets/s, 0 b/s ]
queue net805_gl on em2 bandwidth 2Mb cbq( red )
[ pkts: 2499 bytes: 288275 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 2.3 packets/s, 2.74Kb/s ]
queue net805_bg on em2 bandwidth 8Mb cbq( red borrow )
[ pkts: 17779 bytes: 2286809 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 24.9 packets/s, 48.34Kb/s ]
queue net806_out on em2 bandwidth 10Mb {net806_gl, net806_bg}
[ pkts: 0 bytes: 0 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.0 packets/s, 0 b/s ]
queue net806_gl on em2 bandwidth 2Mb cbq( red )
[ pkts: 482 bytes: 73816 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.3 packets/s, 348.38 b/s ]
queue net806_bg on em2 bandwidth 8Mb cbq( red borrow )
[ pkts: 4140 bytes: 658901 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.5 packets/s, 491.59 b/s ]
queue net810_out on em2 bandwidth 10Mb {net810_gl, net810_bg}
[ pkts: 0 bytes: 0 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.0 packets/s, 0 b/s ]
queue net810_gl on em2 bandwidth 5Mb cbq( red )
[ pkts: 17122 bytes: 3472977 dropped pkts: 157 bytes:
10229 ]
[ qlength: 0/ 50 borrows: 0 suspends: 34 ]
[ measured: 11.0 packets/s, 20.34Kb/s ]
queue net810_bg on em2 bandwidth 5Mb cbq( red borrow )
[ pkts: 40861 bytes: 46663371 dropped pkts: 363 bytes:
526838 ]
[ qlength: 0/ 50 borrows: 14966 suspends: 611 ]
[ measured: 79.2 packets/s, 791.68Kb/s ]
queue net811_out on em2 bandwidth 10Mb {net811_gl, net811_bg}
[ pkts: 0 bytes: 0 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.0 packets/s, 0 b/s ]
queue net811_gl on em2 bandwidth 7Mb cbq( red )
[ pkts: 54399 bytes: 8278321 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 57.2 packets/s, 67.10Kb/s ]
queue net811_bg on em2 bandwidth 3Mb cbq( red borrow )
[ pkts: 4591 bytes: 818646 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 77 suspends: 0 ]
[ measured: 14.0 packets/s, 25.46Kb/s ]
queue nopay_out on em2 bandwidth 512Kb
[ pkts: 0 bytes: 0 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.0 packets/s, 0 b/s ]
queue default_out on em2 bandwidth 10Mb cbq( borrow default )
[ pkts: 140634 bytes: 73177054 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 2584 suspends: 0 ]
[ measured: 174.3 packets/s, 159.37Kb/s ]
queue root_em1 on em1 bandwidth 300Mb priority 0 cbq( wrr root )
{net56_in, net200_in, net501_in, net600_in, net801_in, net804_in,
net805_in, net806_in, net810_in, net811_in, nopay_in, default_in}
[ pkts: 499632 bytes: 351031555 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 822.2 packets/s, 4.33Mb/s ]
queue net56_in on em1 bandwidth 5Mb {net56_gl_in, net56_bg_in}
[ pkts: 0 bytes: 0 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.0 packets/s, 0 b/s ]
queue net56_gl_in on em1 bandwidth 1Mb cbq( red )
[ pkts: 93 bytes: 45493 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.0 packets/s, 202.63 b/s ]
queue net56_bg_in on em1 bandwidth 4Mb cbq( red borrow )
[ pkts: 223 bytes: 118734 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 13 suspends: 2 ]
[ measured: 0.1 packets/s, 94.88 b/s ]
queue net200_in on em1 bandwidth 5Mb {net200_gl_in, net200_bg_in}
[ pkts: 0 bytes: 0 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.0 packets/s, 0 b/s ]
queue net200_gl_in on em1 bandwidth 1Mb cbq( red )
[ pkts: 1640 bytes: 198651 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 2.8 packets/s, 2.25Kb/s ]
queue net200_bg_in on em1 bandwidth 4Mb cbq( red borrow )
[ pkts: 7875 bytes: 692767 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 41.8 packets/s, 23.40Kb/s ]
queue net501_in on em1 bandwidth 5Mb cbq( red )
[ pkts: 492 bytes: 139266 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.3 packets/s, 591.91 b/s ]
queue net600_in on em1 bandwidth 10Mb {net600_gl_in, net600_bg_in}
[ pkts: 0 bytes: 0 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.0 packets/s, 0 b/s ]
queue net600_gl_in on em1 bandwidth 2Mb cbq( red )
[ pkts: 27599 bytes: 13437726 dropped pkts: 114 bytes:
74156 ]
[ qlength: 0/ 50 borrows: 0 suspends: 344 ]
[ measured: 32.2 packets/s, 133Kb/s ]
queue net600_bg_in on em1 bandwidth 8Mb cbq( red borrow )
[ pkts: 51 bytes: 4838 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.1 packets/s, 73.37 b/s ]
queue net801_in on em1 bandwidth 10Mb {net801_gl_in, net801_bg_in}
[ pkts: 0 bytes: 0 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.0 packets/s, 0 b/s ]
queue net801_gl_in on em1 bandwidth 2Mb cbq( red )
[ pkts: 5724 bytes: 7320338 dropped pkts: 210 bytes:
273794 ]
[ qlength: 0/ 50 borrows: 0 suspends: 1180 ]
[ measured: 0.5 packets/s, 640.07 b/s ]
queue net801_bg_in on em1 bandwidth 8Mb cbq( red borrow )
[ pkts: 604 bytes: 413603 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 25 suspends: 21 ]
[ measured: 0.2 packets/s, 127.00 b/s ]
queue net804_in on em1 bandwidth 10Mb {net804_gl_in, net804_bg_in}
[ pkts: 0 bytes: 0 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.0 packets/s, 0 b/s ]
queue net804_gl_in on em1 bandwidth 5Mb cbq( red )
[ pkts: 127162 bytes: 85208071 dropped pkts: 1014 bytes:
1274291 ]
[ qlength: 0/ 50 borrows: 0 suspends: 9474 ]
[ measured: 346.9 packets/s, 2.35Mb/s ]
queue net804_bg_in on em1 bandwidth 5Mb cbq( red borrow )
[ pkts: 43867 bytes: 20705100 dropped pkts: 49 bytes:
63932 ]
[ qlength: 0/ 50 borrows: 10465 suspends: 499 ]
[ measured: 49.9 packets/s, 65.05Kb/s ]
queue net805_in on em1 bandwidth 10Mb {net805_gl_in, net805_bg_in}
[ pkts: 0 bytes: 0 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.0 packets/s, 0 b/s ]
queue net805_gl_in on em1 bandwidth 2Mb cbq( red )
[ pkts: 3689 bytes: 3967967 dropped pkts: 57 bytes:
69873 ]
[ qlength: 0/ 50 borrows: 0 suspends: 659 ]
[ measured: 2.4 packets/s, 12.34Kb/s ]
queue net805_bg_in on em1 bandwidth 8Mb cbq( red borrow )
[ pkts: 27954 bytes: 36272646 dropped pkts: 40 bytes:
60560 ]
[ qlength: 0/ 50 borrows: 7460 suspends: 1380 ]
[ measured: 35.2 packets/s, 268.12Kb/s ]
queue net806_in on em1 bandwidth 10Mb {net806_gl_in, net806_bg_in}
[ pkts: 0 bytes: 0 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.0 packets/s, 0 b/s ]
queue net806_gl_in on em1 bandwidth 2Mb cbq( red )
[ pkts: 387 bytes: 91351 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.3 packets/s, 387.06 b/s ]
queue net806_bg_in on em1 bandwidth 8Mb cbq( red borrow )
[ pkts: 4975 bytes: 4024725 dropped pkts: 17 bytes:
24278 ]
[ qlength: 0/ 50 borrows: 838 suspends: 101 ]
[ measured: 0.5 packets/s, 1.41Kb/s ]
queue net810_in on em1 bandwidth 10Mb {net810_gl_in, net810_bg_in}
[ pkts: 0 bytes: 0 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.0 packets/s, 0 b/s ]
queue net810_gl_in on em1 bandwidth 4Mb cbq( red )
[ pkts: 14634 bytes: 7332824 dropped pkts: 8 bytes:
9208 ]
[ qlength: 0/ 50 borrows: 0 suspends: 253 ]
[ measured: 9.9 packets/s, 33.77Kb/s ]
queue net810_bg_in on em1 bandwidth 6Mb cbq( red borrow )
[ pkts: 31254 bytes: 8302017 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 671 suspends: 54 ]
[ measured: 53.5 packets/s, 84.90Kb/s ]
queue net811_in on em1 bandwidth 10Mb {net811_gl_in, net811_bg_in}
[ pkts: 0 bytes: 0 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.0 packets/s, 0 b/s ]
queue net811_gl_in on em1 bandwidth 7Mb cbq( red )
[ pkts: 71691 bytes: 84058422 dropped pkts: 249 bytes:
326170 ]
[ qlength: 0/ 50 borrows: 0 suspends: 8652 ]
[ measured: 85.0 packets/s, 832.82Kb/s ]
queue net811_bg_in on em1 bandwidth 3Mb cbq( red borrow )
[ pkts: 4449 bytes: 1990919 dropped pkts: 16 bytes:
17515 ]
[ qlength: 0/ 50 borrows: 662 suspends: 40 ]
[ measured: 14.4 packets/s, 75.50Kb/s ]
queue nopay_in on em1 bandwidth 512Kb
[ pkts: 0 bytes: 0 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 0 suspends: 0 ]
[ measured: 0.0 packets/s, 0 b/s ]
queue default_in on em1 bandwidth 10Mb cbq( borrow default )
[ pkts: 125269 bytes: 76706097 dropped pkts: 0 bytes:
0 ]
[ qlength: 0/ 50 borrows: 10468 suspends: 0 ]
[ measured: 146.1 packets/s, 454.05Kb/s ]
Stuart Henderson wrote:
On 2009-08-04, Ivo Chutkin <open...@bgone.net> wrote:
Hello misc,
I have strange problem when I use PF for traffic shaping.
No such problem with PF disabled.
It is OpenBSD 4.5 stable. Here is dmesg: http://paste.lisp.org/display/84738
look for queue drops. pfctl -vvsq.
The problem is that the router start to generate losses.
It generates losses even to directly connected hosts. Here is an example:
r...@core1.bg
~ # ping a.a.a.230
PING a.a.a.230 (a.a.a.230): 56 data bytes
ping: sendto: No route to host
ping: wrote a.a.a.230 64 chars, ret=-1
ping: sendto: No route to host
ping: wrote a.a.a.230 64 chars, ret=-1
ping: sendto: No route to host
ping: wrote a.a.a.230 64 chars, ret=-1
ping: sendto: No route to host
ping: wrote a.a.a.230 64 chars, ret=-1
64 bytes from a.a.a.230: icmp_seq=4 ttl=255 time=0.954 ms
64 bytes from a.a.a.230: icmp_seq=5 ttl=255 time=1.363 ms
64 bytes from a.a.a.230: icmp_seq=6 ttl=255 time=1.288 ms
64 bytes from a.a.a.230: icmp_seq=7 ttl=255 time=1.213 ms
64 bytes from a.a.a.230: icmp_seq=8 ttl=255 time=1.136 ms
64 bytes from a.a.a.230: icmp_seq=9 ttl=255 time=1.214 ms
64 bytes from a.a.a.230: icmp_seq=10 ttl=255 time=1.022 ms
64 bytes from a.a.a.230: icmp_seq=11 ttl=255 time=1.409 ms
64 bytes from a.a.a.230: icmp_seq=12 ttl=255 time=1.334 ms
64 bytes from a.a.a.230: icmp_seq=13 ttl=255 time=1.741 ms
64 bytes from a.a.a.230: icmp_seq=14 ttl=255 time=1.183 ms
a.a.a.230 is on the other and of vlan600, my ip is a.a.a.229
It just happens to all directly connected hosts.
And also mtr to ibm.com:
http://paste.lisp.org/display/84728
Firs packets get lost and then the losses disappear.
Next time I issue ping or mtr command it starts with losses.
It also happen to web traffic and it is annoying for the users.
It does not happen with pf disabled.
There is no more than 10 to 15 Mbit per second load and maximum total
pps I have seen according to systat ifstat is 8000, average 4000.
Here is my pf.conf:
http://paste.lisp.org/display/84727
I really appreciate your help.
If you need more info I did not provide or explain correctly just let me
know. If the links are broken I will paste the configs to the list.
Thank you,
Ivo
__________ Information from ESET NOD32 Antivirus, version of virus signature
database 4304 (20090804) __________
The message was checked by ESET NOD32 Antivirus.
http://www.eset.com
__________ Information from ESET NOD32 Antivirus, version of virus signature
database 4306 (20090804) __________
The message was checked by ESET NOD32 Antivirus.
http://www.eset.com
__________ Information from ESET NOD32 Antivirus, version of virus signature
database 4307 (20090805) __________
The message was checked by ESET NOD32 Antivirus.
http://www.eset.com
