We have same problem. Cogent noc says use another provider, Comcast will not upgrade unless they pay for the traffic b/c they send more then they take in. I attach Ren Provo for official statement.
Vinod > Date: Mon, 22 Apr 2013 22:35:27 -0700 > Subject: Comcast NOC - issues to/from AS13331 (Seattle) > From: mlof...@wgops.com > To: nanog@nanog.org > > Comcast doesn't appear to have any usable NOC contacts via whois, and > this issue is apparently very widespread. Comcast obviously has > multiple saturated paths out in this area, so if you're seeing issues > getting to your customers on Comcast...well, it's probably Comcast. > Sort of an ongoing/me too on last months thread about same... > > > Outbound traffic to Comcast via basically any of our (AS13331) > upstreams except Spectrum (AS11404) is experiencing very high packet > loss once inside Comcast's network, we suspect a router or link very > near to us in Seattle is failing. I've marked out the destination > customer IPs but they're available to Comcast engineers if they get in > touch with me directly or as n...@metapeer.com -- TIA -- and again, > sorry to the list. > > Below are three failing/high loss traces, and then same three traces > from our other DC which is routing out via spectrum. The loss is > present on Cogent and L3 outgoing paths at the least, maybe others. > As of now I've routed around the problem point for via the good path. > > fission:~# mtr -s 900 --report --report-cycles 30 1.2.3.4 > fission.myfreecams.com Snt: 30 Loss% Last Avg Best Wrst > StDev > ve75-gw1-xmr.metapeer.com 0.0% 0.4 1.4 0.3 11.8 > 2.9 > te0-7-0-15.ccr21.sea02.atlas.cogentco.com 0.0% 0.9 0.6 0.5 0.9 > 0.1 > te-0-5-0-3-pe03.seattle.wa.ibone.comcast.net 6.7% 43.7 42.3 38.8 43.7 > 1.4 > be-13-cr01.seattle.wa.ibone.comcast.net 3.3% 47.7 44.6 41.3 47.7 > 1.8 > pos-0-7-0-0-cr01.denver.co.ibone.comcast.net 3.3% 69.4 68.7 65.0 71.3 > 1.5 > he-5-15-0-0-cr01.350ecermak.il.ibone.comcast 6.7% 92.6 97.3 91.4 102.0 > 3.8 > he-3-15-0-0-ar01.woburn.ma.boston.comcast.ne 10.0% 120.3 119.8 116.3 122.0 > 1.8 > pos-0-1-0-0-ar01.needham.ma.boston.comcast.n 0.0% 122.0 120.5 117.1 123.9 > 1.8 > po-80-ur01.deering.nh.boston.comcast.net 0.0% 121.4 121.3 118.3 133.8 > 2.8 > po-21-ur01.concord.nh.boston.comcast.net 6.7% 119.6 130.1 119.3 272.8 > 31.8 > te-1-0-0-ten01.concord.nh.boston.comcast.net 6.7% 118.7 120.0 117.6 121.4 > 1.3 > ??? 100.0 0.0 0.0 0.0 0.0 > 0.0 > You have new mail in /var/spool/mail/root > fission:~# mtr -s 900 --report --report-cycles 30 5.6.7.8 > fission.myfreecams.com Snt: 30 Loss% Last Avg Best Wrst > StDev > ve75-gw1-xmr.metapeer.com 0.0% 0.3 0.6 0.3 5.2 > 0.9 > te0-7-0-15.ccr21.sea02.atlas.cogentco.com 0.0% 0.8 0.6 0.5 0.8 > 0.1 > te-0-5-0-3-pe03.seattle.wa.ibone.comcast.net 0.0% 41.4 42.6 38.5 43.8 > 1.3 > be-13-cr01.seattle.wa.ibone.comcast.net 0.0% 45.6 44.1 40.4 46.7 > 1.8 > pos-0-8-0-0-cr01.denver.co.ibone.comcast.net 6.7% 71.2 69.0 65.0 72.1 > 1.9 > he-5-12-0-0-cr01.350ecermak.il.ibone.comcast 3.3% 98.1 96.3 86.4 101.2 > 3.9 > he-0-15-0-0-ar01.pontiac.mi.michigan.comcast 10.0% 93.5 97.3 93.5 100.6 > 2.3 > xe-11-0-0-0-sur01.rochestrhlls.mi.michigan.c 0.0% 97.2 99.1 92.9 141.8 > 10.4 > te-17-10-cdn05.rochestrhlls.mi.michigan.comc 3.3% 118.9 113.2 104.6 118.9 > 3.5 > ??? 100.0 0.0 0.0 0.0 0.0 > 0.0 > fission:~# mtr -s 900 --report --report-cycles 30 a.b.c.d > fission.myfreecams.com Snt: 30 Loss% Last Avg Best Wrst > StDev > ve75-gw1-xmr.metapeer.com 0.0% 0.3 2.1 0.3 47.1 > 8.6 > te0-7-0-15.ccr21.sea02.atlas.cogentco.com 0.0% 0.7 0.6 0.5 0.8 > 0.1 > te-0-5-0-3-pe03.seattle.wa.ibone.comcast.net 6.7% 40.6 42.4 39.7 45.2 > 1.3 > be-15-cr01.seattle.wa.ibone.comcast.net 0.0% 47.3 48.2 41.3 54.8 > 4.3 > 68.86.92.34 3.3% 43.7 45.5 39.5 101.7 > 11.6 > be-18-ur06.bellevue.wa.seattle.comcast.net 0.0% 43.8 43.0 40.2 44.3 > 1.4 > te-3-0-0-ten15.bellevue.wa.seattle.comcast.n 6.7% 42.7 44.1 42.1 45.7 > 1.1 > ??? 100.0 0.0 0.0 0.0 0.0 > 0.0 > > > > > > > > > mloftis@phobos:~$ mtr -s 900 --report --report-wide --report-cycles 30 1.2.3.4 > HOST: phobos Loss% Snt > Last Avg Best Wrst StDev > 1. 207.229.74.1 0.0% 30 > 0.4 5.1 0.3 132.4 24.1 > 2. agg1-sea-t7-8.bb.spectrumnet.us 0.0% 30 > 1.5 14.0 1.5 206.4 39.8 > 3. 23.30.206.33 0.0% 30 > 1.8 2.0 1.7 3.5 0.3 > 4. be-17-cr01.seattle.wa.ibone.comcast.net 0.0% 30 > 12.6 5.3 2.1 12.6 2.7 > 5. pos-0-4-0-0-cr01.denver.co.ibone.comcast.net 0.0% 30 > 28.5 29.2 27.2 31.4 1.3 > 6. he-5-12-0-0-cr01.350ecermak.il.ibone.comcast.net 0.0% 30 > 49.9 52.2 49.9 56.7 2.8 > 7. he-3-5-0-0-ar01.woburn.ma.boston.comcast.net 0.0% 30 > 78.5 79.5 78.3 81.0 1.0 > 8. pos-1-12-0-0-ar01.needham.ma.boston.comcast.net 0.0% 30 > 80.2 80.1 78.2 81.7 1.1 > 9. po-80-ur01.deering.nh.boston.comcast.net 0.0% 30 > 80.0 80.1 79.9 80.4 0.1 > 10. po-21-ur01.concord.nh.boston.comcast.net 0.0% 30 > 80.7 85.1 80.7 199.3 21.6 > 11. te-1-0-0-ten01.concord.nh.boston.comcast.net 0.0% 30 > 80.5 80.5 80.5 80.7 0.0 > 12. ??? 100.0 30 > 0.0 0.0 0.0 0.0 0.0 > mloftis@phobos:~$ mtr -s 900 --report --report-wide --report-cycles 30 5.6.7.8 > HOST: phobos Loss% > Snt Last Avg Best Wrst StDev > 1. 207.229.74.1 0.0% > 30 0.3 3.6 0.3 96.3 17.5 > 2. agg1-sea-t7-8.bb.spectrumnet.us 0.0% > 30 10.2 10.4 1.5 58.5 15.1 > 3. 23.30.206.33 0.0% > 30 2.4 2.0 1.8 2.4 0.1 > 4. be-14-cr01.seattle.wa.ibone.comcast.net 0.0% > 30 3.6 4.4 1.7 10.6 2.4 > 5. pos-0-3-0-0-cr01.denver.co.ibone.comcast.net 0.0% > 30 31.1 29.5 27.2 31.6 1.3 > 6. he-5-12-0-0-cr01.350ecermak.il.ibone.comcast.net 0.0% > 30 52.3 55.4 50.3 61.5 3.6 > 7. he-0-14-0-0-ar01.pontiac.mi.michigan.comcast.net 0.0% > 30 58.9 58.0 56.1 60.1 1.2 > 8. xe-11-0-0-0-sur01.rochestrhlls.mi.michigan.comcast.net 0.0% > 30 71.2 58.9 56.6 83.6 6.4 > 9. te-17-10-cdn05.rochestrhlls.mi.michigan.comcast.net 0.0% > 30 71.2 72.6 67.6 78.0 3.2 > 10. ??? 100.0 > 30 0.0 0.0 0.0 0.0 0.0 > mloftis@phobos:~$ mtr -s 900 --report --report-wide --report-cycles 30 a.b.c.d > HOST: phobos Loss% Snt > Last Avg Best Wrst StDev > 1. 207.229.74.1 0.0% 30 0.7 > 5.1 0.3 143.4 26.1 > 2. agg1-sea-t7-8.bb.spectrumnet.us 0.0% 30 1.5 > 3.1 1.5 30.1 5.6 > 3. 23.30.206.33 0.0% 30 1.9 > 2.0 1.9 2.2 0.1 > 4. be-12-cr01.seattle.wa.ibone.comcast.net 0.0% 30 6.9 > 5.1 1.7 12.3 3.1 > 5. 68.86.94.70 0.0% 30 1.8 > 2.4 1.8 17.3 2.8 > 6. be-18-ur06.bellevue.wa.seattle.comcast.net 0.0% 30 3.5 > 3.4 3.3 3.5 0.1 > 7. te-3-0-0-ten15.bellevue.wa.seattle.comcast.net 0.0% 30 3.3 > 3.2 3.2 3.4 0.0 > 8. ??? 100.0 30 0.0 > 0.0 0.0 0.0 0.0 > mloftis@phobos:~$ > > -- > > "Genius might be described as a supreme capacity for getting its possessors > into trouble of all kinds." > -- Samuel Butler >