Hi Ian, I've tried with 2.6.32-28 but problem persists. So we have a problem with symptoms similar to #596802. I'll attach the oops details.
Regards, Stephan
Jan 4 17:46:33 n0020 kernel: [ 82.100424] device vif1.0 entered promiscuous
mode
Jan 4 17:46:33 n0020 kernel: [ 82.103545] br0: port 2(vif1.0) entering
learning state
Jan 4 17:46:33 n0020 kernel: [ 82.269708] ip_tables: (C) 2000-2006 Netfilter
Core Team
Jan 4 17:46:34 n0020 kernel: [ 82.900774] nf_conntrack version 0.5.0 (4062
buckets, 16248 max)
Jan 4 17:46:34 n0020 kernel: [ 82.901499] CONFIG_NF_CT_ACCT is deprecated
and will be removed soon. Please use
Jan 4 17:46:34 n0020 kernel: [ 82.901773] nf_conntrack.acct=1 kernel
parameter, acct=1 nf_conntrack module option or
Jan 4 17:46:34 n0020 kernel: [ 82.902035] sysctl
net.netfilter.nf_conntrack_acct=1 to enable it.
Jan 4 17:46:34 n0020 kernel: [ 83.335139] tun: Universal TUN/TAP device
driver, 1.6
Jan 4 17:46:34 n0020 kernel: [ 83.335428] tun: (C) 1999-2004 Max Krasnyansky
<m...@qualcomm.com>
Jan 4 17:46:34 n0020 kernel: [ 83.492992] physdev match: using --physdev-out
in the OUTPUT, FORWARD and POSTROUTING chains for non-bridged traffic is not
supported anymore.
Jan 4 17:46:34 n0020 kernel: [ 83.507857] device tap1.0 entered promiscuous
mode
Jan 4 17:46:34 n0020 kernel: [ 83.508180] br0: port 3(tap1.0) entering
learning state
Jan 4 17:46:44 n0020 kernel: [ 92.692116] hrtimer: interrupt took 150037247
ns
Jan 4 17:46:48 n0020 kernel: [ 97.101015] br0: port 2(vif1.0) entering
forwarding state
Jan 4 17:46:49 n0020 kernel: [ 98.508020] br0: port 3(tap1.0) entering
forwarding state
Jan 4 17:46:52 n0020 kernel: [ 100.992120] br0: port 3(tap1.0) entering
disabled state
Jan 4 17:46:52 n0020 kernel: [ 101.008073] device tap1.0 left promiscuous mode
Jan 4 17:46:52 n0020 kernel: [ 101.008263] br0: port 3(tap1.0) entering
disabled state
Jan 4 17:46:56 n0020 kernel: [ 105.285534] blkback: ring-ref 1536,
event-channel 6, protocol 2 (x86_32-abi)
Jan 4 17:47:04 n0020 kernel: [ 113.061493] frontend_changed: backend/vif/1/0:
prepare for reconnect
Jan 4 17:47:55 n0020 kernel: [ 164.315756] ------------[ cut here
]------------
Jan 4 17:47:55 n0020 kernel: [ 164.316079] WARNING: at
/build/buildd-linux-2.6_2.6.32-28-amd64-EUJiNq/linux-2.6-2.6.32/debian/build/source_amd64_xen/net/core/dev.c:1582
skb_gso_segment+0x109/0x263()
Jan 4 17:47:55 n0020 kernel: [ 164.316689] Hardware name:
Jan 4 17:47:55 n0020 kernel: [ 164.316991] e1000e: caps=(0x110ba9, 0x0)
len=5453 data_len=5395 ip_summed=1
Jan 4 17:47:55 n0020 kernel: [ 164.317001] Modules linked in:
nf_conntrack_ipv4 nf_defrag_ipv4 tun xt_state nf_conntrack xt_physdev
iptable_filter ip_tables x_tables nfsd lockd nfs_acl auth_rpcgss sunrpc
xen_evtchn exportfs xenfs bridge stp ext3 jbd mbcache loop firewire_sbp2
nouveau ttm drm_kms_helper snd_hda_codec_idt drm i2c_algo_bit i2c_i801
parport_pc i2c_core parport snd_hda_intel snd_hda_codec snd_hwdep snd_pcm
snd_timer snd pcspkr evdev button processor soundcore snd_page_alloc
acpi_processor dm_mod btrfs zlib_deflate crc32c libcrc32c sg sd_mod crc_t10dif
sr_mod cdrom uhci_hcd firewire_ohci ata_generic ahci pata_marvell firewire_core
libata floppy ehci_hcd scsi_mod thermal thermal_sys crc_itu_t e1000e usbcore
nls_base [last unloaded: scsi_wait_scan]
Jan 4 17:47:55 n0020 kernel: [ 164.319704] Pid: 0, comm: swapper Not tainted
2.6.32-5-xen-amd64 #1
Jan 4 17:47:55 n0020 kernel: [ 164.319704] Call Trace:
Jan 4 17:47:55 n0020 kernel: [ 164.319704] <IRQ> [<ffffffff8125eeb6>] ?
skb_gso_segment+0x109/0x263
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff8125eeb6>] ?
skb_gso_segment+0x109/0x263
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff8104ed8c>] ?
warn_slowpath_common+0x77/0xa3
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff8104ee14>] ?
warn_slowpath_fmt+0x51/0x59
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff8100e5bd>] ?
xen_force_evtchn_callback+0x9/0xa
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff8100ec72>] ?
check_events+0x12/0x20
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffffa003f739>] ?
e1000_get_drvinfo+0xac/0xe3 [e1000e]
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff8125eeb6>] ?
skb_gso_segment+0x109/0x263
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff8125f1c0>] ?
dev_hard_start_xmit+0x1b0/0x2b8
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff81272550>] ?
sch_direct_xmit+0x58/0x14c
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff8125f61b>] ?
dev_queue_xmit+0x252/0x38d
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffffa02c7c51>] ?
br_dev_queue_push_xmit+0x75/0x79 [bridge]
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffffa02cc050>] ?
br_nf_post_routing+0x1b1/0x1c8 [bridge]
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff8127c16a>] ?
nf_iterate+0x41/0x7d
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffffa02c7bdc>] ?
br_dev_queue_push_xmit+0x0/0x79 [bridge]
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff8127c208>] ?
nf_hook_slow+0x62/0xc3
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffffa02c7bdc>] ?
br_dev_queue_push_xmit+0x0/0x79 [bridge]
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff8127c208>] ?
nf_hook_slow+0x62/0xc3
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffffa02c7c93>] ?
br_forward_finish+0x3e/0x54 [bridge]
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffffa02cc2dd>] ?
br_nf_forward_finish+0xaa/0xb0 [bridge]
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffffa02cc489>] ?
br_nf_forward_ip+0x1a6/0x1c0 [bridge]
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff8127c16a>] ?
nf_iterate+0x41/0x7d
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffffa02c7c55>] ?
br_forward_finish+0x0/0x54 [bridge]
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff8127c208>] ?
nf_hook_slow+0x62/0xc3
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffffa02c7c55>] ?
br_forward_finish+0x0/0x54 [bridge]
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffffa02c7d31>] ?
__br_forward+0x88/0x9d [bridge]
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffffa02c885f>] ?
br_handle_frame_finish+0x127/0x148 [bridge]
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffffa02cca5e>] ?
br_nf_pre_routing_finish+0x284/0x2a6 [bridge]
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffffa02cc7da>] ?
br_nf_pre_routing_finish+0x0/0x2a6 [bridge]
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff8127c208>] ?
nf_hook_slow+0x62/0xc3
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffffa02cc7da>] ?
br_nf_pre_routing_finish+0x0/0x2a6 [bridge]
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffffa02ccfe1>] ?
br_nf_pre_routing+0x561/0x57e [bridge]
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff8127c16a>] ?
nf_iterate+0x41/0x7d
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffffa02c8738>] ?
br_handle_frame_finish+0x0/0x148 [bridge]
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff8127c208>] ?
nf_hook_slow+0x62/0xc3
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffffa02c8738>] ?
br_handle_frame_finish+0x0/0x148 [bridge]
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffffa02c8a28>] ?
br_handle_frame+0x1a8/0x1cc [bridge]
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff8125e4c9>] ?
netif_receive_skb+0x350/0x46d
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff8125e667>] ?
process_backlog+0x81/0xb4
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff8125ec44>] ?
net_rx_action+0xae/0x1c9
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff81054acf>] ?
__do_softirq+0xdd/0x1a2
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff81096e39>] ?
handle_edge_irq+0xdd/0x101
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff81012cac>] ?
call_softirq+0x1c/0x30
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff8101422b>] ?
do_softirq+0x3f/0x7c
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff8105493e>] ?
irq_exit+0x36/0x76
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff811f1925>] ?
xen_evtchn_do_upcall+0x33/0x42
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff81012cfe>] ?
xen_do_hypervisor_callback+0x1e/0x30
Jan 4 17:47:55 n0020 kernel: [ 164.319704] <EOI> [<ffffffff810093aa>] ?
hypercall_page+0x3aa/0x1001
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff810093aa>] ?
hypercall_page+0x3aa/0x1001
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff8100eb95>] ?
xen_vcpuop_set_next_event+0x0/0x60
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff8100e63b>] ?
xen_safe_halt+0xc/0x15
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff8100bf47>] ?
xen_idle+0x37/0x40
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff81010eb1>] ?
cpu_idle+0xa2/0xda
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff81506cd1>] ?
start_kernel+0x3dc/0x3e8
Jan 4 17:47:55 n0020 kernel: [ 164.319704] [<ffffffff81508c7d>] ?
xen_start_kernel+0x57c/0x581
Jan 4 17:47:55 n0020 kernel: [ 164.319704] ---[ end trace e9cc8fcc01e3b264
]---
Jan 4 17:47:56 n0020 kernel: [ 164.646393] ------------[ cut here
]------------
Jan 4 17:47:56 n0020 kernel: [ 164.646674] WARNING: at
/build/buildd-linux-2.6_2.6.32-28-amd64-EUJiNq/linux-2.6-2.6.32/debian/build/source_amd64_xen/net/core/dev.c:1582
skb_gso_segment+0x109/0x263()
Jan 4 17:47:56 n0020 kernel: [ 164.647178] Hardware name:
Jan 4 17:47:56 n0020 kernel: [ 164.647447] e1000e: caps=(0x110ba9, 0x0)
len=11720 data_len=11662 ip_summed=1
Jan 4 17:47:56 n0020 kernel: [ 164.647458] Modules linked in:
nf_conntrack_ipv4 nf_defrag_ipv4 tun xt_state nf_conntrack xt_physdev
iptable_filter ip_tables x_tables nfsd lockd nfs_acl auth_rpcgss sunrpc
xen_evtchn exportfs xenfs bridge stp ext3 jbd mbcache loop firewire_sbp2
nouveau ttm drm_kms_helper snd_hda_codec_idt drm i2c_algo_bit i2c_i801
parport_pc i2c_core parport snd_hda_intel snd_hda_codec snd_hwdep snd_pcm
snd_timer snd pcspkr evdev button processor soundcore snd_page_alloc
acpi_processor dm_mod btrfs zlib_deflate crc32c libcrc32c sg sd_mod crc_t10dif
sr_mod cdrom uhci_hcd firewire_ohci ata_generic ahci pata_marvell firewire_core
libata floppy ehci_hcd scsi_mod thermal thermal_sys crc_itu_t e1000e usbcore
nls_base [last unloaded: scsi_wait_scan]
Jan 4 17:47:56 n0020 kernel: [ 164.649634] Pid: 0, comm: swapper Tainted: G
W 2.6.32-5-xen-amd64 #1
Jan 4 17:47:56 n0020 kernel: [ 164.649917] Call Trace:
Jan 4 17:47:56 n0020 kernel: [ 164.650192] <IRQ> [<ffffffff8125eeb6>] ?
skb_gso_segment+0x109/0x263
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff8125eeb6>] ?
skb_gso_segment+0x109/0x263
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff8104ed8c>] ?
warn_slowpath_common+0x77/0xa3
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff8104ee14>] ?
warn_slowpath_fmt+0x51/0x59
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff8100e5bd>] ?
xen_force_evtchn_callback+0x9/0xa
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff8100ec72>] ?
check_events+0x12/0x20
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffffa003f739>] ?
e1000_get_drvinfo+0xac/0xe3 [e1000e]
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff8125eeb6>] ?
skb_gso_segment+0x109/0x263
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff8125f1c0>] ?
dev_hard_start_xmit+0x1b0/0x2b8
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff81272550>] ?
sch_direct_xmit+0x58/0x14c
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff8125f61b>] ?
dev_queue_xmit+0x252/0x38d
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffffa02c7c51>] ?
br_dev_queue_push_xmit+0x75/0x79 [bridge]
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffffa02cc050>] ?
br_nf_post_routing+0x1b1/0x1c8 [bridge]
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff8127c16a>] ?
nf_iterate+0x41/0x7d
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffffa02c7bdc>] ?
br_dev_queue_push_xmit+0x0/0x79 [bridge]
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff8127c208>] ?
nf_hook_slow+0x62/0xc3
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffffa02c7bdc>] ?
br_dev_queue_push_xmit+0x0/0x79 [bridge]
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff8127c208>] ?
nf_hook_slow+0x62/0xc3
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffffa02c7c93>] ?
br_forward_finish+0x3e/0x54 [bridge]
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffffa02cc2dd>] ?
br_nf_forward_finish+0xaa/0xb0 [bridge]
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffffa02cc489>] ?
br_nf_forward_ip+0x1a6/0x1c0 [bridge]
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff8127c16a>] ?
nf_iterate+0x41/0x7d
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffffa02c7c55>] ?
br_forward_finish+0x0/0x54 [bridge]
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff8127c208>] ?
nf_hook_slow+0x62/0xc3
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffffa02c7c55>] ?
br_forward_finish+0x0/0x54 [bridge]
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffffa02c7d31>] ?
__br_forward+0x88/0x9d [bridge]
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffffa02c885f>] ?
br_handle_frame_finish+0x127/0x148 [bridge]
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffffa02cca5e>] ?
br_nf_pre_routing_finish+0x284/0x2a6 [bridge]
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffffa02cc7da>] ?
br_nf_pre_routing_finish+0x0/0x2a6 [bridge]
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff8127c208>] ?
nf_hook_slow+0x62/0xc3
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffffa02cc7da>] ?
br_nf_pre_routing_finish+0x0/0x2a6 [bridge]
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffffa02ccfe1>] ?
br_nf_pre_routing+0x561/0x57e [bridge]
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff8127c16a>] ?
nf_iterate+0x41/0x7d
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffffa02c8738>] ?
br_handle_frame_finish+0x0/0x148 [bridge]
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff8127c208>] ?
nf_hook_slow+0x62/0xc3
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffffa02c8738>] ?
br_handle_frame_finish+0x0/0x148 [bridge]
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffffa02c8a28>] ?
br_handle_frame+0x1a8/0x1cc [bridge]
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff8125e4c9>] ?
netif_receive_skb+0x350/0x46d
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff8125e667>] ?
process_backlog+0x81/0xb4
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff8125ec44>] ?
net_rx_action+0xae/0x1c9
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff81054acf>] ?
__do_softirq+0xdd/0x1a2
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff81096e39>] ?
handle_edge_irq+0xdd/0x101
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff81012cac>] ?
call_softirq+0x1c/0x30
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff8101422b>] ?
do_softirq+0x3f/0x7c
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff8105493e>] ?
irq_exit+0x36/0x76
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff811f1925>] ?
xen_evtchn_do_upcall+0x33/0x42
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff81012cfe>] ?
xen_do_hypervisor_callback+0x1e/0x30
Jan 4 17:47:56 n0020 kernel: [ 164.650345] <EOI> [<ffffffff810093aa>] ?
hypercall_page+0x3aa/0x1001
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff810093aa>] ?
hypercall_page+0x3aa/0x1001
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff8100e63b>] ?
xen_safe_halt+0xc/0x15
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff8100bf47>] ?
xen_idle+0x37/0x40
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff81010eb1>] ?
cpu_idle+0xa2/0xda
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff81506cd1>] ?
start_kernel+0x3dc/0x3e8
Jan 4 17:47:56 n0020 kernel: [ 164.650345] [<ffffffff81508c7d>] ?
xen_start_kernel+0x57c/0x581
Jan 4 17:47:56 n0020 kernel: [ 164.650345] ---[ end trace e9cc8fcc01e3b265
]---
[...]
smime.p7s
Description: S/MIME Cryptographic Signature
