Re: REGRESSION: RIP: 0010:skb_release_data+0xb8/0x1e0 in vhost/tun

2024-04-07 Thread Jaroslav Pulchart
čt 4. 4. 2024 v 20:17 odesílatel Jaroslav Pulchart napsal: > > čt 4. 4. 2024 v 15:37 odesílatel Jakub Kicinski napsal: > > > > On Thu, 4 Apr 2024 07:42:45 +0200 Jaroslav Pulchart wrote: > > > We do not have much progress > > > > Random thought - do you have KFENCE enabled? > > It's sufficiently l

Re: REGRESSION: RIP: 0010:skb_release_data+0xb8/0x1e0 in vhost/tun

2024-04-04 Thread Jaroslav Pulchart
čt 4. 4. 2024 v 15:37 odesílatel Jakub Kicinski napsal: > > On Thu, 4 Apr 2024 07:42:45 +0200 Jaroslav Pulchart wrote: > > We do not have much progress > > Random thought - do you have KFENCE enabled? > It's sufficiently low overhead to run in production and maybe it could > help catch the bug? Yo

Re: REGRESSION: RIP: 0010:skb_release_data+0xb8/0x1e0 in vhost/tun

2024-04-04 Thread Jakub Kicinski
On Thu, 4 Apr 2024 07:42:45 +0200 Jaroslav Pulchart wrote: > We do not have much progress Random thought - do you have KFENCE enabled? It's sufficiently low overhead to run in production and maybe it could help catch the bug? You also hit some inexplicable bug in the Intel driver, IIRC, there may

Re: REGRESSION: RIP: 0010:skb_release_data+0xb8/0x1e0 in vhost/tun

2024-04-03 Thread Jaroslav Pulchart
út 26. 3. 2024 v 5:46 odesílatel Jason Wang napsal: > > On Mon, Mar 25, 2024 at 4:44 PM Igor Raits wrote: > > > > Hello, > > > > On Fri, Mar 22, 2024 at 12:19 PM Igor Raits wrote: > > > > > > Hi Jason, > > > > > > On Fri, Mar 22, 2024 at 9:39 AM Igor Raits wrote: > > > > > > > > Hi Jason, > > >

Re: REGRESSION: RIP: 0010:skb_release_data+0xb8/0x1e0 in vhost/tun

2024-03-27 Thread Jaroslav Pulchart
st 27. 3. 2024 v 4:11 odesílatel Jason Wang napsal: > > On Tue, Mar 26, 2024 at 9:26 PM Jaroslav Pulchart > wrote: > > > > > > > > On Mon, Mar 25, 2024 at 4:44 PM Igor Raits wrote: > > > > > > > > Hello, > > > > > > > > On Fri, Mar 22, 2024 at 12:19 PM Igor Raits wrote: > > > > > > > > > > Hi J

Re: REGRESSION: RIP: 0010:skb_release_data+0xb8/0x1e0 in vhost/tun

2024-03-26 Thread Jason Wang
On Tue, Mar 26, 2024 at 9:26 PM Jaroslav Pulchart wrote: > > > > > On Mon, Mar 25, 2024 at 4:44 PM Igor Raits wrote: > > > > > > Hello, > > > > > > On Fri, Mar 22, 2024 at 12:19 PM Igor Raits wrote: > > > > > > > > Hi Jason, > > > > > > > > On Fri, Mar 22, 2024 at 9:39 AM Igor Raits wrote: > >

Re: REGRESSION: RIP: 0010:skb_release_data+0xb8/0x1e0 in vhost/tun

2024-03-26 Thread Jaroslav Pulchart
> > On Mon, Mar 25, 2024 at 4:44 PM Igor Raits wrote: > > > > Hello, > > > > On Fri, Mar 22, 2024 at 12:19 PM Igor Raits wrote: > > > > > > Hi Jason, > > > > > > On Fri, Mar 22, 2024 at 9:39 AM Igor Raits wrote: > > > > > > > > Hi Jason, > > > > > > > > On Fri, Mar 22, 2024 at 6:31 AM Jason Wang

Re: REGRESSION: RIP: 0010:skb_release_data+0xb8/0x1e0 in vhost/tun

2024-03-25 Thread Jason Wang
On Mon, Mar 25, 2024 at 4:44 PM Igor Raits wrote: > > Hello, > > On Fri, Mar 22, 2024 at 12:19 PM Igor Raits wrote: > > > > Hi Jason, > > > > On Fri, Mar 22, 2024 at 9:39 AM Igor Raits wrote: > > > > > > Hi Jason, > > > > > > On Fri, Mar 22, 2024 at 6:31 AM Jason Wang wrote: > > > > > > > > On

Re: REGRESSION: RIP: 0010:skb_release_data+0xb8/0x1e0 in vhost/tun

2024-03-25 Thread Igor Raits
Hello, On Fri, Mar 22, 2024 at 12:19 PM Igor Raits wrote: > > Hi Jason, > > On Fri, Mar 22, 2024 at 9:39 AM Igor Raits wrote: > > > > Hi Jason, > > > > On Fri, Mar 22, 2024 at 6:31 AM Jason Wang wrote: > > > > > > On Thu, Mar 21, 2024 at 5:44 PM Igor Raits wrote: > > > > > > > > Hello Jason &

Re: REGRESSION: RIP: 0010:skb_release_data+0xb8/0x1e0 in vhost/tun

2024-03-22 Thread Stefano Garzarella
On Fri, Mar 22, 2024 at 12:20 PM Igor Raits wrote: > > Hi Jason, > > On Fri, Mar 22, 2024 at 9:39 AM Igor Raits wrote: > > > > Hi Jason, > > > > On Fri, Mar 22, 2024 at 6:31 AM Jason Wang wrote: > > > > > > On Thu, Mar 21, 2024 at 5:44 PM Igor Raits wrote: > > > > > > > > Hello Jason & others,

Re: REGRESSION: RIP: 0010:skb_release_data+0xb8/0x1e0 in vhost/tun

2024-03-22 Thread Igor Raits
Hi Jason, On Fri, Mar 22, 2024 at 9:39 AM Igor Raits wrote: > > Hi Jason, > > On Fri, Mar 22, 2024 at 6:31 AM Jason Wang wrote: > > > > On Thu, Mar 21, 2024 at 5:44 PM Igor Raits wrote: > > > > > > Hello Jason & others, > > > > > > On Wed, Mar 20, 2024 at 10:33 AM Jason Wang wrote: > > > > > >

Re: REGRESSION: RIP: 0010:skb_release_data+0xb8/0x1e0 in vhost/tun

2024-03-22 Thread Igor Raits
Hi Jason, On Fri, Mar 22, 2024 at 6:31 AM Jason Wang wrote: > > On Thu, Mar 21, 2024 at 5:44 PM Igor Raits wrote: > > > > Hello Jason & others, > > > > On Wed, Mar 20, 2024 at 10:33 AM Jason Wang wrote: > > > > > > On Tue, Mar 19, 2024 at 9:15 PM Igor Raits wrote: > > > > > > > > Hello Stefan,

Re: REGRESSION: RIP: 0010:skb_release_data+0xb8/0x1e0 in vhost/tun

2024-03-21 Thread Jason Wang
On Thu, Mar 21, 2024 at 5:44 PM Igor Raits wrote: > > Hello Jason & others, > > On Wed, Mar 20, 2024 at 10:33 AM Jason Wang wrote: > > > > On Tue, Mar 19, 2024 at 9:15 PM Igor Raits wrote: > > > > > > Hello Stefan, > > > > > > On Tue, Mar 19, 2024 at 2:12 PM Stefan Hajnoczi > > > wrote: > > >

Re: REGRESSION: RIP: 0010:skb_release_data+0xb8/0x1e0 in vhost/tun

2024-03-21 Thread Igor Raits
Hello Jason & others, On Wed, Mar 20, 2024 at 10:33 AM Jason Wang wrote: > > On Tue, Mar 19, 2024 at 9:15 PM Igor Raits wrote: > > > > Hello Stefan, > > > > On Tue, Mar 19, 2024 at 2:12 PM Stefan Hajnoczi wrote: > > > > > > On Tue, Mar 19, 2024 at 10:00:08AM +0100, Igor Raits wrote: > > > > Hel

Re: REGRESSION: RIP: 0010:skb_release_data+0xb8/0x1e0 in vhost/tun

2024-03-20 Thread Jason Wang
On Tue, Mar 19, 2024 at 9:15 PM Igor Raits wrote: > > Hello Stefan, > > On Tue, Mar 19, 2024 at 2:12 PM Stefan Hajnoczi wrote: > > > > On Tue, Mar 19, 2024 at 10:00:08AM +0100, Igor Raits wrote: > > > Hello, > > > > > > We have started to observe kernel crashes on 6.7.y kernels (atm we > > > have

Re: REGRESSION: RIP: 0010:skb_release_data+0xb8/0x1e0 in vhost/tun

2024-03-19 Thread Igor Raits
On Tue, Mar 19, 2024 at 2:41 PM Willem de Bruijn wrote: > > Igor Raits wrote: > > Hello Willem, > > > > On Tue, Mar 19, 2024 at 2:08 PM Willem de Bruijn > > wrote: > > > > > > Igor Raits wrote: > > > > Hello, > > > > > > > > We have started to observe kernel crashes on 6.7.y kernels (atm we > > >

Re: REGRESSION: RIP: 0010:skb_release_data+0xb8/0x1e0 in vhost/tun

2024-03-19 Thread Willem de Bruijn
Igor Raits wrote: > Hello Willem, > > On Tue, Mar 19, 2024 at 2:08 PM Willem de Bruijn > wrote: > > > > Igor Raits wrote: > > > Hello, > > > > > > We have started to observe kernel crashes on 6.7.y kernels (atm we > > > have hit the issue 5 times on 6.7.5 and 6.7.10). On 6.6.9 where we > > > have

Re: REGRESSION: RIP: 0010:skb_release_data+0xb8/0x1e0 in vhost/tun

2024-03-19 Thread Igor Raits
Hello Willem, On Tue, Mar 19, 2024 at 2:08 PM Willem de Bruijn wrote: > > Igor Raits wrote: > > Hello, > > > > We have started to observe kernel crashes on 6.7.y kernels (atm we > > have hit the issue 5 times on 6.7.5 and 6.7.10). On 6.6.9 where we > > have nodes of cluster it looks stable. Pleas

Re: REGRESSION: RIP: 0010:skb_release_data+0xb8/0x1e0 in vhost/tun

2024-03-19 Thread Stefan Hajnoczi
On Tue, Mar 19, 2024 at 10:00:08AM +0100, Igor Raits wrote: > Hello, > > We have started to observe kernel crashes on 6.7.y kernels (atm we > have hit the issue 5 times on 6.7.5 and 6.7.10). On 6.6.9 where we > have nodes of cluster it looks stable. Please see stacktrace below. If > you need more

Re: REGRESSION: RIP: 0010:skb_release_data+0xb8/0x1e0 in vhost/tun

2024-03-19 Thread Willem de Bruijn
Igor Raits wrote: > Hello, > > We have started to observe kernel crashes on 6.7.y kernels (atm we > have hit the issue 5 times on 6.7.5 and 6.7.10). On 6.6.9 where we > have nodes of cluster it looks stable. Please see stacktrace below. If > you need more information please let me know. > > We do

Re: REGRESSION: RIP: 0010:skb_release_data+0xb8/0x1e0 in vhost/tun

2024-03-19 Thread Igor Raits
Hello again, On Tue, Mar 19, 2024 at 10:00 AM Igor Raits wrote: > > Hello, > > We have started to observe kernel crashes on 6.7.y kernels (atm we > have hit the issue 5 times on 6.7.5 and 6.7.10). On 6.6.9 where we > have nodes of cluster it looks stable. Please see stacktrace below. If > you nee

REGRESSION: RIP: 0010:skb_release_data+0xb8/0x1e0 in vhost/tun

2024-03-19 Thread Igor Raits
Hello, We have started to observe kernel crashes on 6.7.y kernels (atm we have hit the issue 5 times on 6.7.5 and 6.7.10). On 6.6.9 where we have nodes of cluster it looks stable. Please see stacktrace below. If you need more information please let me know. We do not have a consistent reproducer