Re: Issue: Networking performance in Xen VM on Arm64

2022-11-18 Thread Stefano Stabellini
Hi Leo, Thank you for the fantastic work with so many good details. Apologies for the late reply -- I have been traveling and on holiday. On Fri, 28 Oct 2022, Leo Yan wrote: > Hi Stefano, > > On Tue, Oct 25, 2022 at 04:58:16PM -0700, Stefano Stabellini wrote: > > On Mon, 24 Oct 2022, Leo Yan wr

Re: Issue: Networking performance in Xen VM on Arm64

2022-10-28 Thread Leo Yan
On Fri, Oct 28, 2022 at 05:54:05PM +0800, Leo Yan wrote: [...] > If map to the code, I think the function xennet_start_xmit() in Xen > frontend driver is critical for the sending interval in domU. I can > see several things cost time when sending a packet: > > - Xen frontend driver needs to set

Re: Issue: Networking performance in Xen VM on Arm64

2022-10-28 Thread Leo Yan
Hi Stefano, On Tue, Oct 25, 2022 at 04:58:16PM -0700, Stefano Stabellini wrote: > On Mon, 24 Oct 2022, Leo Yan wrote: > > > If you are really running with the NULL scheduler, then I would > > > investigate why the vCPU has is_running == 0 because it should not > > > happen. > > > > Correct for th

Re: Issue: Networking performance in Xen VM on Arm64

2022-10-25 Thread Stefano Stabellini
On Mon, 24 Oct 2022, Leo Yan wrote: > > If you are really running with the NULL scheduler, then I would > > investigate why the vCPU has is_running == 0 because it should not > > happen. > > Correct for this: it's my bad that I didn't really enable NULL scheduler > in my code base. After I enable

Re: Issue: Networking performance in Xen VM on Arm64

2022-10-24 Thread Leo Yan
On Fri, Oct 21, 2022 at 02:14:04PM -0700, Stefano Stabellini wrote: [...] > > > # domU side > > > xen/arch/arm/vgic-v2.c:vgic_v2_to_sgi > > > xen/arch/arm/vgic.c:vgic_to_sgi > > > xen/arch/arm/vgic.c:vgic_inject_irq > > > xen/arch/arm/vgic.c:vcpu_kick > > > xen/arch/arm/gic-v2.c:gicv2_send_SGI >

Re: Issue: Networking performance in Xen VM on Arm64

2022-10-21 Thread Stefano Stabellini
On Fri, 21 Oct 2022, Leo Yan wrote: > Hi Stefano and all, > > On Mon, Oct 17, 2022 at 04:50:05PM -0700, Stefano Stabellini wrote: > > [...] > > > > We can see DomU sends notification with timestamp (raw counter) is > > > 4989078592 and Dom0 receives the interrupt with timestamp 4989092169. > > >

Re: Issue: Networking performance in Xen VM on Arm64

2022-10-21 Thread Leo Yan
Hi Stefano and all, On Mon, Oct 17, 2022 at 04:50:05PM -0700, Stefano Stabellini wrote: [...] > > We can see DomU sends notification with timestamp (raw counter) is > > 4989078592 and Dom0 receives the interrupt with timestamp 4989092169. > > Since Dom0 and DomU use the same time counter and the

Re: Issue: Networking performance in Xen VM on Arm64

2022-10-20 Thread Julien Grall
Hi Stefano, On 18/10/2022 20:54, Stefano Stabellini wrote: On Tue, 18 Oct 2022, Leo Yan wrote: On Mon, Oct 17, 2022 at 04:50:05PM -0700, Stefano Stabellini wrote: [...] Which means it takes 543us to let Dom0 to receive the notification. You could see DomU runs in CPU3 and Dom0 runs on CPU13,

Re: Issue: Networking performance in Xen VM on Arm64

2022-10-18 Thread Stefano Stabellini
On Tue, 18 Oct 2022, Leo Yan wrote: > On Mon, Oct 17, 2022 at 04:50:05PM -0700, Stefano Stabellini wrote: > > [...] > > > > Which means it takes 543us to let Dom0 to receive the notification. > > > You could see DomU runs in CPU3 and Dom0 runs on CPU13, there should > > > not have contention for

Re: Issue: Networking performance in Xen VM on Arm64

2022-10-18 Thread Leo Yan
On Mon, Oct 17, 2022 at 04:50:05PM -0700, Stefano Stabellini wrote: [...] > > Which means it takes 543us to let Dom0 to receive the notification. > > You could see DomU runs in CPU3 and Dom0 runs on CPU13, there should > > not have contention for CPU resources. Seems to me, it's likely Xen > > h

Re: Issue: Networking performance in Xen VM on Arm64

2022-10-17 Thread Stefano Stabellini
On Mon, 17 Oct 2022, Leo Yan wrote: > Hi Stefano, > > Sorry for late response. Please see below comments. > > On Tue, Oct 11, 2022 at 02:47:00PM -0700, Stefano Stabellini wrote: > > On Tue, 11 Oct 2022, Leo Yan wrote: > > > > > The second question is how to mitigate the long latency when send da

Re: Issue: Networking performance in Xen VM on Arm64

2022-10-17 Thread Leo Yan
Hi Stefano, Sorry for late response. Please see below comments. On Tue, Oct 11, 2022 at 02:47:00PM -0700, Stefano Stabellini wrote: > On Tue, 11 Oct 2022, Leo Yan wrote: > > > > The second question is how to mitigate the long latency when send data > > > > from DomU. A possible solution is the

Re: Issue: Networking performance in Xen VM on Arm64

2022-10-11 Thread Stefano Stabellini
On Tue, 11 Oct 2022, Leo Yan wrote: > > > The second question is how to mitigate the long latency when send data > > > from DomU. A possible solution is the Xen network forend driver copies > > > skb into mediate (bounce) buffer, just like what does in Xen net > > > backend driver with gnttab_batc

Re: Issue: Networking performance in Xen VM on Arm64

2022-10-11 Thread Leo Yan
Hi Stefano, On Mon, Oct 10, 2022 at 04:50:46PM -0700, Stefano Stabellini wrote: > +Xen/Linux maintainers Thanks for reviewing. [...] > > Throughput result: > > > > Profile netperf (Mbits/sec)ddsperf (Mbits/sec) > > Xen-Dom0939.41 > 620 > > Xen-DomU

Re: Issue: Networking performance in Xen VM on Arm64

2022-10-10 Thread Stefano Stabellini
+Xen/Linux maintainers On Mon, 10 Oct 2022, Leo Yan wrote: > Hi there, > > I tested the networking performance on my Arm64 platform in Xen > virtual machine, below I will try to give out summary for testing > result and share some analysis, at the end I want to check a bit > from the community a

Issue: Networking performance in Xen VM on Arm64

2022-10-10 Thread Leo Yan
Hi there, I tested the networking performance on my Arm64 platform in Xen virtual machine, below I will try to give out summary for testing result and share some analysis, at the end I want to check a bit from the community and get suggestion before I can proceed. First of all, if you want to kno