Re: swaping ring slots between NIC ring and Host ring does not always success

2017-11-29 Thread Xiaoye Sun
On Mon, Nov 27, 2017 at 2:33 AM, Vincenzo Maffione wrote: > Hi, > > If you think it's a bug can you please open an issue on the github ( > https://github.com/luigirizzo/netmap/issues)? > > 2017-11-24 22:11 GMT+01:00 Xiaoye Sun : > >> Hi Vincenzo, >> >&g

Re: swaping ring slots between NIC ring and Host ring does not always success

2017-11-24 Thread Xiaoye Sun
. So think the root of the problem is that the buffer pointer is not always successfully/timely updated even after the NS_BUF_CHANGED flag is set and the buf_idx is updated. Best, Xiaoye On Wed, Nov 22, 2017 at 7:39 AM, Vincenzo Maffione wrote: > Hi, > > 2017-11-21 7:51 GMT+01:00 Xiaoye

Re: swaping ring slots between NIC ring and Host ring does not always success

2017-11-24 Thread Xiaoye Sun
wrote: > Hi, > > 2017-11-21 7:51 GMT+01:00 Xiaoye Sun : > >> Hi, >> >> Recently I found another problem with netmap. I think this new problem >> could be related to the problems in this threads so I just post the new >> problem here. >> >> In my

Re: swaping ring slots between NIC ring and Host ring does not always success

2017-11-20 Thread Xiaoye Sun
of the netmap module to a specific core. or is there a way to know the root of such problem? Best, Xiaoye On Wed, Feb 10, 2016 at 10:18 AM, Xiaoye Sun wrote: > Hi Luigi, > > Thanks Luigi! > Pinning the process to one CPU core solves the reorder problem!!! > Let me check if the

Re: [netmap] when does a packet in the netmap ring send out exactly

2017-11-20 Thread Xiaoye Sun
t; > On Mon, Nov 20, 2017 at 3:35 PM, Xiaoye Sun wrote: > > Hi, > > > > I found that the tail pointer only moves when the ring has less than half > > of the slots available. This prevents me from knowing the accurate time > > when the packet in a slot is processed. Is

Re: [netmap] when does a packet in the netmap ring send out exactly

2017-11-20 Thread Xiaoye Sun
Note > that also the slot pointed by tail has been completed. > > But you are right that there is no way to receive completion notification > if the queue is not full. You must use TXSYNC to check (by sleeping or busy > wait) when tail moves forward. > > Cheers, > Vincenz

[netmap] when does a packet in the netmap ring send out exactly

2017-10-26 Thread Xiaoye Sun
Hi I write a netmap program that sends packets to the network. my program uses one netmap ring and fills the ring slots with packets. My program needs to do something (action A) after a particular packet (packet P) in the ring slot is sent to the network. so the program tracks the position of the

Re: High priority for the tx queue in netmap

2017-01-24 Thread Xiaoye Sun
I'm using the typical intel 10 Gbps nic. Does ethtool have related configuration command? On Tue, Jan 24, 2017 at 12:57 AM Sepherosa Ziehau wrote: > On Tue, Jan 24, 2017 at 4:09 AM, Xiaoye Sun wrote: > > > Hi, > > > > > > In my application, there are mu

High priority for the tx queue in netmap

2017-01-23 Thread Xiaoye Sun
Hi, In my application, there are multiple tx queues in the OS, and the netmap program uses one tx queue. I wondering if I can give the netmap tx queue higher priority so that the NIC always sends the packets from this queue if netmap put any packet to it. I am using Linux 3.16. Thanks! Best, Xi

Way to let the host/nic ignore the NIC queue attached to netmap

2017-01-03 Thread Xiaoye Sun
Hi, In my application, I take one pair of NIC queue (both tx and rx) for sending and receiving packets in the netmap userspace program to process a specific type of packets. There are also other packets from/to the host. In such case, It seems that I need to open the host queue in my netmap appli

Re: Can netmap be more efficient when it just does bridging between NIC and Linux kernal?

2016-12-09 Thread Xiaoye Sun
packets may want to go to the TX nic queues that have been given to netmap (I guess). I am wondering is there a way to work around this issue. Best, Xiaoye On Thu, Dec 8, 2016 at 5:39 AM, Vincenzo Maffione wrote: > Hi, > > 2016-12-07 2:36 GMT+01:00 Xiaoye Sun : > >> Hi, >>

Can netmap be more efficient when it just does bridging between NIC and Linux kernal?

2016-12-06 Thread Xiaoye Sun
Hi, I am wondering if there a way to reduce the CPU usage of a netmap program similar to the bridge.c example. In my use case, I have a distributed application/framework (e.g. Spark or Hadoop) running on a cluster of machines (each of the machines runs Linux and has an Intel 10Gbps NIC). The appl

Re: swaping ring slots between NIC ring and Host ring does not always success

2016-02-10 Thread Xiaoye Sun
Hi Luigi, Thanks Luigi! Pinning the process to one CPU core solves the reorder problem!!! Let me check if the duplicated packet problem is solved also. Thanks! Best, Xiaoye On Wed, Feb 10, 2016 at 7:21 AM, Luigi Rizzo wrote: > On Tue, Feb 9, 2016 at 1:12 PM, Xiaoye Sun wrote: > >

Re: swaping ring slots between NIC ring and Host ring does not always success

2016-02-09 Thread Xiaoye Sun
Hi Luigi, Have you seen the previous email. any comments? On Fri, Feb 5, 2016 at 3:29 PM, Xiaoye Sun wrote: > Hi Victor, > Thanks for the help. The command you provided worked perfectly for me. > > Hi Luigi, > > Thanks for your clarification. > > The experiment I did wa

Re: swaping ring slots between NIC ring and Host ring does not always success

2016-02-05 Thread Xiaoye Sun
host stack. What is your opinion? Thanks! Xiaoye On Thu, Feb 4, 2016 at 6:26 PM, Victor Detoni wrote: > I'm sorry, I made mistake. To workaround this try `ip link set $IFACE > promisc on` > > > > On Thu, Feb 4, 2016 at 10:04 PM, Xiaoye Sun wrote: > >> Yes. all the i

Re: swaping ring slots between NIC ring and Host ring does not always success

2016-02-04 Thread Xiaoye Sun
de fevereiro de 2016, Xiaoye Sun > escreveu: > >> Hi Luigi, >> >> Thanks for your explanation. >> >> I used three machines to do this experiment. They are directly connected. >> >> [(machine1) eth1]---[eth2 (machine2) eth3]---[eth4 (machine3)]. >

Fwd: swaping ring slots between NIC ring and Host ring does not always success

2016-02-04 Thread Xiaoye Sun
ux kernel version is *3.16.0-4-amd64* Thanks! Xiaoye On Wed, Feb 3, 2016 at 2:12 AM, Luigi Rizzo wrote: > On Tue, Feb 2, 2016 at 10:48 PM, Xiaoye Sun wrote: > > > > > > On Mon, Feb 1, 2016 at 11:34 PM, Luigi Rizzo wrote: > >> > >> On Tue, Feb 2, 201

Re: swaping ring slots between NIC ring and Host ring does not always success

2016-02-02 Thread Xiaoye Sun
On Mon, Feb 1, 2016 at 11:34 PM, Luigi Rizzo wrote: > On Tue, Feb 2, 2016 at 6:23 AM, Xiaoye Sun wrote: > > Hi Luigi, > > > > I have to clarify about the *jumping issue* about the slot indexes. > > In the bridge.c program, the slot index never jumps and it increases &

Re: swaping ring slots between NIC ring and Host ring does not always success

2016-02-01 Thread Xiaoye Sun
eing later). > > I have no idea of the cause but typically this pattern > is what you see when there are multiple input rings and > not just one. > > Cheers > Luigi > > > > > On Tue, Feb 2, 2016 at 12:24 AM, Xiaoye Sun wrote: > > Hi Luigi, > > > >

Re: swaping ring slots between NIC ring and Host ring does not always success

2016-02-01 Thread Xiaoye Sun
ot). The reordered seq usually right before or after the poll function call. Best, Xiaoye On Fri, Jan 29, 2016 at 4:27 PM, Luigi Rizzo wrote: > On Fri, Jan 29, 2016 at 2:12 PM, Xiaoye Sun wrote: > > Hi Luigi, > > > > Thanks for your advice. > > I forgot to mention that

Re: swaping ring slots between NIC ring and Host ring does not always success

2016-01-29 Thread Xiaoye Sun
second tx ring and then the host/nic might drain either rings. But this is not the case in the experiment. Thanks a lot! Xiaoye On Fri, Jan 29, 2016 at 3:45 PM, Luigi Rizzo wrote: > On Fri, Jan 29, 2016 at 1:39 PM, Xiaoye Sun wrote: > > Hi Pavel, > > > > Our code is some

Re: swaping ring slots between NIC ring and Host ring does not always success

2016-01-29 Thread Xiaoye Sun
result in bogus content, certainly not the one before the swap. > I suspect some kind of race, possibly missing memory barriers. > > cheers > luigi > > > On Mon, Jan 25, 2016 at 3:55 PM, Xiaoye Sun wrote: > > Hi all, > > > > I wrote a netmap application that i

Re: swaping ring slots between NIC ring and Host ring does not always success

2016-01-29 Thread Xiaoye Sun
; So I could not help with your original question. Let's wait answer > from developers of awesome Netmap :) > > On Tue, Jan 26, 2016 at 2:55 AM, Xiaoye Sun wrote: > > Hi all, > > > > I wrote a netmap application that is very similar to bridge.c in > master/exampl

swaping ring slots between NIC ring and Host ring does not always success

2016-01-25 Thread Xiaoye Sun
Hi all, I wrote a netmap application that is very similar to bridge.c in master/example directory of the netmap code. The major difference between my program and bridge.c is that my application also creates custom packets that are directly put into the tx ring of the NIC (like a packet generator w

netmap nic to host stack forwarding

2015-02-02 Thread Xiaoye Sun
Hi, I am new to netmap. What I want to do with netmap is to implement file transfer protocol so that netmap can help achieve fast network IO. In the netmap client program, I want that the unrelated packets are forwarded to the linux host stack and all the packets from the host stack are forwarded

Adjust Ring Size

2014-07-28 Thread Xiaoye Sun
Hi all, I am new to netmap. I am current running netmap on Myricom 10G NIC and Linux machine. The problem in my case is that the maximum packet rate can achieve at the receiver is about 650kpp with 1514 frame length, about 8.3Gbps (1.7 from the 10Gbps line rate). if the sender sends faster than th