Hi all,
I'm using qpid transferring large messages, the message size is more than
120MB, it will cost over 250ms.
My IB is Mellanox ConnectX-3 56Gbps FDR HCA card, when I use qperf -m 120m
serverip??it said:
[root@node2 qpid-benchmark]# qperf -m 120m 192.168.1.1 tcp_lat
tcp_lat:
latency = 58.8 ms
[root@node2 qpid-benchmark]# qperf -m 120m 192.168.1.1 tcp_bw
tcp_bw:
bw = 2.82 GB/sec
[root@node2 qpid-benchmark]# qperf -m 120m 192.168.1.1 rc_lat
rc_lat:
latency = 20.6 ms
[root@node2 qpid-benchmark]# qperf -m 120m 192.168.1.1 rc_bw
rc_bw:
bw = 5.82 GB/sec
[root@node2 qpid-benchmark]#
I'm using qpid-0.22, and use the following cmds:
qpid-send -b 'amqp:rdma:192.168.1.1' -a 'benchmark-0;{create:always}'
--report-total --report-header=no --timestamp=yes --sequence=no --durable False
--connection-options '{tcp-nodelay:true,reconnect:true,heartbeat:1}' --messages
0 --content-size 120240000 --send-rate 1
qpid-receive -b 'amqp:rdma:192.168.1.1' -a 'benchmark-0;{create:always}'
--print-content no -f --report-every 3 --receive-rate 2
Is there any tuning methods to improve the latency performance on RDMA env?
Regards,
An Yang