Oops looks like I forgot to reply to the chain when I sent my previous email - 
sent it directly to Ole instead!!  Going to have to get used to this mailing 
board thing!

Thank you very much Ole for your suggestion - really appreciate you taking the 
time out of your day to reply!  For posterities sake, I'll break down my issue 
for all to see :)

Initially, I set those routes purely as a hail mary because nothing was working 
- couldn't even ping devices on the same network (or myself for that matter!).  
Turns out it was an issue with my obscure setup as follows:
I had the Mellanox CX-4 setup with multiple SR-IOV VFs on a Proxmox host and 
passed through one of these VFs into a VPP VM.  The "issue" with that is that 
the MAC Address of the VF is obviously not the same as the MAC of the host 
device - however, the RDMA driver doesn't know this.  It grabs the HW MAC 
Address of the device it's been attached to, thus any frames sent will be sent 
with the host's MAC Address, and any being sent back will not be received by 
the VF.  The documentation is a little vague for the RDMA driver anyway, but 
this was hinted at in the latest docs - I'll attempt to make a pull request and 
update it to be a bit more straightforward.

Here's the solve for anyone experiencing the same issue :

1) Set the desired interface state to up on the host machine (e.g. sudo 
ifconfig <interface> up) and run ifconfig - noting the MAC Address listed next 
to "ether"
2) Create your RDMA interface in VPP as you would normally
3) Apply the MAC address to your RDMA interface with "(sudo) (vppctl) set int 
mac address <rdma-int> <mac-address>" where brackets denote optional commands 
(e.g. might not need sudo, might already be in the VPP shell)
4) Continue as you would normally

Thanks again to Ole for his suggestion on this matter - looking forward to 
being an active participant in this community in the future!

All the very best,

Jacob
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#21011): https://lists.fd.io/g/vpp-dev/message/21011
Mute This Topic: https://lists.fd.io/mt/89727903/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Reply via email to