Hi All,
After successful deployment of OVS (2.4) -DPDK (2.0) on HP GEN 7 blade ,
I tried to activate it also on HP GEN9 (BL460C), got DMA error ("PTE Read
access is not set" , see attached file).
I found several discussions describing similar scenarios (for HP GEN8),
http://permalink.gmane.org/gmane.comp.networking.dpdk.devel/22140
http://comments.gmane.org/gmane.comp.networking.dpdk.devel/2281
But couldn't find any solution/work around , you can find below compute
details.
Your help is highly appreciated.
Kind regards
Yossi
Compute details :
Compute HW :
HP C7K , BL460c-G9
Bios configuration (See attached file):
Virtaulization Technology = Enabled
Intel(R0 VT-d = Enable
SRIOV = tried it with both Enable and Disable , no success
Kernel version :
[root at compute-0-1 ~]# uname -a
Linux compute-0-1.local 3.10.0-327.10.1.el7.x86_64 #1 SMP Sat Jan 23 04:54:55
EST 2016 x86_64 x86_64 x86_64 GNU/Linux
Kernel config :
[root at compute-0-1 ~]# cat /proc/cmdline
BOOT_IMAGE=/boot/vmlinuz-3.10.0-327.10.1.el7.x86_64
root=UUID=c79b653b-d2bf-4f76-9ed1-f8445cd6acec ro vconsole.keymap=us
vconsole.font=latarcyrheb-sun16 rhgb quiet LANG=en_US.UTF-8 crashkernel=auto
vga=normal nomodeset 3 selinux=0 default_hugepagesz=1G hugepagesz=1G
hugepages=87 iommu=pt intel_iommu=on
[root at compute-0-1 ~]#
Adding port to OVS as dpdk port :
modprobe uio_pci_generic
dpdk_nic_bind.py --bind=uio_pci_generic 0000:08:00.0
ovs-vsctl add-port ..........
DMA error (see also attached file) :
[root at compute-0-1 ~]# dmesg | grep dma
[ 0.053730] dmar: Host address width 46
[ 0.053731] dmar: DRHD base: 0x000000fbffc000 flags: 0x0
[ 0.053737] dmar: IOMMU 0: reg_base_addr fbffc000 ver 1:0 cap d2078c106f0466
ecap f020df
[ 0.053738] dmar: DRHD base: 0x000000c7ffc000 flags: 0x1
[ 0.053741] dmar: IOMMU 1: reg_base_addr c7ffc000 ver 1:0 cap d2078c106f0466
ecap f020df
[ 0.053742] dmar: RMRR base: 0x00000079171000 end: 0x00000079173fff
[ 0.053744] dmar: RMRR base: 0x000000791ed000 end: 0x000000791f0fff
[ 0.053744] dmar: RMRR base: 0x000000791dd000 end: 0x000000791ecfff
[ 0.053745] dmar: RMRR base: 0x000000791ca000 end: 0x000000791dafff
[ 0.053746] dmar: RMRR base: 0x000000791db000 end: 0x000000791dcfff
[ 0.053750] dmar: RMRR base: 0x0000005ac9d000 end: 0x0000005acdcfff
[ 1.020336] pnp 00:01: [dma 4]
[ 3.755796] ioatdma: Intel(R) QuickData Technology Driver 4.00
[ 3.756468] ioatdma 0000:00:04.0: irq 302 for MSI/MSI-X
[ 3.757199] ioatdma 0000:00:04.1: irq 304 for MSI/MSI-X
[ 3.757597] ioatdma 0000:00:04.2: irq 305 for MSI/MSI-X
[ 3.758044] ioatdma 0000:00:04.3: irq 306 for MSI/MSI-X
[ 3.758352] ioatdma 0000:00:04.4: irq 307 for MSI/MSI-X
[ 3.758669] ioatdma 0000:00:04.5: irq 308 for MSI/MSI-X
[ 3.758978] ioatdma 0000:00:04.6: irq 309 for MSI/MSI-X
[ 3.759292] ioatdma 0000:00:04.7: irq 310 for MSI/MSI-X
[ 3.759600] ioatdma 0000:80:04.0: irq 312 for MSI/MSI-X
[ 3.759849] ioatdma 0000:80:04.1: irq 314 for MSI/MSI-X
[ 3.760093] ioatdma 0000:80:04.2: irq 316 for MSI/MSI-X
[ 3.760356] ioatdma 0000:80:04.3: irq 318 for MSI/MSI-X
[ 3.760599] ioatdma 0000:80:04.4: irq 319 for MSI/MSI-X
[ 3.760828] ioatdma 0000:80:04.5: irq 320 for MSI/MSI-X
[ 3.761189] ioatdma 0000:80:04.6: irq 321 for MSI/MSI-X
[ 3.761407] ioatdma 0000:80:04.7: irq 322 for MSI/MSI-X
[ 8.554411] RPC: Registered rdma transport module.
[ 222.278558] dmar: DRHD: handling fault status reg 2
[ 222.278627] dmar: DMAR:[DMA Read] Request device [08:00.0] fault addr
52633d000
[ 224.168760] dmar: DRHD: handling fault status reg 102
[ 224.169003] dmar: DMAR:[DMA Read] Request device [08:00.0] fault addr
52633d000
[ 225.164728] dmar: DRHD: handling fault status reg 202
[ 225.164978] dmar: DMAR:[DMA Read] Request device [08:00.0] fault addr
52633d000
[ 225.200170] dmar: DRHD: handling fault status reg 302
[ 225.200398] dmar: DMAR:[DMA Read] Request device [08:00.0] fault addr
52633d000
[ 226.172331] dmar: DRHD: handling fault status reg 402
[ 226.172569] dmar: DMAR:[DMA Read] Request device [08:00.0] fault addr
52633d000
[ 227.199846] dmar: DRHD: handling fault status reg 502
[ 227.200088] dmar: DMAR:[DMA Read] Request device [08:00.0] fault addr
52633d000
[root at compute-0-1 ~]# Connection to compute-0-1 closed by remote host.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: dpdk_dma_error.PNG
Type: image/png
Size: 89975 bytes
Desc: dpdk_dma_error.PNG
URL:
<http://dpdk.org/ml/archives/dev/attachments/20160524/b7550454/attachment-0002.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: dpdk_hp_bios.PNG
Type: image/png
Size: 60513 bytes
Desc: dpdk_hp_bios.PNG
URL:
<http://dpdk.org/ml/archives/dev/attachments/20160524/b7550454/attachment-0003.png>
