-----David Marchand <david.march...@redhat.com> wrote: ----- >To: Takeshi T Yoshimura <t...@jp.ibm.com> >From: David Marchand <david.march...@redhat.com> >Date: 08/01/2019 02:01PM >Cc: dev <dev@dpdk.org>, David Christensen <d...@linux.vnet.ibm.com> >Subject: [EXTERNAL] Re: [dpdk-dev] [PATCH] eal: forcing IOVA as PA in >ppc > >Hello, > >On Thu, Aug 1, 2019 at 6:10 AM Takeshi T Yoshimura <t...@jp.ibm.com> >wrote: >> Here's the full debug log I got. I ran upstream SPDK on NVMe on IBM >Power9 AC922. >> The operating system is Ubuntu 18.04 and Linux 4.17. >> >> Starting SPDK v19.07-pre / DPDK 19.08.0-rc3 initialization... >> [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 >--log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 >--log-level=lib.eal:8 --base-virtaddr=0x200000000000 >--match-allocations --file-prefix=spdk_pid139059 ] > >We are missing the initial logs here (eal log level is set twice, but >this should not be a problem). >Is it truncated by spdk ? Is there a way to get them ? > >Thanks. > >-- >David Marchand > >
Okay. I should have set the --log-level=lib.*:debug. Here is the log. Starting SPDK v19.10-pre / DPDK 19.08.0-rc3 initialization... [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --log-level=lib.*:debug --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid159692 ] EAL: Detected lcore 0 as core 0 on socket 0 EAL: Detected lcore 1 as core 0 on socket 0 EAL: Detected lcore 2 as core 0 on socket 0 EAL: Detected lcore 3 as core 0 on socket 0 EAL: Detected lcore 4 as core 4 on socket 0 EAL: Detected lcore 5 as core 4 on socket 0 EAL: Detected lcore 6 as core 4 on socket 0 EAL: Detected lcore 7 as core 4 on socket 0 EAL: Detected lcore 8 as core 8 on socket 0 EAL: Detected lcore 9 as core 8 on socket 0 EAL: Detected lcore 10 as core 8 on socket 0 EAL: Detected lcore 11 as core 8 on socket 0 EAL: Detected lcore 12 as core 12 on socket 0 EAL: Detected lcore 13 as core 12 on socket 0 EAL: Detected lcore 14 as core 12 on socket 0 EAL: Detected lcore 15 as core 12 on socket 0 EAL: Detected lcore 16 as core 24 on socket 0 EAL: Detected lcore 17 as core 24 on socket 0 EAL: Detected lcore 18 as core 24 on socket 0 EAL: Detected lcore 19 as core 24 on socket 0 EAL: Detected lcore 20 as core 28 on socket 0 EAL: Detected lcore 21 as core 28 on socket 0 EAL: Detected lcore 22 as core 28 on socket 0 EAL: Detected lcore 23 as core 28 on socket 0 EAL: Detected lcore 24 as core 32 on socket 0 EAL: Detected lcore 25 as core 32 on socket 0 EAL: Detected lcore 26 as core 32 on socket 0 EAL: Detected lcore 27 as core 32 on socket 0 EAL: Detected lcore 28 as core 36 on socket 0 EAL: Detected lcore 29 as core 36 on socket 0 EAL: Detected lcore 30 as core 36 on socket 0 EAL: Detected lcore 31 as core 36 on socket 0 EAL: Detected lcore 32 as core 48 on socket 0 EAL: Detected lcore 33 as core 48 on socket 0 EAL: Detected lcore 34 as core 48 on socket 0 EAL: Detected lcore 35 as core 48 on socket 0 EAL: Detected lcore 36 as core 52 on socket 0 EAL: Detected lcore 37 as core 52 on socket 0 EAL: Detected lcore 38 as core 52 on socket 0 EAL: Detected lcore 39 as core 52 on socket 0 EAL: Detected lcore 40 as core 56 on socket 0 EAL: Detected lcore 41 as core 56 on socket 0 EAL: Detected lcore 42 as core 56 on socket 0 EAL: Detected lcore 43 as core 56 on socket 0 EAL: Detected lcore 44 as core 60 on socket 0 EAL: Detected lcore 45 as core 60 on socket 0 EAL: Detected lcore 46 as core 60 on socket 0 EAL: Detected lcore 47 as core 60 on socket 0 EAL: Detected lcore 48 as core 64 on socket 0 EAL: Detected lcore 49 as core 64 on socket 0 EAL: Detected lcore 50 as core 64 on socket 0 EAL: Detected lcore 51 as core 64 on socket 0 EAL: Detected lcore 52 as core 68 on socket 0 EAL: Detected lcore 53 as core 68 on socket 0 EAL: Detected lcore 54 as core 68 on socket 0 EAL: Detected lcore 55 as core 68 on socket 0 EAL: Detected lcore 56 as core 72 on socket 0 EAL: Detected lcore 57 as core 72 on socket 0 EAL: Detected lcore 58 as core 72 on socket 0 EAL: Detected lcore 59 as core 72 on socket 0 EAL: Detected lcore 60 as core 76 on socket 0 EAL: Detected lcore 61 as core 76 on socket 0 EAL: Detected lcore 62 as core 76 on socket 0 EAL: Detected lcore 63 as core 76 on socket 0 EAL: Detected lcore 64 as core 80 on socket 0 EAL: Detected lcore 65 as core 80 on socket 0 EAL: Detected lcore 66 as core 80 on socket 0 EAL: Detected lcore 67 as core 80 on socket 0 EAL: Detected lcore 68 as core 84 on socket 0 EAL: Detected lcore 69 as core 84 on socket 0 EAL: Detected lcore 70 as core 84 on socket 0 EAL: Detected lcore 71 as core 84 on socket 0 EAL: Detected lcore 72 as core 88 on socket 0 EAL: Detected lcore 73 as core 88 on socket 0 EAL: Detected lcore 74 as core 88 on socket 0 EAL: Detected lcore 75 as core 88 on socket 0 EAL: Detected lcore 76 as core 92 on socket 0 EAL: Detected lcore 77 as core 92 on socket 0 EAL: Detected lcore 78 as core 92 on socket 0 EAL: Detected lcore 79 as core 92 on socket 0 EAL: Detected lcore 80 as core 2048 on socket 8 EAL: Detected lcore 81 as core 2048 on socket 8 EAL: Detected lcore 82 as core 2048 on socket 8 EAL: Detected lcore 83 as core 2048 on socket 8 EAL: Detected lcore 84 as core 2052 on socket 8 EAL: Detected lcore 85 as core 2052 on socket 8 EAL: Detected lcore 86 as core 2052 on socket 8 EAL: Detected lcore 87 as core 2052 on socket 8 EAL: Detected lcore 88 as core 2056 on socket 8 EAL: Detected lcore 89 as core 2056 on socket 8 EAL: Detected lcore 90 as core 2056 on socket 8 EAL: Detected lcore 91 as core 2056 on socket 8 EAL: Detected lcore 92 as core 2060 on socket 8 EAL: Detected lcore 93 as core 2060 on socket 8 EAL: Detected lcore 94 as core 2060 on socket 8 EAL: Detected lcore 95 as core 2060 on socket 8 EAL: Detected lcore 96 as core 2064 on socket 8 EAL: Detected lcore 97 as core 2064 on socket 8 EAL: Detected lcore 98 as core 2064 on socket 8 EAL: Detected lcore 99 as core 2064 on socket 8 EAL: Detected lcore 100 as core 2068 on socket 8 EAL: Detected lcore 101 as core 2068 on socket 8 EAL: Detected lcore 102 as core 2068 on socket 8 EAL: Detected lcore 103 as core 2068 on socket 8 EAL: Detected lcore 104 as core 2072 on socket 8 EAL: Detected lcore 105 as core 2072 on socket 8 EAL: Detected lcore 106 as core 2072 on socket 8 EAL: Detected lcore 107 as core 2072 on socket 8 EAL: Detected lcore 108 as core 2076 on socket 8 EAL: Detected lcore 109 as core 2076 on socket 8 EAL: Detected lcore 110 as core 2076 on socket 8 EAL: Detected lcore 111 as core 2076 on socket 8 EAL: Detected lcore 112 as core 2080 on socket 8 EAL: Detected lcore 113 as core 2080 on socket 8 EAL: Detected lcore 114 as core 2080 on socket 8 EAL: Detected lcore 115 as core 2080 on socket 8 EAL: Detected lcore 116 as core 2084 on socket 8 EAL: Detected lcore 117 as core 2084 on socket 8 EAL: Detected lcore 118 as core 2084 on socket 8 EAL: Detected lcore 119 as core 2084 on socket 8 EAL: Detected lcore 120 as core 2088 on socket 8 EAL: Detected lcore 121 as core 2088 on socket 8 EAL: Detected lcore 122 as core 2088 on socket 8 EAL: Detected lcore 123 as core 2088 on socket 8 EAL: Detected lcore 124 as core 2092 on socket 8 EAL: Detected lcore 125 as core 2092 on socket 8 EAL: Detected lcore 126 as core 2092 on socket 8 EAL: Detected lcore 127 as core 2092 on socket 8 EAL: Detected lcore 128 as core 2096 on socket 8 EAL: Detected lcore 129 as core 2096 on socket 8 EAL: Detected lcore 130 as core 2096 on socket 8 EAL: Detected lcore 131 as core 2096 on socket 8 EAL: Detected lcore 132 as core 2100 on socket 8 EAL: Detected lcore 133 as core 2100 on socket 8 EAL: Detected lcore 134 as core 2100 on socket 8 EAL: Detected lcore 135 as core 2100 on socket 8 EAL: Detected lcore 136 as core 2104 on socket 8 EAL: Detected lcore 137 as core 2104 on socket 8 EAL: Detected lcore 138 as core 2104 on socket 8 EAL: Detected lcore 139 as core 2104 on socket 8 EAL: Detected lcore 140 as core 2108 on socket 8 EAL: Detected lcore 141 as core 2108 on socket 8 EAL: Detected lcore 142 as core 2108 on socket 8 EAL: Detected lcore 143 as core 2108 on socket 8 EAL: Detected lcore 144 as core 2112 on socket 8 EAL: Detected lcore 145 as core 2112 on socket 8 EAL: Detected lcore 146 as core 2112 on socket 8 EAL: Detected lcore 147 as core 2112 on socket 8 EAL: Detected lcore 148 as core 2116 on socket 8 EAL: Detected lcore 149 as core 2116 on socket 8 EAL: Detected lcore 150 as core 2116 on socket 8 EAL: Detected lcore 151 as core 2116 on socket 8 EAL: Detected lcore 152 as core 2136 on socket 8 EAL: Detected lcore 153 as core 2136 on socket 8 EAL: Detected lcore 154 as core 2136 on socket 8 EAL: Detected lcore 155 as core 2136 on socket 8 EAL: Detected lcore 156 as core 2140 on socket 8 EAL: Detected lcore 157 as core 2140 on socket 8 EAL: Detected lcore 158 as core 2140 on socket 8 EAL: Detected lcore 159 as core 2140 on socket 8 EAL: Support maximum 1536 logical core(s) by configuration. EAL: Detected 160 lcore(s) EAL: Detected 2 NUMA nodes EAL: No shared files mode enabled, IPC will be disabled EAL: No shared files mode enabled, IPC is disabled EAL: VFIO PCI modules not loaded EAL: Bus pci wants IOVA as 'DC' EAL: Buses did not request a specific IOVA mode. EAL: IOMMU is available, selecting IOVA as VA mode. EAL: Module /sys/module/rte_kni not found! error 2 (No such file or directory) EAL: Selected IOVA mode 'VA' EAL: No available hugepages reported in hugepages-1048576kB EAL: Probing VFIO support... EAL: IOMMU type 1 (Type 1) is not supported EAL: IOMMU type 7 (sPAPR) is supported EAL: IOMMU type 8 (No-IOMMU) is not supported EAL: VFIO support initialized EAL: Ask a virtual area of 0x30000 bytes EAL: Virtual area found at 0x200000000000 (size = 0x30000) EAL: Setting up physically contiguous memory... EAL: Setting maximum number of open files to 1048576 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 EAL: Detected memory type: socket_id:8 hugepage_sz:2097152 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 EAL: Ask a virtual area of 0x70000 bytes EAL: Virtual area found at 0x200000030000 (size = 0x70000) EAL: Memseg list allocated: 0x800kB at socket 0 EAL: Ask a virtual area of 0x400000000 bytes EAL: Virtual area found at 0x200000200000 (size = 0x400000000) EAL: Ask a virtual area of 0x70000 bytes EAL: Virtual area found at 0x200400200000 (size = 0x70000) EAL: Memseg list allocated: 0x800kB at socket 0 EAL: Ask a virtual area of 0x400000000 bytes EAL: Virtual area found at 0x200400400000 (size = 0x400000000) EAL: Ask a virtual area of 0x70000 bytes EAL: Virtual area found at 0x200800400000 (size = 0x70000) EAL: Memseg list allocated: 0x800kB at socket 0 EAL: Ask a virtual area of 0x400000000 bytes EAL: Virtual area found at 0x200800600000 (size = 0x400000000) EAL: Ask a virtual area of 0x70000 bytes EAL: Virtual area found at 0x200c00600000 (size = 0x70000) EAL: Memseg list allocated: 0x800kB at socket 0 EAL: Ask a virtual area of 0x400000000 bytes EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) EAL: Creating 4 segment lists: n_segs:8192 socket_id:8 hugepage_sz:2097152 EAL: Ask a virtual area of 0x70000 bytes EAL: Virtual area found at 0x201000800000 (size = 0x70000) EAL: Memseg list allocated: 0x800kB at socket 8 EAL: Ask a virtual area of 0x400000000 bytes EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) EAL: Ask a virtual area of 0x70000 bytes EAL: Virtual area found at 0x201400a00000 (size = 0x70000) EAL: Memseg list allocated: 0x800kB at socket 8 EAL: Ask a virtual area of 0x400000000 bytes EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) EAL: Ask a virtual area of 0x70000 bytes EAL: Virtual area found at 0x201800c00000 (size = 0x70000) EAL: Memseg list allocated: 0x800kB at socket 8 EAL: Ask a virtual area of 0x400000000 bytes EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) EAL: Ask a virtual area of 0x70000 bytes EAL: Virtual area found at 0x201c00e00000 (size = 0x70000) EAL: Memseg list allocated: 0x800kB at socket 8 EAL: Ask a virtual area of 0x400000000 bytes EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) EAL: Hugepages will be freed exactly as allocated. EAL: No shared files mode enabled, IPC is disabled EAL: TSC frequency is ~510000 KHz EAL: Master lcore 0 is ready (tid=7430194644a0;cpuset=[0]) EAL: Trying to obtain current memory policy. EAL: Setting policy MPOL_PREFERRED for socket 0 EAL: Restoring previous memory policy: 0 EAL: request: mp_malloc_sync EAL: No shared files mode enabled, IPC is disabled EAL: Heap on socket 0 was expanded by 2MB EAL: No shared files mode enabled, IPC is disabled EAL: Mem event callback 'spdk:(nil)' registered EAL: PCI device 0000:01:00.0 on NUMA socket 0 EAL: probe driver: 144d:a822 spdk_nvme EAL: Expecting 'PA' IOVA mode but current mode is 'VA', not initializing EAL: Requested device 0000:01:00.0 cannot be used EAL: PCI device 0003:01:00.0 on NUMA socket 0 EAL: probe driver: 144d:a822 spdk_nvme EAL: Expecting 'PA' IOVA mode but current mode is 'VA', not initializing EAL: Requested device 0003:01:00.0 cannot be used EAL: PCI device 0030:01:00.0 on NUMA socket 8 EAL: probe driver: 144d:a822 spdk_nvme EAL: Expecting 'PA' IOVA mode but current mode is 'VA', not initializing EAL: Requested device 0030:01:00.0 cannot be used No NVMe controllers found.
