I think you've put your finger on it, Suravee! On 15/04/2021 10:28, Suthikulpanit, Suravee wrote:
David,On 4/14/2021 10:33 PM, David Coe wrote:Hi Suravee!I've re-run your revert+update patch on Ubuntu's latest kernel 5.11.0-14 partly to check my mailer's 'mangling' hadn't also reached the code!There are 3 sets of results in the attachment, all for the Ryzen 2400G. The as-distributed kernel already incorporates your IOMMU RFCv3 patch.A. As-distributed kernel (cold boot) >5 retries, so no IOMMU read/write capability, no amd_iommu events. B. As-distributed kernel (warm boot) <5 retries, amd_iommu running stats show large numbers as before. C. Revert+Update kernel amd_iommu events listed and also show large hit/miss numbers.In due course, I'll load the new (revert+update) kernel on the 4700G but won't overload your mail-box unless something unusual turns up.Best regards,For the Ryzen 2400G, could you please try with: - 1 event at a time - Not more than 8 events (On your system, it has 2 banks x 4 counters/bank.I am trying to see if this issue might be related to the counters multiplexing).Thanks,
Attached are the results you requested for the 2400G along with a tiny shell-script.
One event at a time and various batches of less than 8 events produce unexceptionable data. One final batch of 10 events and (hoopla) up go the counter stats.
Will you be doing something in mitigation or does this just go with the patch? Is there anything further you need from me? I'll run the script on the 4700U but I don't expect surprises :-).
All most appreciated, -- David
iommu_list.sh
Description: application/shellscript
$ sudo ./iommu_list.sh
Performance counter stats for 'system wide':
12 amd_iommu_0/cmd_processed/
10.001266851 seconds time elapsed
Performance counter stats for 'system wide':
11 amd_iommu_0/cmd_processed_inv/
10.001259049 seconds time elapsed
Performance counter stats for 'system wide':
0 amd_iommu_0/ign_rd_wr_mmio_1ff8h/
10.000791810 seconds time elapsed
Performance counter stats for 'system wide':
350 amd_iommu_0/int_dte_hit/
10.000848437 seconds time elapsed
Performance counter stats for 'system wide':
16 amd_iommu_0/int_dte_mis/
10.001271989 seconds time elapsed
Performance counter stats for 'system wide':
348 amd_iommu_0/mem_dte_hit/
10.000808074 seconds time elapsed
Performance counter stats for 'system wide':
211,925 amd_iommu_0/mem_dte_mis/
10.000915362 seconds time elapsed
Performance counter stats for 'system wide':
30 amd_iommu_0/mem_iommu_tlb_pde_hit/
10.001520597 seconds time elapsed
Performance counter stats for 'system wide':
450 amd_iommu_0/mem_iommu_tlb_pde_mis/
10.000877493 seconds time elapsed
Performance counter stats for 'system wide':
10,953 amd_iommu_0/mem_iommu_tlb_pte_hit/
10.000831802 seconds time elapsed
Performance counter stats for 'system wide':
13,235 amd_iommu_0/mem_iommu_tlb_pte_mis/
10.001292003 seconds time elapsed
Performance counter stats for 'system wide':
0 amd_iommu_0/mem_pass_excl/
10.000836000 seconds time elapsed
Performance counter stats for 'system wide':
0 amd_iommu_0/mem_pass_pretrans/
10.000799887 seconds time elapsed
Performance counter stats for 'system wide':
12,283 amd_iommu_0/mem_pass_untrans/
10.000815339 seconds time elapsed
Performance counter stats for 'system wide':
0 amd_iommu_0/mem_target_abort/
10.001205168 seconds time elapsed
Performance counter stats for 'system wide':
1,333 amd_iommu_0/mem_trans_total/
10.000915359 seconds time elapsed
Performance counter stats for 'system wide':
0 amd_iommu_0/page_tbl_read_gst/
10.001248235 seconds time elapsed
Performance counter stats for 'system wide':
65 amd_iommu_0/page_tbl_read_nst/
10.001266411 seconds time elapsed
Performance counter stats for 'system wide':
78 amd_iommu_0/page_tbl_read_tot/
10.001272406 seconds time elapsed
Performance counter stats for 'system wide':
0 amd_iommu_0/smi_blk/
10.001282912 seconds time elapsed
Performance counter stats for 'system wide':
0 amd_iommu_0/smi_recv/
10.001223193 seconds time elapsed
Performance counter stats for 'system wide':
0 amd_iommu_0/tlb_inv/
10.001234853 seconds time elapsed
Performance counter stats for 'system wide':
0 amd_iommu_0/vapic_int_guest/
10.000848081 seconds time elapsed
Performance counter stats for 'system wide':
428 amd_iommu_0/vapic_int_non_guest/
10.000806041 seconds time elapsed
$ sudo perf stat -e 'amd_iommu_0/cmd_processed/,
amd_iommu_0/cmd_processed_inv/, amd_iommu_0/ign_rd_wr_mmio_1ff8h/,
amd_iommu_0/int_dte_hit/, amd_iommu_0/int_dte_mis/, amd_iommu_0/mem_dte_hit/,
amd_iommu_0/mem_dte_mis/' sleep 10
Performance counter stats for 'system wide':
16 amd_iommu_0/cmd_processed/
8 amd_iommu_0/cmd_processed_inv/
0 amd_iommu_0/ign_rd_wr_mmio_1ff8h/
358 amd_iommu_0/int_dte_hit/
10 amd_iommu_0/int_dte_mis/
465 amd_iommu_0/mem_dte_hit/
4,296 amd_iommu_0/mem_dte_mis/
10.001297570 seconds time elapsed
$ sudo perf stat -e 'amd_iommu_0/mem_iommu_tlb_pde_hit/,
amd_iommu_0/mem_iommu_tlb_pde_mis/, amd_iommu_0/mem_iommu_tlb_pte_hit/,
amd_iommu_0/mem_iommu_tlb_pte_mis/, amd_iommu_0/mem_pass_excl/,
amd_iommu_0/mem_pass_pretrans/, amd_iommu_0/mem_pass_untrans/' sleep 10
Performance counter stats for 'system wide':
24 amd_iommu_0/mem_iommu_tlb_pde_hit/
407 amd_iommu_0/mem_iommu_tlb_pde_mis/
478 amd_iommu_0/mem_iommu_tlb_pte_hit/
7,113 amd_iommu_0/mem_iommu_tlb_pte_mis/
0 amd_iommu_0/mem_pass_excl/
0 amd_iommu_0/mem_pass_pretrans/
7,040 amd_iommu_0/mem_pass_untrans/
10.001246489 seconds time elapsed
$ sudo perf stat -e 'amd_iommu_0/mem_target_abort/,
amd_iommu_0/mem_trans_total/, amd_iommu_0/page_tbl_read_gst/,
amd_iommu_0/page_tbl_read_nst/, amd_iommu_0/page_tbl_read_tot/' sleep 10
Performance counter stats for 'system wide':
0 amd_iommu_0/mem_target_abort/
1,898 amd_iommu_0/mem_trans_total/
0 amd_iommu_0/page_tbl_read_gst/
140 amd_iommu_0/page_tbl_read_nst/
140 amd_iommu_0/page_tbl_read_tot/
10.001295526 seconds time elapsed
$ sudo perf stat -e 'amd_iommu_0/smi_blk/, amd_iommu_0/smi_recv/,
amd_iommu_0/tlb_inv/, amd_iommu_0/vapic_int_guest/,
amd_iommu_0/vapic_int_non_guest/' sleep 10
Performance counter stats for 'system wide':
0 amd_iommu_0/smi_blk/
0 amd_iommu_0/smi_recv/
0 amd_iommu_0/tlb_inv/
0 amd_iommu_0/vapic_int_guest/
433 amd_iommu_0/vapic_int_non_guest/
10.001286515 seconds time elapsed
$ sudo perf stat -e 'amd_iommu_0/mem_target_abort/,
amd_iommu_0/mem_trans_total/, amd_iommu_0/page_tbl_read_gst/,
amd_iommu_0/page_tbl_read_nst/, amd_iommu_0/page_tbl_read_tot/,
amd_iommu_0/smi_blk/, amd_iommu_0/smi_recv/, amd_iommu_0/tlb_inv/,
amd_iommu_0/vapic_int_guest/, amd_iommu_0/vapic_int_non_guest/' sleep 10
Performance counter stats for 'system wide':
0 amd_iommu_0/mem_target_abort/ (80.00%)
703,650,342,510,810 amd_iommu_0/mem_trans_total/ (80.00%)
0 amd_iommu_0/page_tbl_read_gst/ (80.00%)
351,839,572,857,842 amd_iommu_0/page_tbl_read_nst/ (80.00%)
351,849,973,332,309 amd_iommu_0/page_tbl_read_tot/ (80.00%)
0 amd_iommu_0/smi_blk/ (80.00%)
0 amd_iommu_0/smi_recv/ (80.00%)
0 amd_iommu_0/tlb_inv/ (80.00%)
0 amd_iommu_0/vapic_int_guest/ (80.00%)
703,720,763,722,288 amd_iommu_0/vapic_int_non_guest/ (80.00%)
10.000790762 seconds time elapsed
_______________________________________________ iommu mailing list iommu@lists.linux-foundation.org https://lists.linuxfoundation.org/mailman/listinfo/iommu
