Hi Venkat, I have checked the Grafana web portal,
About the Error issue, the reason is for tc037, the data in so large that if you choose from May 2,2017 to Aug 30,2017, it will cause a timeout error when get data from influxdb. I have tried several times, two weeks should be OK. If you only in one graph, two month should be OK. For the null issue, the default is null. You need to choose proper pod and scenario, then the data will be shown. Regards, Jack Chan 发件人: [email protected] [mailto:[email protected]] 代表 Gaoliang (kubi) 发送时间: 2017年9月12日 22:16 收件人: [email protected] 抄送: [email protected]; [email protected] 主题: Re: [opnfv-tech-discuss] [yardstick] Yardstick results showing Null or Error HI Venkat, Sorry for the delay in responding. Some comments in line. Regards, Kubi 发件人: [email protected]<mailto:[email protected]> [mailto:[email protected]] 发送时间: 2017年9月12日 21:26 收件人: Gaoliang (kubi) <[email protected]<mailto:[email protected]>>; [email protected]<mailto:[email protected]>; [email protected]<mailto:[email protected]>; 'Alexandru Avadanii' <[email protected]<mailto:[email protected]>> 主题: RE: [opnfv-tech-discuss] [yardstick] Yardstick results showing Null or Error Hi Kubi, Alex(ARMBand) Any inputs/clarifications on the below mail please ? Thanks for your help. -Venkat From: [email protected]<mailto:[email protected]> [mailto:[email protected]] On Behalf Of Venkateshwarlu Vangala Sent: Saturday, September 9, 2017 4:12 PM To: Gaoliang (kubi) <[email protected]<mailto:[email protected]>>; [email protected]<mailto:[email protected]>; [email protected]<mailto:[email protected]> Subject: [opnfv-tech-discuss] [yardstick] Yardstick results showing Null or Error Hi Kubi and Yardstick team, Thanks for your information on the yardstick earlier. I just collected the old results from Grafana by going through each of the tests for a specific date range as suggested. Below is the table. Intel C release below points based on the Yardstick report. Request you to please clarify the below questions and Sorry for many questions as this may be useful for others as wel. 1. Why some of the results of the test cases are showing either error or null if I query them as shown below as NA/error ? [Kubi] I believe there should be some test date in influxdb during the time range. I will give you the root cause after I check with the influxdb and grafana config. It should be related to the “Mean” of Grafana function. 1. Is SLA to be defined for some cases ? [Kubi] we have give some reference SLA for some test case. But that is not a standard. Just give by yardstick developer based on some testing experience. As I said, we will try to analyze the result by the Tool, then give some more reasonable SLA in future release. 1. For a particular test, the test runs for multiple iterations say on a specific day. How is the single number achieved ? Is it average of those multiple iterations on a specific day and how is Grafana picking the average of those multiple iterations ? [Kubi] yes, It is average of those multiple iterations on a specific day, Grafana provide the Mean function for the data. It need admin root to config that with each graph. 1. How about other test cases as default only these test cases run say for os-nosdn-nofeature-noha ? Is it based on the scenarios ? [Kubi] we have different test suites for each scenario. Please check the below link https://git.opnfv.org/yardstick/tree/tests/opnfv/test_suites As the maximum time for each CI job is 3 hours, we didn’t put all test cases into one scenario. Only find some typical test cases to make them with CI jobs. Please help in answering the questions. Thanks -Venkat May 2,2017 to Aug 30,2017 tests conducted arm-pod1 Linux Foundation-pod2 /huawei-pod (Intel) SLA Intel C-Release Units OPNFV_YARDSTICK_TC002_NETWORK LATENCY 1.26 1.08 10 0.55 ms OPNFV_YARDSTICK_TC005_STORAGE PERFORMANCE 217.2 137.29 400 200 MB/s OPNFV_YARDSTICK_TC010_MEMORY LATENCY NA 1.61 30 1.2 ns OPNFV_YARDSTICK_TC011_PACKET DELAY VARIATION BETWEEN VMs 0.1193 0.0133 NA 0.0067 ms OPNFV_YARDSTICK_TC012_MEMORY BANDWIDTH 3.7 19.8 15 17.6 GB/s OPNFV_YARDSTICK_TC014_PROCESSING SPEED 610 3827 NA 3150 score OPNFV_YARDSTICK_TC037_LATENCY NA(error) NA(error) NA 15 ms OPNFV_YARDSTICK_TC037_CPU LOAD NA(error) NA(error) NA 2 % OPNFV_YARDSTICK_TC037_THROUGHPUT NA(error) NA(error) NA 433000 pps OPNFV_YARDSTICK_TC037_PACKET LOSS NA(error) NA(error) NA 550 packets OPNFV_YARDSTICK_TC069_Memory Bandwidth 13 29.4 6 20.45 GB/s OPNFV_YARDSTICK_TC070_Memory Utilization NA NA NA 235 MB OPNFV_YARDSTICK_TC071_Cache Utilization NA NA NA 208 MB OPNFV_YARDSTICK_TC072_Network Utilization NA NA NA 200 KPPS
_______________________________________________ opnfv-tech-discuss mailing list [email protected] https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss
