[TVM Discuss] [Development] Low efficiency on my own cpu

2019-03-27 Thread Chang Liu via TVM Discuss
I made a mistake for the execute time, the true execute time for resnet50 is 18 seconds and ssd_resnet50 is 23 seconds. sorry for this mistake. But I expect millisecond execute time. could autotuning achieve this effect? --- [Visit Topic](https://discuss.tvm.ai/t/low-efficiency-on-my-own-c

[TVM Discuss] [Development] Low efficiency on my own cpu

2019-03-27 Thread yidawang via TVM Discuss
I don't have any experience on this CPU model. But those performance numbers are too bad anyhow, even assuming single thread. I don't have any clue for now. Perhaps you want to share some code snippet. --- [Visit Topic](https://discuss.tvm.ai/t/low-efficiency-on-my-own-cpu/2030/8) to resp

[TVM Discuss] [Development] Low efficiency on my own cpu

2019-03-27 Thread Chang Liu via TVM Discuss
I had try use gluoncv got resnet50_v1 model, the execute time of model take 57 seconds. --- [Visit Topic](https://discuss.tvm.ai/t/low-efficiency-on-my-own-cpu/2030/7) to respond. You are receiving this because you enabled mailing list mode. To unsubscribe from these emails, [click here

[TVM Discuss] [Development] Low efficiency on my own cpu

2019-03-27 Thread yidawang via TVM Discuss
Can you try resnet-50 to see if the performance issue is in the base network or not? --- [Visit Topic](https://discuss.tvm.ai/t/low-efficiency-on-my-own-cpu/2030/6) to respond. You are receiving this because you enabled mailing list mode. To unsubscribe from these emails, [click here](h

[TVM Discuss] [Development] Low efficiency on my own cpu

2019-03-27 Thread Chang Liu via TVM Discuss
Thank you so much for your suggestion,I had try set -mcpu for many arguments, but it no reason so slow, even if there is no autotuning. --- [Visit Topic](https://discuss.tvm.ai/t/low-efficiency-on-my-own-cpu/2030/5) to respond. You are receiving this because you enabled mailing list mode.

[TVM Discuss] [Development] Low efficiency on my own cpu

2019-03-27 Thread Chang Liu via TVM Discuss
Thank you so much for your suggestion, do you mean mcpu=silvermont, it works, but also cost 98-seconds ... --- [Visit Topic](https://discuss.tvm.ai/t/low-efficiency-on-my-own-cpu/2030/4) to respond. You are receiving this because you enabled mailing list mode. To unsubscribe from these e

[TVM Discuss] [Development] Low efficiency on my own cpu

2019-03-27 Thread yidawang via TVM Discuss
Try `mpcu=silvermont`. BTW, 101-second sounds shocking... --- [Visit Topic](https://discuss.tvm.ai/t/low-efficiency-on-my-own-cpu/2030/3) to respond. You are receiving this because you enabled mailing list mode. To unsubscribe from these emails, [click here](https://discuss.tvm.ai/email/

[TVM Discuss] [Development] Low efficiency on my own cpu

2019-03-27 Thread Yao Wang via TVM Discuss
Hi, You might need to set extra llvm arguments, especially -mcpu option, depending on your chip: https://llvm.org/docs/CommandGuide/llc.html You can also try autotuning after proper llvm arguments are set. --- [Visit Topic](https://discuss.tvm.ai/t/low-efficiency-on-my-own-cpu/2030/2) to

Re: [dmlc/tvm] [RFC] Register Relay VM design (#2915)

2019-03-27 Thread Tianqi Chen
Thanks for the proposal. I think we can use more discussion here. To make progress, it is good trying to divide the argument by points, so we can agree on that. For example, so instead of saying: register vm allows data flow discovery, but dataflow discovery don't have to be done at the VM lev

Re: [dmlc/tvm] [RFC] Register Relay VM design (#2915)

2019-03-27 Thread Theodore Omtzigt
In the long tradition of competitive engineering, let's develop both VMs concurrently. That way we will generate actual engineering metrics of the difference between a stack-based and a register-based VM. The engineering dependencies are too complex to productively discuss without actually going

Re: [dmlc/tvm] [RFC] Register Relay VM design (#2915)

2019-03-27 Thread Haichen Shen
I proposed an alternative VM design using registers instead of stack. We can discuss and compare which one works better. cc @jroesch @tqchen @wweic @zhiics @MarisaKirisame @junrushao1994 @abergeron @ajtulloch @antinucleon @Ravenwater -- You are receiving this because you are subscribed to thi

[dmlc/tvm] [RFC] Register Relay VM design (#2915)

2019-03-27 Thread Haichen Shen
# Register VM Design Current Relay VM RFC (#2810) proposes stack-based VM design which uses push and pop to maintain a unified stack. Though the design itself is simple to implement, it is cumbersome in tasks such as dataflow analysis and enforces certain orders in the execution. I propose a re

[TVM Discuss] [Development] Low efficiency on my own cpu

2019-03-27 Thread Chang Liu via TVM Discuss
system info: cpu:J1900 mxnet==1.5.0 llvm==8.0 tvm==0.5.0 I just implement ssd model by tutorials, then I got a accurate result but it cost 101 seconds with a 512*512 picture. I set target = llvm. ssd = 'ssd_512_resnet50_v1_voc'. For the low efficiency,am I doing something wrong, or what I did