[
https://issues.apache.org/jira/browse/HIVE-22741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020212#comment-17020212
]
Zoltan Chovan commented on HIVE-22741:
--------------------------------------
Ran some benchmarks with
[hclient|https://github.com/akolb1/hclient/blob/master/metastore-cli/README.md]
(thanks [~pvary] for the help):
Benchmark with before patch:
{code:java}
$ java -jar hbench-jar-with-dependencies.jar -H localhost -N 100 -W 1 -S
"getTableMeta.*" -d "A6" -L 10
13:53:52.928 [main] INFO com.akolb.HMSBenchmark - using args -H localhost -N
100 -W 1 -S getTableMeta.* -d A6 -L 10
13:53:52.929 [main] INFO com.akolb.HMSBenchmark - Using table 'A6.bench_table
13:53:52.939 [main] INFO com.akolb.Util - Connecting to localhost:9083
0 [main] WARN org.apache.hadoop.util.NativeCodeLoader - Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
13:53:53.494 [main] INFO com.akolb.HMSBenchmark - Using 100 object instances
warmup 1 spin 10 threads 2
13:53:53.494 [main] INFO com.akolb.HMSBenchmark - Using 100 object instances
13:53:53.520 [main] INFO com.akolb.BenchmarkSuite - Running benchmark
getTableMeta.100
Run time: 248
Run time: 276
Run time: 295
Run time: 338
Run time: 285
Run time: 286
Run time: 271
Run time: 285
Run time: 270
Run time: 268
Operation AMean Mean Med Min Max Err%
getTableMeta.100 0.000 282.8 281.4 248.2 338.4
8.320
{code}
Benchmark after patch:
{code:java}
$ java -jar hbench-jar-with-dependencies.jar -H localhost -N 100 -W 1 -S
"getTableMeta.*" -d "A7" -L 10
13:56:22.312 [main] INFO com.akolb.HMSBenchmark - using args -H localhost -N
100 -W 1 -S getTableMeta.* -d A7 -L 10
13:56:22.314 [main] INFO com.akolb.HMSBenchmark - Using table 'A7.bench_table
13:56:22.339 [main] INFO com.akolb.Util - Connecting to localhost:9083
0 [main] WARN org.apache.hadoop.util.NativeCodeLoader - Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
13:56:23.722 [main] INFO com.akolb.HMSBenchmark - Using 100 object instances
warmup 1 spin 10 threads 2
13:56:23.722 [main] INFO com.akolb.HMSBenchmark - Using 100 object instances
13:56:23.754 [main] INFO com.akolb.BenchmarkSuite - Running benchmark
getTableMeta.100
Run time: 16
Run time: 19
Run time: 19
Run time: 23
Run time: 21
Run time: 14
Run time: 17
Run time: 16
Run time: 20
Run time: 13
Operation AMean Mean Med Min Max Err%
getTableMeta.100 0.000 18.18 18.44 13.25 23.03
17.86
{code}
Based on the mean values the speedup is ~15x
> Speed up ObjectStore method getTableMeta
> -----------------------------------------
>
> Key: HIVE-22741
> URL: https://issues.apache.org/jira/browse/HIVE-22741
> Project: Hive
> Issue Type: Improvement
> Reporter: Zoltan Chovan
> Assignee: Zoltan Chovan
> Priority: Major
> Attachments: HIVE-22741.patch, no_patch_datanucleus.log,
> patched_datanucleus.log
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
