[ 
https://issues.apache.org/jira/browse/HIVE-19902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16537299#comment-16537299
 ] 

Alexander Kolbasov commented on HIVE-19902:
-------------------------------------------

Some comment on JMH. I experimented with JMH initially and found it not very 
useful for the kind of testing that we want to do. Here are some reasons:

* A typical test does something like
** Create object (time not measured)
** Drop object (time measured)

JMS doesn't support such use case where we want to do pre- and post- test for 
each iteration. Also it has complete control over output formatting. Here I 
just collect raw data and use Java's DescriptiveStatistics to do all the stats.

Another problem with JMH is that it starts new JVM for a test so it is very 
difficult to pass down any information from main to the test.


> Provide Metastore micro-benchmarks
> ----------------------------------
>
>                 Key: HIVE-19902
>                 URL: https://issues.apache.org/jira/browse/HIVE-19902
>             Project: Hive
>          Issue Type: Improvement
>          Components: Standalone Metastore
>    Affects Versions: 3.1.0, 4.0.0
>            Reporter: Alexander Kolbasov
>            Assignee: Alexander Kolbasov
>            Priority: Major
>         Attachments: HIVE-19902.01.patch, HIVE-19902.02.patch, 
> HIVE-19902.03.patch
>
>
> It would be very useful to have metastore benchmarks to be able to track perf 
> issues.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to