[ https://issues.apache.org/jira/browse/HIVE-11531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063320#comment-15063320 ]
Hui Zheng commented on HIVE-11531: ---------------------------------- Hi [~sershe] and [~prasanth_j] The union9 is good in my local machine.Could you give more details about how to reproduce it? {code} mvn test -Dtest=TestCliDriver -Dqfile=union9.q,offset_limit.q ...... [INFO] Executed tasks [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ hive-it-qfile-spark --- [INFO] Compiling 3 source files to /Users/huzheng/git/hive/itests/qtest-spark/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.16:test (default-test) @ hive-it-qfile-spark --- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Hive Integration - Parent ......................... SUCCESS [1.191s] [INFO] Hive Integration - Custom Serde ................... SUCCESS [1.955s] [INFO] Hive Integration - HCatalog Unit Tests ............ SUCCESS [2.974s] [INFO] Hive Integration - Testing Utilities .............. SUCCESS [2.312s] [INFO] Hive Integration - Unit Tests ..................... SUCCESS [4.672s] [INFO] Hive Integration - Test Serde ..................... SUCCESS [0.326s] [INFO] Hive Integration - QFile Tests .................... SUCCESS [1:35.067s] [INFO] Hive Integration - QFile Accumulo Tests ........... SUCCESS [2.523s] [INFO] JMH benchmark: Hive ............................... SUCCESS [0.399s] [INFO] Hive Integration - Unit Tests - Hadoop 2 .......... SUCCESS [1.358s] [INFO] Hive Integration - Unit Tests with miniKdc ........ SUCCESS [1.407s] [INFO] Hive Integration - QFile Spark Tests .............. SUCCESS [3.650s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD SUCCESS [INFO] ------------------------------------------------------------------------ [INFO] Total time: 1:58.710s [INFO] Finished at: Fri Dec 18 11:18:28 JST 2015 [INFO] Final Memory: 164M/875M [INFO] ------------------------------------------------------------------------ {code} > Add mysql-style LIMIT support to Hive, or improve ROW_NUMBER performance-wise > ----------------------------------------------------------------------------- > > Key: HIVE-11531 > URL: https://issues.apache.org/jira/browse/HIVE-11531 > Project: Hive > Issue Type: Improvement > Components: CBO > Reporter: Sergey Shelukhin > Assignee: Hui Zheng > Fix For: 2.1.0 > > Attachments: HIVE-11531.02.patch, HIVE-11531.03.patch, > HIVE-11531.04.patch, HIVE-11531.05.patch, HIVE-11531.06.patch, > HIVE-11531.07.patch, HIVE-11531.WIP.1.patch, HIVE-11531.WIP.2.patch, > HIVE-11531.patch > > > For any UIs that involve pagination, it is useful to issue queries in the > form SELECT ... LIMIT X,Y where X,Y are coordinates inside the result to be > paginated (which can be extremely large by itself). At present, ROW_NUMBER > can be used to achieve this effect, but optimizations for LIMIT such as TopN > in ReduceSink do not apply to ROW_NUMBER. We can add first class support for > "skip" to existing limit, or improve ROW_NUMBER for better performance -- This message was sent by Atlassian JIRA (v6.3.4#6332)