[jira] [Updated] (HIVE-3142) Bug in parallel test for singlehost flag

2012-06-14 Thread Shuai Ding (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuai Ding updated HIVE-3142: - Assignee: Shuai Ding Status: Patch Available (was: Open) > Bug in parallel test for singlehost

[jira] [Commented] (HIVE-3142) Bug in parallel test for singlehost flag

2012-06-14 Thread Shuai Ding (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13295474#comment-13295474 ] Shuai Ding commented on HIVE-3142: -- https://reviews.facebook.net/D3681 >

[jira] [Updated] (HIVE-3092) Hive tests should load Hive classes from build directory, not Ivy cache

2012-06-14 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-3092: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committe

[jira] [Created] (HIVE-3142) Bug in parallel test for singlehost flag

2012-06-14 Thread Shuai Ding (JIRA)
Shuai Ding created HIVE-3142: Summary: Bug in parallel test for singlehost flag Key: HIVE-3142 URL: https://issues.apache.org/jira/browse/HIVE-3142 Project: Hive Issue Type: Bug Repor

[jira] [Updated] (HIVE-3141) Bug in SELECT query

2012-06-14 Thread ASK (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASK updated HIVE-3141: -- Status: Open (was: Patch Available) > Bug in SELECT query > --- > > Key: HIVE-3141

[jira] [Updated] (HIVE-3141) Bug in SELECT query

2012-06-14 Thread ASK (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASK updated HIVE-3141: -- Status: Patch Available (was: Open) > Bug in SELECT query > --- > > Key: HIVE-3141

Re: Running unit tests on Windows - Need some suggestions/help to fix exim & archive related issues

2012-06-14 Thread Edward Capriolo
ARge windows :) Well '!' is just a shortcut for a process builder. I guess if we were clever enough we could make the escapes more cross platform. It might be better to build udfs that could do this things SELECT RM("/path/to/file") from src limit 1; It would not be pretty but it would be cross

[jira] [Created] (HIVE-3141) Bug in SELECT query

2012-06-14 Thread ASK (JIRA)
ASK created HIVE-3141: - Summary: Bug in SELECT query Key: HIVE-3141 URL: https://issues.apache.org/jira/browse/HIVE-3141 Project: Hive Issue Type: Bug Components: CLI Environment: OS:

[jira] [Updated] (HIVE-3140) Comment indenting is broken for "describe" in CLI

2012-06-14 Thread Xiaoxiao Hou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoxiao Hou updated HIVE-3140: --- Labels: patch (was: ) Status: Patch Available (was: Open) > Comment indenting is broken for

[jira] [Commented] (HIVE-3140) Comment indenting is broken for "describe" in CLI

2012-06-14 Thread Xiaoxiao Hou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13295368#comment-13295368 ] Xiaoxiao Hou commented on HIVE-3140: Please refer to diff: https://reviews.facebook.ne

Running unit tests on Windows - Need some suggestions/help to fix exim & archive related issues

2012-06-14 Thread Kanna Karanam
Hi, I am working on running unit tests on windows. I have done some basic changes to handle path & diff related issues and most of them are passing now. It would be a great help if you can provide me some early feedback to fix exim & archive related unit test failures. Here are my observations.

[jira] [Created] (HIVE-3140) Comment indenting is broken for "describe" in CLI

2012-06-14 Thread Xiaoxiao Hou (JIRA)
Xiaoxiao Hou created HIVE-3140: -- Summary: Comment indenting is broken for "describe" in CLI Key: HIVE-3140 URL: https://issues.apache.org/jira/browse/HIVE-3140 Project: Hive Issue Type: Bug

[jira] [Created] (HIVE-3139) Code clean-up (Function populate_inputs() in SemanticAnalyze() should be used by partition pruner also to add the inputs. See JIRA 3078

2012-06-14 Thread Shuai Ding (JIRA)
Shuai Ding created HIVE-3139: Summary: Code clean-up (Function populate_inputs() in SemanticAnalyze() should be used by partition pruner also to add the inputs. See JIRA 3078 Key: HIVE-3139 URL: https://issues.apache

[jira] [Commented] (HIVE-3135) add an option in ptest to run on a single machine

2012-06-14 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13295353#comment-13295353 ] Namit Jain commented on HIVE-3135: -- +1 > add an option in ptest to run on

[jira] [Commented] (HIVE-3135) add an option in ptest to run on a single machine

2012-06-14 Thread Shuai Ding (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13295320#comment-13295320 ] Shuai Ding commented on HIVE-3135: -- https://reviews.facebook.net/D3657 >

[jira] [Updated] (HIVE-3135) add an option in ptest to run on a single machine

2012-06-14 Thread Shuai Ding (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuai Ding updated HIVE-3135: - Status: Patch Available (was: Open) > add an option in ptest to run on a single machine > ---

[jira] [Updated] (HIVE-3107) Improve semantic analyzer to better handle column name references in group by/sort by clauses

2012-06-14 Thread Richard Ding (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Ding updated HIVE-3107: --- Issue Type: Improvement (was: Bug) Summary: Improve semantic analyzer to better handle column n

[jira] [Reopened] (HIVE-3107) Improve semantic analyzer to better handle column name references in group by/sort by clauses

2012-06-14 Thread Richard Ding (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Ding reopened HIVE-3107: Thanks. I changed this to improvement. > Improve semantic analyzer to better handle col

[jira] [Commented] (HIVE-3074) Create a new API which gets a new empty partition object.

2012-06-14 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13295248#comment-13295248 ] Carl Steinbach commented on HIVE-3074: -- bq. The user can modify it and flush it later.

[jira] [Commented] (HIVE-3074) Create a new API which gets a new empty partition object.

2012-06-14 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13295247#comment-13295247 ] Namit Jain commented on HIVE-3074: -- @Carl, append_partition adds a new partition to the me

[jira] [Updated] (HIVE-3074) Create a new API which gets a new empty partition object.

2012-06-14 Thread Nadeem Moidu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nadeem Moidu updated HIVE-3074: --- Status: Patch Available (was: Open) Updated according to Carl's comments. > Create a

[jira] [Commented] (HIVE-2745) Remove Hive's runtime dependency on bin/hadoop

2012-06-14 Thread Kanna Karanam (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13295244#comment-13295244 ] Kanna Karanam commented on HIVE-2745: - Is there any recommended way to implement this?

[jira] [Commented] (HIVE-3092) Hive tests should load Hive classes from build directory, not Ivy cache

2012-06-14 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13295223#comment-13295223 ] Carl Steinbach commented on HIVE-3092: -- +1 > Hive tests should load

[jira] [Commented] (HIVE-3129) Create windows native scripts (CMD files) to run hive on windows without Cygwin

2012-06-14 Thread Edward Capriolo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13295214#comment-13295214 ] Edward Capriolo commented on HIVE-3129: --- None of them are retired. They each start up

[jira] [Commented] (HIVE-3129) Create windows native scripts (CMD files) to run hive on windows without Cygwin

2012-06-14 Thread Kanna Karanam (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13295199#comment-13295199 ] Kanna Karanam commented on HIVE-3129: - Hi Edward, It is a good idea. Let me understand

[jira] [Updated] (HIVE-3134) Drop table/index/database can result in orphaned locations

2012-06-14 Thread Kevin Wilfong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Wilfong updated HIVE-3134: Attachment: HIVE-3134.2.patch.txt > Drop table/index/database can result in orphaned locations >

[jira] [Commented] (HIVE-3134) Drop table/index/database can result in orphaned locations

2012-06-14 Thread Kevin Wilfong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13295186#comment-13295186 ] Kevin Wilfong commented on HIVE-3134: - Responded to comments on phabricator.

[jira] [Updated] (HIVE-3134) Drop table/index/database can result in orphaned locations

2012-06-14 Thread Kevin Wilfong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Wilfong updated HIVE-3134: Status: Patch Available (was: Open) > Drop table/index/database can result in orphaned location

Re: Hive List Bucketing - Feature Review

2012-06-14 Thread Gang Liu
Would you please elaborate on it? Thanks Tim On 6/14/12 10:30 AM, "Edward Capriolo" wrote: >We have had a ticket open for quite some time for combine input format >to work across partitions. Not sure if that can help with what you are >seeing as well. It could help us alot. > >Edward > >On Th

Re: Hive List Bucketing - Feature Review

2012-06-14 Thread Edward Capriolo
We have had a ticket open for quite some time for combine input format to work across partitions. Not sure if that can help with what you are seeing as well. It could help us alot. Edward On Thu, Jun 14, 2012 at 1:25 PM, Gang Liu wrote: > Hey Edward, > > Thank you very much for providing comment

Re: Hive List Bucketing - Feature Review

2012-06-14 Thread Gang Liu
Hey Edward, Thank you very much for providing comments. This feature is designed for use cases described in wiki. We do see them in the real life so that we come up with the feature. In this first release, in order to use the feature: 1. Hive table users need to know the skewed key in advance 2.

[jira] [Commented] (HIVE-3092) Hive tests should load Hive classes from build directory, not Ivy cache

2012-06-14 Thread Kevin Wilfong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13295163#comment-13295163 ] Kevin Wilfong commented on HIVE-3092: - Carl did have a good point, this patch did not f

[jira] [Commented] (HIVE-3092) Hive tests should load Hive classes from build directory, not Ivy cache

2012-06-14 Thread Kevin Wilfong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13295164#comment-13295164 ] Kevin Wilfong commented on HIVE-3092: - Also added a comment. > Hive te

[jira] [Updated] (HIVE-3092) Hive tests should load Hive classes from build directory, not Ivy cache

2012-06-14 Thread Kevin Wilfong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Wilfong updated HIVE-3092: Attachment: HIVE-3092.2.patch.txt > Hive tests should load Hive classes from build directory, no

Re: Hive List Bucketing - Feature Review

2012-06-14 Thread Gang Liu
Hi Carl, Thank you for informing me. Yes, I didn't register as a watcher so that I didn't see it. I am sorry. I just register as a watcher. I will check comments and reply accordingly. Thanks Tim On 6/14/12 1:14 AM, "Carl Steinbach" wrote: >Hi Tim, > >I added some comments to the wiki a cou

Re: Hive List Bucketing - Feature Review

2012-06-14 Thread Edward Capriolo
I am of the opinion this feature is too specialized to be generally helpful. --- The cardinality of 'x' is in 1000's per partition of T. Moreover, there is a skew for the values of 'x'. In general, there are ~10 values of 'x' which have a very large skew, and the remain

Build failed in Jenkins: Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false #47

2012-06-14 Thread Apache Jenkins Server
See -- [...truncated 10116 lines...] ivy-retrieve-test: [echo] Project: odbc compile-test: [echo] Project: odbc create-dirs: [echo] Project: serde [copy] War

Re: Question about documentation for Hive in general

2012-06-14 Thread Edward Capriolo
The indexes would not make sense on storage handler tables. They attempt to make an index of data->dfs block. Then that information is used to prune blocks from the job, this would not make sense for storage handlers because the data is not directly backed by blocks. Edward On Thu, Jun 14, 2012 a

[jira] [Commented] (HIVE-3108) SELECT count(DISTINCT col) ... returns 0 if "col" is a partition column

2012-06-14 Thread Edward Capriolo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13295072#comment-13295072 ] Edward Capriolo commented on HIVE-3108: --- I am guessing he things that HIVE-2955 is pa

Re: Question about documentation for Hive in general

2012-06-14 Thread Lars Francke
Edward, thanks for your reply. > As you may have heard myself and some others (Dean, Jason) are working > on the programming hive book. Yeah, heard about that and I'm looking forward to it! > I recently stumbed onto the really amazing thrift raw bytes serde. Who > knew that hive table can be de

[jira] [Created] (HIVE-3138) FAILED: Error in semantic analysis: line 1:33 Invalid Column Reference crawled_page_id when using where clause

2012-06-14 Thread Rajesh Kumar (JIRA)
Rajesh Kumar created HIVE-3138: -- Summary: FAILED: Error in semantic analysis: line 1:33 Invalid Column Reference crawled_page_id when using where clause Key: HIVE-3138 URL: https://issues.apache.org/jira/browse/HIVE-

[jira] [Commented] (HIVE-3125) sort_array doesn't work with LazyPrimitive

2012-06-14 Thread Philip Tromans (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13294921#comment-13294921 ] Philip Tromans commented on HIVE-3125: -- @Carl: reviews.apache.org appears to be down a

[jira] [Commented] (HIVE-3092) Hive tests should load Hive classes from build directory, not Ivy cache

2012-06-14 Thread Kevin Wilfong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13294894#comment-13294894 ] Kevin Wilfong commented on HIVE-3092: - Carl, do you happen to know why these Hive artif

Re: Hive List Bucketing - Feature Review

2012-06-14 Thread Carl Steinbach
Hi Tim, I added some comments to the wiki a couple days ago. I just wanted to make sure you saw them since it doesn't look like you're registered as a watcher for that page. Thanks. Carl On Mon, Jun 11, 2012 at 12:22 PM, Gang Liu wrote: > Hi Carl, thanks Tim > > On 6/11/12 12:14 PM, "Carl Ste

[jira] [Commented] (HIVE-3092) Hive tests should load Hive classes from build directory, not Ivy cache

2012-06-14 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13294888#comment-13294888 ] Carl Steinbach commented on HIVE-3092: -- I also don't think this fix will stay in place

[jira] [Commented] (HIVE-3092) Hive tests should load Hive classes from build directory, not Ivy cache

2012-06-14 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13294880#comment-13294880 ] Carl Steinbach commented on HIVE-3092: -- This patch will fix the problem in cases where

[jira] [Commented] (HIVE-3074) Create a new API which gets a new empty partition object.

2012-06-14 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13294870#comment-13294870 ] Carl Steinbach commented on HIVE-3074: -- @Namit: I don't understand what Ed means by ".

[jira] [Updated] (HIVE-3108) SELECT count(DISTINCT col) ... returns 0 if "col" is a partition column

2012-06-14 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-3108: - Status: Open (was: Patch Available) @Arun: Doesn't look like there's a patch here. Not sure why y

[jira] [Commented] (HIVE-3136) QTestUtil diff masking masks out most of 'DESCRIBE EXTENDED' output

2012-06-14 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13294858#comment-13294858 ] Carl Steinbach commented on HIVE-3136: -- Here's what the output of DESCRIBE EXTENDED lo

[jira] [Updated] (HIVE-3123) Hadoop20Shim. CombineFileRecordReader does not report progress within files

2012-06-14 Thread Kevin Wilfong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Wilfong updated HIVE-3123: Component/s: Shims Fix Version/s: 0.10.0 > Hadoop20Shim. CombineFileRecordReader does not

[jira] [Created] (HIVE-3137) Including row update and delete option in hive

2012-06-14 Thread Unnikrishnan V T (JIRA)
Unnikrishnan V T created HIVE-3137: -- Summary: Including row update and delete option in hive Key: HIVE-3137 URL: https://issues.apache.org/jira/browse/HIVE-3137 Project: Hive Issue Type: New