[jira] Commented: (HIVE-1434) Cassandra Storage Handler

2011-03-14 Thread John Sichi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006787#comment-13006787 ] John Sichi commented on HIVE-1434: -- The hbase stuff was originally in hbase-handler, but i

[jira] Commented: (HIVE-1434) Cassandra Storage Handler

2011-03-14 Thread Edward Capriolo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006781#comment-13006781 ] Edward Capriolo commented on HIVE-1434: --- I put this in ql/ivy.xml because that is whe

[jira] Commented: (HIVE-1867) Fix intermittent failures in TestNegativeCliDriver/dyn_part_empty.q

2011-03-14 Thread Marcel Kornacker (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006743#comment-13006743 ] Marcel Kornacker commented on HIVE-1867: To provide some more context: Driver.execu

[jira] Updated: (HIVE-2051) getInputSummary() to call FileSystem.getContentSummary() in parallel

2011-03-14 Thread Siying Dong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siying Dong updated HIVE-2051: -- Attachment: HIVE-2051.3.patch Minor: typo in comments. > getInputSummary() to call FileSystem.getConten

[jira] Updated: (HIVE-2051) getInputSummary() to call FileSystem.getContentSummary() in parallel

2011-03-14 Thread Siying Dong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siying Dong updated HIVE-2051: -- Status: Patch Available (was: Open) > getInputSummary() to call FileSystem.getContentSummary() in paral

[jira] Updated: (HIVE-2051) getInputSummary() to call FileSystem.getContentSummary() in parallel

2011-03-14 Thread Siying Dong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siying Dong updated HIVE-2051: -- Attachment: HIVE-2051.2.patch Updates: 1. use ConcurrentHashMap 2. wait for Future objbect too 3. Share

[jira] Updated: (HIVE-1434) Cassandra Storage Handler

2011-03-14 Thread Edward Capriolo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Capriolo updated HIVE-1434: -- Status: Patch Available (was: Open) > Cassandra Storage Handler > - > >

[jira] Updated: (HIVE-1434) Cassandra Storage Handler

2011-03-14 Thread Edward Capriolo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Capriolo updated HIVE-1434: -- Attachment: hive-1434-2011-03-14.patch.txt Adds repo to grab jug > Cassandra Storage Handler >

[jira] Commented: (HIVE-1434) Cassandra Storage Handler

2011-03-14 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006623#comment-13006623 ] Carl Steinbach commented on HIVE-1434: -- I was able to get it to work by modifying ivy/

[jira] Commented: (HIVE-1434) Cassandra Storage Handler

2011-03-14 Thread Edward Capriolo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006611#comment-13006611 ] Edward Capriolo commented on HIVE-1434: --- We can not pull down. {noformat} [ivy:resol

[jira] Commented: (HIVE-1434) Cassandra Storage Handler

2011-03-14 Thread Edward Capriolo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006604#comment-13006604 ] Edward Capriolo commented on HIVE-1434: --- It looks like this is only used when first g

[jira] Updated: (HIVE-1434) Cassandra Storage Handler

2011-03-14 Thread John Sichi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Sichi updated HIVE-1434: - Status: Open (was: Patch Available) I looked in hive.log after the test failure and noticed the exception

Jenkins build is back to normal : Hive-0.7.0-h0.20 #37

2011-03-14 Thread Apache Hudson Server
See

Re: Review Request: HIVE-2051: getInputSummary() to call FileSystem.getContentSummary() in parallel

2011-03-14 Thread Siying Dong
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/491/#review330 --- trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java

[jira] Commented: (HIVE-1918) Add export/import facilities to the hive system

2011-03-14 Thread Paul Yang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006582#comment-13006582 ] Paul Yang commented on HIVE-1918: - +1 Looks good, will test and commit > Add export/import

Build failed in Jenkins: Hive-trunk-h0.20 #611

2011-03-14 Thread Apache Hudson Server
See -- [...truncated 27308 lines...] [junit] PREHOOK: type: CREATETABLE [junit] POSTHOOK: query: create table testhivedrivertable (num int) [junit] POSTHOOK: type: CREATETABLE [juni

Re: how to load hive table schema programatically?

2011-03-14 Thread Edward Capriolo
On Mon, Mar 14, 2011 at 3:01 PM, Carl Steinbach wrote: > Hi Ed, > I'm pretty sure HiveMetaStoreClient is intended to be a public API. > > On Mon, Mar 14, 2011 at 11:49 AM, Edward Capriolo > wrote: >> >> On Mon, Mar 14, 2011 at 2:44 PM, Jae Lee wrote: >> > Ah... thanks alot... that worked :) >> >

Re: how to load hive table schema programatically?

2011-03-14 Thread Carl Steinbach
Hi Ed, I'm pretty sure HiveMetaStoreClient is intended to be a public API. On Mon, Mar 14, 2011 at 11:49 AM, Edward Capriolo wrote: > On Mon, Mar 14, 2011 at 2:44 PM, Jae Lee wrote: > > Ah... thanks alot... that worked :) > > > > Is there any other recommended way to load hive table meta data?

Re: how to load hive table schema programatically?

2011-03-14 Thread Edward Capriolo
On Mon, Mar 14, 2011 at 2:44 PM, Jae Lee wrote: > Ah... thanks alot... that worked :) > > Is there any other recommended way to load hive table meta data? I suppose > accessing meta-store via HiveMetaStoreClient make it possible to change > underlying data storage implementation choice. > > J > >

Re: how to load hive table schema programatically?

2011-03-14 Thread Jae Lee
Ah... thanks alot... that worked :) Is there any other recommended way to load hive table meta data? I suppose accessing meta-store via HiveMetaStoreClient make it possible to change underlying data storage implementation choice. J On Mon, Mar 14, 2011 at 5:56 PM, Carl Steinbach wrote: > Hi Ja

Re: Review Request: HIVE-2051: getInputSummary() to call FileSystem.getContentSummary() in parallel

2011-03-14 Thread Joydeep Sensarma
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/491/#review329 --- note that in this case - the maps used by different threads will almost

Re: how to load hive table schema programatically?

2011-03-14 Thread Carl Steinbach
Hi Jae, Sounds like your problem is related to HIVE-1435 ( https://issues.apache.org/jira/browse/HIVE-1435). You need to make sure that the Datanucleus ORM layer is getting initialized with the configuration property datanucleus.identifierFactory=datanucleus. Probably the easiest way to fix this p

Re: how to load hive table schema programatically?

2011-03-14 Thread Jae Lee
just a bit more information from my debugging so far my mysql hive metastore have columns like "integer_idx" at "columns" table "integer_idx" at "sort_cols" table those columns looks pretty suspicious in that it is similar to "idx" columns that HiveMetaSotreClient complains missing. It looks lik

Re: Review Request: HIVE-2051: getInputSummary() to call FileSystem.getContentSummary() in parallel

2011-03-14 Thread M IS
> On 2011-03-14 03:13:45, Siying Dong wrote: > > trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java, line 1600 > > > > > > Do we need it if we do executor.shutdown()? If we use the futures for the tasks subm

[jira] Updated: (HIVE-2052) PostHook and PreHook API to add flag to indicate it is pre or post hook plus cache for content summary

2011-03-14 Thread Siying Dong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siying Dong updated HIVE-2052: -- Status: Patch Available (was: Open) > PostHook and PreHook API to add flag to indicate it is pre or pos

[jira] Updated: (HIVE-2052) PostHook and PreHook API to add flag to indicate it is pre or post hook plus cache for content summary

2011-03-14 Thread Siying Dong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siying Dong updated HIVE-2052: -- Attachment: HIVE-2052.2.patch add a test case for check HookContext.getInputPathToContentSummary(). >

[jira] Commented: (HIVE-2051) getInputSummary() to call FileSystem.getContentSummary() in parallel

2011-03-14 Thread Siying Dong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006372#comment-13006372 ] Siying Dong commented on HIVE-2051: --- @Carl, also commented on reviewboard. > getInputSum

Re: Review Request: HIVE-2051: getInputSummary() to call FileSystem.getContentSummary() in parallel

2011-03-14 Thread Siying Dong
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/491/#review326 --- trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java

[jira] Updated: (HIVE-2051) getInputSummary() to call FileSystem.getContentSummary() in parallel

2011-03-14 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-2051: - Status: Open (was: Patch Available) @Siying: Please see the comments on reviewboard. > getInputS

[jira] Updated: (HIVE-2052) PostHook and PreHook API to add flag to indicate it is pre or post hook plus cache for content summary

2011-03-14 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated HIVE-2052: -- Status: Open (was: Patch Available) Can you validate HookContext.getInputPathTo

[jira] Commented: (HIVE-2042) In error scenario some opened streams may not closed in ExplainTask.java and Throttle.java

2011-03-14 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006351#comment-13006351 ] Amareshwari Sriramadasu commented on HIVE-2042: --- Can you combine HIVE-2042, H

Re: Review Request: Patch For Hive 1918 - Export / Import

2011-03-14 Thread Krishna
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/430/ --- (Updated 2011-03-14 01:05:49.673041) Review request for hive. Changes ---

[jira] Commented: (HIVE-1538) FilterOperator is applied twice with ppd on.

2011-03-14 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006347#comment-13006347 ] Amareshwari Sriramadasu commented on HIVE-1538: --- Yongqiang, Can you have a lo

[jira] Updated: (HIVE-1918) Add export/import facilities to the hive system

2011-03-14 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-1918: Attachment: (was: HIVE-1918.patch.5.txt) > Add export/import facilities to the hive system > ---

[jira] Updated: (HIVE-1918) Add export/import facilities to the hive system

2011-03-14 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-1918: Attachment: HIVE-1918.patch.5.txt Merged with trunk > Add export/import facilities to the hive syst

[jira] Updated: (HIVE-2031) Correct the exception message for the better traceability for the scenario load into the partitioned table having 2 partitions by specifying only one partition in the load

2011-03-14 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated HIVE-2031: -- Status: Open (was: Patch Available) Change looks fine. Can you add a test in cl