RE: Dynamic partitioned parquet tables

2015-10-09 Thread Yogesh Keshetty
Any one tried this? Please help me if you have any knowledge on this kind of use case. From: yogesh.keshe...@outlook.com To: user@hive.apache.org Subject: Dynamic partitioned parquet tables Date: Fri, 9 Oct 2015 11:20:57 +0530 Hello, I have a question regarding parquet tables. We have

Dynamic partitioned parquet tables

2015-10-08 Thread Yogesh Keshetty
Hello, I have a question regarding parquet tables. We have POS data, we want to store the data on per day partition basis. We sqoop the data into an external table which is in text file format and then try to insert into an external table which is partitioned by date and, due to some require

RE: Hive Generic UDF invoking Hbase

2015-09-30 Thread Yogesh Keshetty
really can't help. Have you written other functioning UDFs? Are you aware of the requirements? https://cwiki.apache.org/confluence/display/Hive/HivePlugins From: Yogesh Keshetty [mailto:yogesh.keshe...@outlook.com] Sent: Wednesday, September 30, 2015 3:19 PM To: user@hive.apache.org;

RE: Hive Generic UDF invoking Hbase

2015-09-30 Thread Yogesh Keshetty
better insights for you there. From: Yogesh Keshetty [mailto:yogesh.keshe...@outlook.com] Sent: Wednesday, September 30, 2015 2:48 PM To: Hive community Subject: RE: Hive Generic UDF invoking Hbase Jason and Ryan, Thanks for the solutions. It's now launching in MapReduce Mode. However,

RE: Hive Generic UDF invoking Hbase

2015-09-30 Thread Yogesh Keshetty
That would typically be a logical approach for a "give me everything" query if it were not for the UDF... try adding a basic where clause to the query and see if that changes the behavior... e.g. SELECT membership(c1,c2,c3,c4,c5,c5,c7) from MemberTable where c1 is not NULL; From: Yo

RE: Hive Generic UDF invoking Hbase

2015-09-29 Thread Yogesh Keshetty
d have a UI to show running jobs and you can drill down to see tasks/containers. Hope this helps Sent from my iPhone On Sep 29, 2015, at 9:39 PM, Yogesh Keshetty wrote: Hi, I have a quick question about Hive Generic UDF’s. We are trying to do some CRUD operations on HBase tables

Hive Generic UDF invoking Hbase

2015-09-29 Thread Yogesh Keshetty
Hi, I have a quick question about Hive Generic UDF’s. We are trying to do some CRUD operations on HBase tables from hive generic UDF. But, the issue here is until hive 0.13, it would generate map reduce task where we could track the status of execution. Once we migrated to hive 1.0, it doesn’t