Re: hive read/write hbase

Hi, Do you have hive-hbase-handler.jar in hive classpath ? On 14 March 2016 at 21:28, songj songj wrote: > hi,i have two cluster,one is hbase(with a hdfs://A ) ,another is hive(with > a hdfs://B). > > i want to use hive shell to read/write hbase. > > when i enter hive shell and input as follow

Re: Hive alter table concatenate loses data - can parquet help?

Thank you very much for thinking of this. I do not have such files. I will file a bug as per your suggestion. On Monday, March 14, 2016, Prasanth Jayachandran < pjayachand...@hortonworks.com> wrote: > Hi Marcin > > I came across this issue recently. Do you have old orc files (created with > hive

Re: Hive alter table concatenate loses data - can parquet help?

Hi Marcin I came across this issue recently. Do you have old orc files (created with hive 0.11) in the table/partition? If so this patch is required https://issues.apache.org/jira/browse/HIVE-13285 Thanks Prasanth On Mar 10, 2016, at 5:02 PM, Prasanth Jayachandran mailto:pjayachand...@hortonw

Inserting into a Hive transactional table using Java code

Hive 2:00 Spark engine 1.3.1 Eclipse Scala IDE build of Eclipse SDK A simple routine that reads CSV files from a staging directory by creating an external table and insert into an ORC transactional table. Using beeline from another server the task finishes pretty quickly. The code is shown in att

Re: Spark SQL is not returning records for HIVE transactional tables on HDP

Thanks for update Alan Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpress.com On 14 March 2016 at 17:49, Alan Ga

Re: Spark SQL is not returning records for HIVE transactional tables on HDP

> On Mar 14, 2016, at 10:31, Mich Talebzadeh wrote: > > That is an interesting point Alan. > > Does this imply that Hive on Spark (Hive 2 encourages Spark or TEZ) is going > to have an issue with transactional tables? I was partially wrong. In HIVE-12366 Wei refactored this so that the hear

Re: Spark SQL is not returning records for HIVE transactional tables on HDP

That is an interesting point Alan. Does this imply that Hive on Spark (Hive 2 encourages Spark or TEZ) is going to have an issue with transactional tables? Besides this begs the question that we still run Hive on Spark 1.3.1 engine. We don't seem to make Hive work on Spark engine with a newer ve

Re: Spark SQL is not returning records for HIVE transactional tables on HDP

I don’t know why you’re seeing Hive on Spark sometimes work with transactional tables and sometimes not. But note that in general it doesn’t work. The Spark runtime in Hive does not send heartbeats to the transaction/lock manager so it will timeout any job that takes longer than the heartbeat

Pb with HBase

I have this error sometimes : {noformat} Error: Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Reducer 3, vertexId=vertex_1457964631631_0013_1_03, diagnostics=[Task failed, taskId=task_145796463163

Re: Hive on Spark performance

Thanks for your response. We were evaluating Spark and were curious to know how it is used today and the lowest latency it can provide. > On Mar 14, 2016, at 8:37 AM, Mich Talebzadeh > wrote: > > Hi Wlodeck, > > Let us look at this. > > In Oracle I have two tables channels and sales. This c

Re: Hive on Spark performance

Hi Wlodeck, Let us look at this. In Oracle I have two tables channels and sales. This code works in Oracle 1 select c.channel_id, sum(c.channel_id * (select count(1) from sales s WHERE c.channel_id = s.channel_id)) As R 2 from channels c 3* group by c.channel_id s...@mydb.mich.LOCAL> / C

Re: Hive on Spark performance

Hive 1.2.1.2.3.4.0-3485Spark 1.5.2Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production ### SELECT  f.description, f.item_number, sum(f.df_a * (select count(1) from e.mv_A_h_a where hb_h_name = r.h_id)) as df_aFROM e.eng_fac_atl_sc_bf_qty f, wv_ATL_2_qty_df_rates rwhere f.

hive read/write hbase

hi,i have two cluster,one is hbase(with a hdfs://A ) ,another is hive(with a hdfs://B). i want to use hive shell to read/write hbase. when i enter hive shell and input as follows: hive>set hbase.zookeeper.quorum=10.24.31.99; hive> create external table inputTable (key string, value string)

Re: Hive StreamingAPI leaves table in not consistent state

Thanks, for reply Alan. What do you mean by Hortonworks list? Is it mailing list like this. I can't find the address. Or is it some kind of HDP support feature? (Sadly, we didn't purchase support subscription yet.) On Fri, Mar 11, 2016 at 9:02 PM, Alan Gates wrote: > I believe this is an issue i