custom binary format

Dear List, I want to set up a DW based on Hive. However, my data does not come as handy csv files but as binary files in a proprietary format. The binary file consists of - 1 header of a dynamic number of bytes, which can be read from the contents of the header The header tells me how to

Re: Hive 0.13/Hadoop 0.20 ORC probleme

Both Hadoop 2.6 and hive 0.13 use protobuf 2.5, so it runs well. But Hadoop 2.0 and before, protobuf 2.4 is used, just as I mentioned before, 2.4 and 2.5 are uncompatible. Good luck. On Thu, Dec 11, 2014 at 10:22 PM, Amjad ALSHABANI wrote: > > Hello Jander, > > Thanx for your reply, > I think it

Re: Concatenating ORC files

Thanks Daniel for filing the jira and the test case. I have put up a patch in HIVE-9067 jira that should fix this issue.  - Prasanth On Thu, Dec 11, 2014 at 3:29 AM, Daniel Haviv wrote: > Hi, > I've created a JIRA with a test case: > https://issues.apache.org/jira/browse/HIVE-9080 > Thanks! >

Re: Hive 0.13/Hadoop 0.20 ORC probleme

Hello Jander, Thanx for your reply, I think it is more about hadoop CLASSPATH problem, because the same built Hive 0.13 worked well with Hadoop 2.6 I ll try to find a way to change hadoop classpath so it will use the new protobu instead of 2.4 On Thu, Dec 11, 2014 at 11:48 AM, Jander g wrote:

Re: JDBX Web based sql viewers

Hue On Thu, Dec 11, 2014 at 8:54 AM, peterm_second wrote: > Hi Guys, > Do you know of any web based jdbc enabled sql viewers ? > > Peter > -- Those who say it can't be done, are usually interrupted by those doing it.

JDBX Web based sql viewers

Hi Guys, Do you know of any web based jdbc enabled sql viewers ? Peter

Re: Concatenating ORC files

Hi, I've created a JIRA with a test case: https://issues.apache.org/jira/browse/HIVE-9080 Thanks! Daniel On Thu, Dec 11, 2014 at 12:49 AM, Prasanth Jayachandran < pjayachand...@hortonworks.com> wrote: > I am unable to reproduce the case that causes exception that you are > seeing. Will be great

Hive 14 performance and scalability?

Hi, While I haven’t upgraded to HDP 2.2, I have to ask if the transaction processing introduced in 14 has been tested at scale in terms of both users, and data size? I am curious as to what happens if you have a long transaction how well it copes. Thx -Mike

Re: Hive 0.13/Hadoop 0.20 ORC probleme

hi，Amjad protobuf 2.4 isn't compatible with protobuf 2.5, so you should regen OrcProto.java using protobuf 2.4.0, and then rebuild hive. I hope it helps. On Wed, Dec 10, 2014 at 6:28 PM, Amjad ALSHABANI wrote: > > Hello everybody. > > I have a problem when using ORC file format in Hive 0.13.