unicode character as delimiter

2013-01-09 Thread Ho Kenneth - kennho
Hi all, I have an input file that has a unicode character as a delimiter, which is þ (thorn) For example: col1þcol2þcol3 Þ has a value of UTF-8(hex) 0xC3 0xBE (c3be) And I have tried the following but no luck: create table test(col1 string, col2 string, col3 string) row format delimited f

Hive performance exception

2013-01-09 Thread 窦晓峰
Hello, every one: I am a newbie to hive. And I have a bash shell script which will run multi hive scripts(more than 16*31) simultaneously to export data to text files. When I run this shell, the following exception occurred, and if I run the hive scripts one by one, all are OK.

Re: FAILED: Error in metadata: MetaException(message:org.apache.hadoop.hbase.MasterNotRunningException: in HBase+Hive intergration

2013-01-09 Thread Ted Reynolds
Hi Sagar, If you do a jps after the error shows, do you still see HMaster in the list? It is possible that the Master came up for a bit and then died. Ted. On Tue, Jan 8, 2013 at 5:24 PM, sagar nikam wrote: > MasterNotRunningException

Re: Find out what's causing an InvalidOperationException

2013-01-09 Thread Krishna Rao
The data types are the same. In fact, the statement works the first time, but not the second (I change a WHERE constraint to give different data). I presume it is some invalid data, but is there any way to find a clue in a log file? On 9 January 2013 13:21, Nitin Pawar wrote: > can you give ta

Re: create a hive table: always a tab space before each line

2013-01-09 Thread Dean Wampler
To add to what Nitin said, there is no key output by Hive in front of the tab. On Wed, Jan 9, 2013 at 3:07 AM, Nitin Pawar wrote: > you may want to look at the sequencefile format > > http://my.safaribooksonline.com/book/databases/hadoop/9780596521974/file-based-data-structures/id3555432 > > tha

Re: Find out what's causing an InvalidOperationException

2013-01-09 Thread Nitin Pawar
can you give table definition of both the tables? are both the columns of same type ? On Wed, Jan 9, 2013 at 5:15 AM, Krishna Rao wrote: > Hi all, > > On running a statement of the form "INSERT INTO TABLE tbl1 PARTITION(p1) > SELECT x1 FROM tbl2", I get the following error: > > "Failed with ex

Find out what's causing an InvalidOperationException

2013-01-09 Thread Krishna Rao
Hi all, On running a statement of the form "INSERT INTO TABLE tbl1 PARTITION(p1) SELECT x1 FROM tbl2", I get the following error: "Failed with exception java.lang.ClassCastException: org.apache.hadoop.hive.metastore.api.InvalidOperationException cannot be cast to java.lang.RuntimeException" How

Re:Re: create a hive table: always a tab space before each line

2013-01-09 Thread Richard
I am trying to create a table and insert overwrite it, so the data is supposed to be generated. At 2013-01-09 17:17:06,"Anurag Tangri" wrote: Hi Richard, You should set the format in create external table command based on the format of your data on HDFS. Is your data text file or seq fi

Re: create a hive table: always a tab space before each line

2013-01-09 Thread Anurag Tangri
Hi Richard, You should set the format in create external table command based on the format of your data on HDFS. Is your data text file or seq file on HDFS ? Thanks, Anurag Tangri Sent from my iPhone On Jan 9, 2013, at 12:49 AM, Richard wrote: > more information: > > if I set the format as

Re: create a hive table: always a tab space before each line

2013-01-09 Thread Nitin Pawar
you may want to look at the sequencefile format http://my.safaribooksonline.com/book/databases/hadoop/9780596521974/file-based-data-structures/id3555432 that tab is to separate key from values in the record (I may be wrong but this is how I interpreted it) On Wed, Jan 9, 2013 at 12:49 AM, Richar

Re:create a hive table: always a tab space before each line

2013-01-09 Thread Richard
more information: if I set the format as textfile, there is no tab space. if I set the format as sequencefile and view the content via hadoop fs -text, I saw a tab space in the head of each line. At 2013-01-09 15:44:00,Richard wrote: hi there I have a problem with creating a hive table. n