Re: Unable to move files on Hive/Hdfs

2015-05-04 Thread Moore, Douglas
I've seen where hdfs:///tmp permissions were not compatible with the user running hive. To fix that look at changing the perms on hdfs:///tmp - Douglas From: amit kumar mailto:ak3...@gmail.com>> Reply-To: mailto:user@hive.apache.org>> Date: Tue, 5 May 2015 04:48:58 +0530 To: mailto:user@hive.apac

Re: Unable to move files on Hive/Hdfs

2015-05-04 Thread amit kumar
Doug, Do i need any changes in configuration or else to resolve this issue. Thanks On Tue, May 5, 2015 at 4:46 AM, amit kumar wrote: > Do you have any suggestion to resolve this issue, > > I am looking for a resolution. > > On Tue, May 5, 2015 at 4:42 AM, Moore, Douglas < > douglas.mo...@think

Re: Unable to move files on Hive/Hdfs

2015-05-04 Thread amit kumar
Do you have any suggestion to resolve this issue, I am looking for a resolution. On Tue, May 5, 2015 at 4:42 AM, Moore, Douglas < douglas.mo...@thinkbiganalytics.com> wrote: > Yep, permission problem. Weird though it seems to be moving a file > within the same dir. > > Thanks for the update! >

Re: Unable to move files on Hive/Hdfs

2015-05-04 Thread Moore, Douglas
Yep, permission problem. Weird though it seems to be moving a file within the same dir. Thanks for the update! - Douglas From: amit kumar mailto:ak3...@gmail.com>> Reply-To: mailto:user@hive.apache.org>> Date: Tue, 5 May 2015 04:40:18 +0530 To: mailto:user@hive.apache.org>> Subject: Re: Unable to

Re: Unable to move files on Hive/Hdfs

2015-05-04 Thread amit kumar
Hi Doug, I have use CDH 5.2.1 I performed the below task, and getting the error, but after rolling back the below changes issue has been resolved itself. Disable ACLs on Name Nodes Set Enable Access Control Lists = False Save Changes Restart Hadoop Cluster Thanks, On Tue, May 5, 2015 at 4:36

Re: Unable to move files on Hive/Hdfs

2015-05-04 Thread amit kumar
Hi Doug, I have use CDH 5.2.1 Disable ACLs on Name Nodes Set Enable Access Control Lists = False Save Changes Restart Hadoop Cluster Stack trace: 2015-05-04 10:38:18,820 INFO [main]: exec.Task (SessionState.java:printInfo(537)) - Moving data to: hdfs://nameservice1/tmp/hive-srv-hdp-edh-d

Re: Unable to move files on Hive/Hdfs

2015-05-04 Thread Moore, Douglas
Hi Amit, We've seen the same error on MoveTask with Hive 0.14 / HDP 2.2 release. There are lots of reasons for this though. Can you provide more details about the stack trace and version so we can compare? For our problem we've seen some relief with SET hive.metastore.client.socket.timeout=60s

Re: Writing Sequence Files

2015-05-04 Thread Owen O'Malley
On Mon, May 4, 2015 at 11:02 AM, Grant Overby (groverby) wrote: > I’m looking for some sample code to write a hive compatible sequence > file for an external table and matching ddl. > In general the easiest way is to create a table with what you'd like to have and use Hive to write to table li

Unable to move files on Hive/Hdfs

2015-05-04 Thread amit kumar
While moving the data from hive/hdfs we get below error, Please suggest on this. Moving data to: hdfs://nameservice1/tmp/hive-srv-hdp-edh-d/hive_2015-05-04_10-02-39_841_5305383954203911235-1/-ext-1 Failed with exception Unable to move sourcehdfs://nameservice1/tmp/hive-srv-hdp-edh-d/hive_2015

Writing Sequence Files

2015-05-04 Thread Grant Overby (groverby)
I’m looking for some sample code to write a hive compatible sequence file for an external table and matching ddl. I’m starting with a java pojo. I can create an Object Inspector for this class. I’m reasonably sure I can write a serde leveraging java’s externalizable serialization. I’m coming up

Re: A request for Hive wiki space edit permissions

2015-05-04 Thread Sergey Tryuber
Thanks, Lefty! On 4 May 2015 at 01:24, Lefty Leverenz wrote: > Done. Welcome to the Hive wiki team, Sergey! > > -- Lefty > > On Sun, May 3, 2015 at 11:48 AM, Sergey Tryuber > wrote: > >> Hello, >> >> According to the instructions >>

Re: Re: join on different data type

2015-05-04 Thread r7raul1...@163.com
IF join on A.col1 == B.col2 col1 is string col2 is bigint The automatic conversion is support? All cast to string? r7raul1...@163.com From: Gopal Vijayaraghavan Date: 2015-05-04 16:10 To: user CC: r7raul1...@163.com Subject: Re: join on different data type > If A.col1 is of DOUBLE type, >

Re: Re: join on different data type

2015-05-04 Thread r7raul1...@163.com
Thank you! r7raul1...@163.com From: Gopal Vijayaraghavan Date: 2015-05-04 16:10 To: user CC: r7raul1...@163.com Subject: Re: join on different data type > If A.col1 is of DOUBLE type, > but B.col2 is of BIGINT, The automatic conversion is not acceptable according to the java language spe

Re: join on different data type

2015-05-04 Thread Gopal Vijayaraghavan
> If A.col1 is of DOUBLE type, > but B.col2 is of BIGINT, The automatic conversion is not acceptable according to the java language spec (section 5.1.2) https://docs.oracle.com/javase/specs/jls/se7/html/jls-5.html#jls-5.1.2 Also to be noted here is that in general, that even if you cast, you