Re: Controlling Number of small files while inserting into Hive table

2017-07-06 Thread Arpan Rajani
the issue. "insert into 'target_table' select a,b,c from x where ... distribute by (date)" PS: Backdated processing will generate additional file(s). One file per load. Thanks, Saurabh Sent from my iPhone, please avoid typos. On 22-Jun-2017, at 11:30 AM, Arpan Rajani wrote: He

Controlling Number of small files while inserting into Hive table

2017-06-21 Thread Arpan Rajani
Hello everyone, I am sure many of you might have faced similar issue. We do "insert into 'target_table' select a,b,c from x where .." kind of queries for a nightly load. This insert goes in a new partition of the target_table. Now the concern is : *this inserts load hardly any data* ( I would s

Re: Hive CLI not starting

2015-11-24 Thread Arpan Rajani
YARN : Failed to renew token: > Kind: TIMELINE_DELEGATION_TOKEN, Service: 10.25.100.118:8188, Ident: > (owner=hduser, renewer=yarn, realUser=, issueDate=1436827743392, > maxDate=1437432543392, sequenceNumber=36, masterKeyId=16) > > at > org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.subm

Re: Unable to connect to beeline after kerberos is installed

2015-11-24 Thread Arpan Rajani
Hi Jay, I faced this and fixed yesterday. There are two things. 1)Before connecting to Hive server do you have a valid TGT? Do $ kinit u...@realm.com and get a valid TGT 2) in the jdbc connect string use the hive principle Use "!connect jdbc:hive2://:/;principal=”. Please make sure it is the