RE: Table count is more than File count after loading in hive

2017-05-30 Thread balajee venkatesh
x filename*”. *From:* shakti singh Shekhawat [mailto:shaktisingh.shekhawa...@gmail.com] *Sent:* 30 May 2017 10:02 *To:* user@hive.apache.org *Subject:* Re: Table count is more than File count after loading in hive Hi Balajee, The best way will be to clean the file in Unix(or perl or python) befo

RE: Table count is more than File count after loading in hive

2017-05-29 Thread JP gupta
@hive.apache.org Subject: Re: Table count is more than File count after loading in hive Hi Balajee, The best way will be to clean the file in Unix(or perl or python) before loading the file in HIVE. The root cause should be most probably carriage return(occurs as mostly the files generated on

Re: Table count is more than File count after loading in hive

2017-05-29 Thread shakti singh Shekhawat
Hi Balajee, The best way will be to clean the file in Unix(or perl or python) before loading the file in HIVE. The root cause should be most probably carriage return(occurs as mostly the files generated on Microsoft platform consists of ^M characters in file). To identify whether carriage return i

Table count is more than File count after loading in hive

2017-05-29 Thread balajee venkatesh
Hi, Table count should be equal to the the number of records in in the source file but in my case it is more than the file count. Suppose the input file is having 1000 records but when I load this file data in the newly created table it becomes 1018. The table is having 80 columns so it is very di