Re: Reducer throwing warning during join operations.Defaulting int columns to 0

2012-08-16 Thread Himanish Kushary
Hi, To address this issue , for now I have changed the all my fields in the external tables to STRING datatype.The joins on external tables are working fine now. Will try to change the datatype while transforming to Hive managed table and re-execute the joins on the new tables. Any other suggesti

Re: Reducer throwing warning during join operations.Defaulting int columns to 0

2012-08-15 Thread Himanish Kushary
Thanks Nitin..but to take care of that I had cleaned the csv files of leading and trailing spaces before putting into hdfs.Also ran the dos2unix command on the csv files. Only if I define the external table with all fields data type as STRING the joins perform properly.Even when load the data init

Re: Reducer throwing warning during join operations.Defaulting int columns to 0

2012-08-15 Thread Nitin Pawar
it might be the case that there are few empty spaces at the end of each row which are being handled when you are reading and writing from disc but when you set autoconvert then looks like one of these tables is really small and it is converted into mapside join which means the entire table is loa

Reducer throwing warning during join operations.Defaulting int columns to 0

2012-08-15 Thread Himanish Kushary
Hi, I have uploaded few csv files from windows into hive and configured few external tables using them. When I am trying to run a join on two tables one of the int columns get changed to 0. The structure of the tables are as follows: Table-1Table-2 ---