Re: Export hive table format issue

2013-06-19 Thread Hamza Asad
Thnx alot Nitin and all, Thats the root cause. Field separator was default i.e ^A and the above issue u have mentioned. Thnx again :) Stay Blessed On Wed, Jun 19, 2013 at 10:21 AM, Nitin Pawar wrote: > Jarek, > > Any chances that Hamza is hitting this one SQOOP-188: Problem with NULL > values in

Re: Export hive table format issue

2013-06-18 Thread Nitin Pawar
Jarek, Any chances that Hamza is hitting this one SQOOP-188: Problem with NULL values in MySQL export In that case I would recommend him to use --input-null-string "N" --input-null-non-string "N" Hamza, can you try above options On Wed,

Re: Export hive table format issue

2013-06-18 Thread Jarek Jarcec Cecho
Would you mind upgrading Sqoop to version 1.4.3? We've significantly improved error logging for case when the input data can't be parsed during export. You should get state dump (exception, input file, position in the file, entire input line) available in the associated map task log. Jarcec O

Re: Export hive table format issue

2013-06-18 Thread Arafat, Moiz
Can you try using default value ex 0 or 999 instead of storing NULL in the numeric column on hive side ? Thanks, Moiz Arafat On Jun 18, 2013, at 9:14 AM, Hamza Asad mailto:hamza.asa...@gmail.com>> wrote: Nitin, Issue is not with the INT or BIGINT (as i have verified both), exception

Re: Export hive table format issue

2013-06-18 Thread Hamza Asad
Nitin, Issue is not with the INT or BIGINT (as i have verified both), exception is same.. Issue is with some thing else.. Please sort out any solution... following exception still raising (# in input string is not visible in terminal and is translated to # when copied to office writer which

Re: Export hive table format issue

2013-06-18 Thread Nitin Pawar
can you change your mysql schema to have bigint instead of just int. for more you can refer this http://stackoverflow.com/questions/16886668/why-sqoop-fails-on-numberformatexception-for-numeric-column-during-the-export-fr On Tue, Jun 18, 2013 at 5:52 PM, Hamza Asad wrote: > Attached are the sch

Re: Export hive table format issue

2013-06-18 Thread Hamza Asad
Attached are the schema files of both HIVE and mySql tables On Tue, Jun 18, 2013 at 5:11 PM, Nitin Pawar wrote: > for the number format exception, can you share your mysql schema (put as > attachment and not inline in mail). If you have created table with int .. > try to switch the column with

Re: Export hive table format issue

2013-06-18 Thread Nitin Pawar
for the number format exception, can you share your mysql schema (put as attachment and not inline in mail). If you have created table with int .. try to switch the column with bigint On Tue, Jun 18, 2013 at 5:37 PM, Hamza Asad wrote: > I have copy paste the ROW in office writer where i saw i

Re: Export hive table format issue

2013-06-18 Thread Hamza Asad
I have copy paste the ROW in office writer where i saw its # separated... yeah \N values representing NULL.. the version of sqoop is *Sqoop 1.4.2 git commit id Compiled by ag on Tue Aug 14 17:37:19 IST 2012* On Tue, Jun 18, 2013 at 5:01 PM, Nitin Pawar wrote: > is "#" your field separator? > als

Re: Export hive table format issue

2013-06-18 Thread Nitin Pawar
is "#" your field separator? also the separator is normally an octal representation so you can give it a try. why does your columns have \N as values? is it for NULL ? what version of sqoop are you using? On Tue, Jun 18, 2013 at 5:00 PM, Hamza Asad wrote: > im executing following command* > s

Re: Export hive table format issue

2013-06-18 Thread Hamza Asad
im executing following command* sqoop export --connect jdbc:mysql://localhost/ --table dump_hive_events_details --export-dir hive/warehouse/.db/events_details --input-null-non-string \N --input-fields-terminated-by '#' --username --password x* * 13/06/18 16:26:44 INFO mapre

Re: Export hive table format issue

2013-06-18 Thread Nitin Pawar
check the option --input-fields-terminated-by in sqoop export On Tue, Jun 18, 2013 at 4:31 PM, Hamza Asad wrote: > I want to export my table in mysql and for that i'm using sqoop export > command but in HDFS i've data apparantly without any field seperator But it > does contain some field separ

Export hive table format issue

2013-06-18 Thread Hamza Asad
I want to export my table in mysql and for that i'm using sqoop export command but in HDFS i've data apparantly without any field seperator But it does contain some field separator. data is saved in the format as shown below *8119844144724992013-01-29 00:00:00.0141\N\N\N\N\N\N\N\N\N