[
https://issues.apache.org/jira/browse/SQOOP-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14554287#comment-14554287
]
John Pickard commented on SQOOP-2363:
-------------------------------------
This command works:
/usr/bin/sqoop export --connect jdbc:mysql://master.jpickard/tempdb --username
testimator -P --table test -m 1 --export-dir /tmp/jpickard/sqoop/test
--optionally-enclosed-by \' --escaped-by \\ --fields-terminated-by ,
--lines-terminated-by \n
This command fails:
/usr/bin/sqoop export --connect jdbc:mysql://master.jpickard/tempdb --username
testimator -P --table test -m 1 --export-dir /tmp/jpickard/sqoop/test
--optionally-enclosed-by \' --escaped-by \\ --fields-terminated-by ,
--lines-terminated-by \n --direct
Here are the full logs from a mapper of a failed export job. These mappers were
killed after a timeout:
2015-05-20 10:21:43,305 WARN [main]
org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration:
tried hadoop-metrics2-maptask.properties,hadoop-metrics2.properties
2015-05-20 10:21:43,434 INFO [main]
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at
10 second(s).
2015-05-20 10:21:43,434 INFO [main]
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MapTask metrics system
started
2015-05-20 10:21:43,455 INFO [main] org.apache.hadoop.mapred.YarnChild:
Executing with tokens:
2015-05-20 10:21:43,455 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind:
mapreduce.job, Service: job_1431630776161_0121, Ident:
(org.apache.hadoop.mapreduce.security.token.JobTokenIdentifier@58ebfe0)
2015-05-20 10:21:43,649 INFO [main] org.apache.hadoop.mapred.YarnChild:
Sleeping for 0ms before retrying again. Got null now.
2015-05-20 10:21:44,156 INFO [main] org.apache.hadoop.mapred.YarnChild:
mapreduce.cluster.local.dir for child:
/hadoop/yarn/local/usercache/jpickard/appcache/application_1431630776161_0121
2015-05-20 10:21:45,036 INFO [main]
org.apache.hadoop.conf.Configuration.deprecation: session.id is deprecated.
Instead, use dfs.metrics.session-id
2015-05-20 10:21:45,650 INFO [main] org.apache.hadoop.mapred.Task: Using
ResourceCalculatorProcessTree : [ ]
2015-05-20 10:21:45,947 INFO [main] org.apache.hadoop.mapred.MapTask:
Processing split: Paths:/tmp/jpickard/sqoop/test/part-m-00000:0+85
2015-05-20 10:21:45,952 INFO [main]
org.apache.hadoop.conf.Configuration.deprecation: map.input.file is deprecated.
Instead, use mapreduce.map.input.file
2015-05-20 10:21:45,952 INFO [main]
org.apache.hadoop.conf.Configuration.deprecation: map.input.start is
deprecated. Instead, use mapreduce.map.input.start
2015-05-20 10:21:45,952 INFO [main]
org.apache.hadoop.conf.Configuration.deprecation: map.input.length is
deprecated. Instead, use mapreduce.map.input.length
2015-05-20 10:21:46,017 INFO [main]
org.apache.hadoop.conf.Configuration.deprecation: mapred.task.timeout is
deprecated. Instead, use mapreduce.task.timeout
2015-05-20 10:21:46,018 INFO [main]
org.apache.hadoop.conf.Configuration.deprecation: job.local.dir is deprecated.
Instead, use mapreduce.job.local.dir
2015-05-20 10:21:46,018 INFO [main]
org.apache.hadoop.conf.Configuration.deprecation: mapred.task.id is deprecated.
Instead, use mapreduce.task.attempt.id
2015-05-20 10:21:46,036 INFO [main] org.apache.sqoop.io.NamedFifo: mknod output:
2015-05-20 10:21:46,106 INFO [Thread-13]
org.apache.sqoop.mapreduce.MySQLExportMapper: mysqlimport: unknown variable
'escaped-by=0x5c'
> wrong option for escape character with mysqlimport
> --------------------------------------------------
>
> Key: SQOOP-2363
> URL: https://issues.apache.org/jira/browse/SQOOP-2363
> Project: Sqoop
> Issue Type: Bug
> Components: connectors/mysql
> Reporter: Abraham Elmahrek
> Fix For: 1.4.7
>
>
> {{\-\-fields-escaped-by}} seems right
> (https://dev.mysql.com/doc/refman/5.6/en/mysqlimport.html). Sqoop seems to be
> used {{\-\-escaped-by}}
> (https://git-wip-us.apache.org/repos/asf?p=sqoop.git;a=blob;f=src/java/org/apache/sqoop/mapreduce/MySQLExportMapper.java;h=5a695ca80bb0e2e2baffb909339b1078b8bedbdb;hb=HEAD)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
