SUMANG484 commented on issue #25: Use mysql to import data from hdfs to the database when sqoop.mysql.e… URL: https://github.com/apache/sqoop/pull/25#issuecomment-469619467 sqoop-import --connect jdbc:mysql://localhost/demodb --username demo -P --table pet --m 1 Warning: /usr/local/hbase does not exist! HBase imports will fail. Please set $HBASE_HOME to the root of your HBase installation. Warning: /usr/lib/sqoop/../hcatalog does not exist! HCatalog jobs will fail. Please set $HCAT_HOME to the root of your HCatalog installation. Warning: /usr/lib/sqoop/../accumulo does not exist! Accumulo imports will fail. Please set $ACCUMULO_HOME to the root of your Accumulo installation. Warning: /usr/lib/sqoop/../zookeeper does not exist! Accumulo imports will fail. Please set $ZOOKEEPER_HOME to the root of your Zookeeper installation. 19/03/05 15:23:32 INFO sqoop.Sqoop: Running Sqoop version: 1.4.7 Enter password: 19/03/05 15:23:34 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset. 19/03/05 15:23:34 INFO tool.CodeGenTool: Beginning code generation Tue Mar 05 15:23:35 IST 2019 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 19/03/05 15:23:35 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `pet` AS t LIMIT 1 19/03/05 15:23:35 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `pet` AS t LIMIT 1 19/03/05 15:23:35 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /usr/local/hadoop Note: /tmp/sqoop-root/compile/6695864bcc4b6af0f5a8c9bffd618ad2/pet.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. 19/03/05 15:23:37 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-root/compile/6695864bcc4b6af0f5a8c9bffd618ad2/pet.jar 19/03/05 15:23:37 WARN manager.MySQLManager: It looks like you are importing from mysql. 19/03/05 15:23:37 WARN manager.MySQLManager: This transfer can be faster! Use the --direct 19/03/05 15:23:37 WARN manager.MySQLManager: option to exercise a MySQL-specific fast path. 19/03/05 15:23:37 INFO manager.MySQLManager: Setting zero DATETIME behavior to convertToNull (mysql) 19/03/05 15:23:37 INFO mapreduce.ImportJobBase: Beginning import of pet 19/03/05 15:23:37 INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.apache.hadoop.security.authentication.util.KerberosUtil (file:/usr/local/hadoop/share/hadoop/common/lib/hadoop-auth-2.6.5.jar) to method sun.security.krb5.Config.getInstance() WARNING: Please consider reporting this to the maintainers of org.apache.hadoop.security.authentication.util.KerberosUtil WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release 19/03/05 15:23:37 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 19/03/05 15:23:37 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar 19/03/05 15:23:38 INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address 19/03/05 15:23:38 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps 19/03/05 15:23:38 INFO Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id 19/03/05 15:23:38 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId= Tue Mar 05 15:23:39 IST 2019 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. 19/03/05 15:23:39 INFO db.DBInputFormat: Using read commited transaction isolation 19/03/05 15:23:39 INFO mapreduce.JobSubmitter: number of splits:1 19/03/05 15:23:39 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_local562596839_0001 19/03/05 15:23:40 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619572/ant-eclipse-1.0-jvm1.2.jar <- /usr/lib/sqoop/ant-eclipse-1.0-jvm1.2.jar 19/03/05 15:23:40 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/ant-eclipse-1.0-jvm1.2.jar as file:/app/hadoop/tmp/mapred/local/1551779619572/ant-eclipse-1.0-jvm1.2.jar 19/03/05 15:23:40 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619573/mysql-connector-java-5.1.46-bin.jar <- /usr/lib/sqoop/mysql-connector-java-5.1.46-bin.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/mysql-connector-java-5.1.46-bin.jar as file:/app/hadoop/tmp/mapred/local/1551779619573/mysql-connector-java-5.1.46-bin.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619574/paranamer-2.7.jar <- /usr/lib/sqoop/paranamer-2.7.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/paranamer-2.7.jar as file:/app/hadoop/tmp/mapred/local/1551779619574/paranamer-2.7.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619575/commons-jexl-2.1.1.jar <- /usr/lib/sqoop/commons-jexl-2.1.1.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/commons-jexl-2.1.1.jar as file:/app/hadoop/tmp/mapred/local/1551779619575/commons-jexl-2.1.1.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619576/commons-codec-1.4.jar <- /usr/lib/sqoop/commons-codec-1.4.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/commons-codec-1.4.jar as file:/app/hadoop/tmp/mapred/local/1551779619576/commons-codec-1.4.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619577/jackson-core-2.3.1.jar <- /usr/lib/sqoop/jackson-core-2.3.1.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/jackson-core-2.3.1.jar as file:/app/hadoop/tmp/mapred/local/1551779619577/jackson-core-2.3.1.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619578/parquet-jackson-1.6.0.jar <- /usr/lib/sqoop/parquet-jackson-1.6.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/parquet-jackson-1.6.0.jar as file:/app/hadoop/tmp/mapred/local/1551779619578/parquet-jackson-1.6.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619579/jackson-annotations-2.3.1.jar <- /usr/lib/sqoop/jackson-annotations-2.3.1.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/jackson-annotations-2.3.1.jar as file:/app/hadoop/tmp/mapred/local/1551779619579/jackson-annotations-2.3.1.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619580/parquet-hadoop-1.6.0.jar <- /usr/lib/sqoop/parquet-hadoop-1.6.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/parquet-hadoop-1.6.0.jar as file:/app/hadoop/tmp/mapred/local/1551779619580/parquet-hadoop-1.6.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619581/commons-logging-1.1.1.jar <- /usr/lib/sqoop/commons-logging-1.1.1.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/commons-logging-1.1.1.jar as file:/app/hadoop/tmp/mapred/local/1551779619581/commons-logging-1.1.1.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619582/opencsv-2.3.jar <- /usr/lib/sqoop/opencsv-2.3.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/opencsv-2.3.jar as file:/app/hadoop/tmp/mapred/local/1551779619582/opencsv-2.3.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619583/hsqldb-1.8.0.10.jar <- /usr/lib/sqoop/hsqldb-1.8.0.10.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/hsqldb-1.8.0.10.jar as file:/app/hadoop/tmp/mapred/local/1551779619583/hsqldb-1.8.0.10.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619584/kite-data-hive-1.1.0.jar <- /usr/lib/sqoop/kite-data-hive-1.1.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/kite-data-hive-1.1.0.jar as file:/app/hadoop/tmp/mapred/local/1551779619584/kite-data-hive-1.1.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619585/xz-1.5.jar <- /usr/lib/sqoop/xz-1.5.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/xz-1.5.jar as file:/app/hadoop/tmp/mapred/local/1551779619585/xz-1.5.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619586/commons-lang3-3.4.jar <- /usr/lib/sqoop/commons-lang3-3.4.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/commons-lang3-3.4.jar as file:/app/hadoop/tmp/mapred/local/1551779619586/commons-lang3-3.4.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619587/parquet-column-1.6.0.jar <- /usr/lib/sqoop/parquet-column-1.6.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/parquet-column-1.6.0.jar as file:/app/hadoop/tmp/mapred/local/1551779619587/parquet-column-1.6.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619588/kite-data-mapreduce-1.1.0.jar <- /usr/lib/sqoop/kite-data-mapreduce-1.1.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/kite-data-mapreduce-1.1.0.jar as file:/app/hadoop/tmp/mapred/local/1551779619588/kite-data-mapreduce-1.1.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619589/jackson-core-asl-1.9.13.jar <- /usr/lib/sqoop/jackson-core-asl-1.9.13.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/jackson-core-asl-1.9.13.jar as file:/app/hadoop/tmp/mapred/local/1551779619589/jackson-core-asl-1.9.13.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619590/parquet-generator-1.6.0.jar <- /usr/lib/sqoop/parquet-generator-1.6.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/parquet-generator-1.6.0.jar as file:/app/hadoop/tmp/mapred/local/1551779619590/parquet-generator-1.6.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619591/jackson-databind-2.3.1.jar <- /usr/lib/sqoop/jackson-databind-2.3.1.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/jackson-databind-2.3.1.jar as file:/app/hadoop/tmp/mapred/local/1551779619591/jackson-databind-2.3.1.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619592/parquet-common-1.6.0.jar <- /usr/lib/sqoop/parquet-common-1.6.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/parquet-common-1.6.0.jar as file:/app/hadoop/tmp/mapred/local/1551779619592/parquet-common-1.6.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619593/avro-1.8.1.jar <- /usr/lib/sqoop/avro-1.8.1.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/avro-1.8.1.jar as file:/app/hadoop/tmp/mapred/local/1551779619593/avro-1.8.1.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619594/snappy-java-1.1.1.6.jar <- /usr/lib/sqoop/snappy-java-1.1.1.6.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/snappy-java-1.1.1.6.jar as file:/app/hadoop/tmp/mapred/local/1551779619594/snappy-java-1.1.1.6.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619595/kite-hadoop-compatibility-1.1.0.jar <- /usr/lib/sqoop/kite-hadoop-compatibility-1.1.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/kite-hadoop-compatibility-1.1.0.jar as file:/app/hadoop/tmp/mapred/local/1551779619595/kite-hadoop-compatibility-1.1.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619596/parquet-avro-1.6.0.jar <- /usr/lib/sqoop/parquet-avro-1.6.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/parquet-avro-1.6.0.jar as file:/app/hadoop/tmp/mapred/local/1551779619596/parquet-avro-1.6.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619597/slf4j-api-1.6.1.jar <- /usr/lib/sqoop/slf4j-api-1.6.1.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/slf4j-api-1.6.1.jar as file:/app/hadoop/tmp/mapred/local/1551779619597/slf4j-api-1.6.1.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619598/ant-contrib-1.0b3.jar <- /usr/lib/sqoop/ant-contrib-1.0b3.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/ant-contrib-1.0b3.jar as file:/app/hadoop/tmp/mapred/local/1551779619598/ant-contrib-1.0b3.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619599/avro-mapred-1.8.1-hadoop2.jar <- /usr/lib/sqoop/avro-mapred-1.8.1-hadoop2.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/avro-mapred-1.8.1-hadoop2.jar as file:/app/hadoop/tmp/mapred/local/1551779619599/avro-mapred-1.8.1-hadoop2.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/sqoop-1.4.7.jar as file:/app/hadoop/tmp/mapred/local/1551779619600/sqoop-1.4.7.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619601/commons-io-1.4.jar <- /usr/lib/sqoop/commons-io-1.4.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/commons-io-1.4.jar as file:/app/hadoop/tmp/mapred/local/1551779619601/commons-io-1.4.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619602/parquet-format-2.2.0-rc1.jar <- /usr/lib/sqoop/parquet-format-2.2.0-rc1.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/parquet-format-2.2.0-rc1.jar as file:/app/hadoop/tmp/mapred/local/1551779619602/parquet-format-2.2.0-rc1.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619603/kite-data-core-1.1.0.jar <- /usr/lib/sqoop/kite-data-core-1.1.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/kite-data-core-1.1.0.jar as file:/app/hadoop/tmp/mapred/local/1551779619603/kite-data-core-1.1.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619604/commons-compress-1.8.1.jar <- /usr/lib/sqoop/commons-compress-1.8.1.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/commons-compress-1.8.1.jar as file:/app/hadoop/tmp/mapred/local/1551779619604/commons-compress-1.8.1.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619605/jackson-mapper-asl-1.9.13.jar <- /usr/lib/sqoop/jackson-mapper-asl-1.9.13.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/jackson-mapper-asl-1.9.13.jar as file:/app/hadoop/tmp/mapred/local/1551779619605/jackson-mapper-asl-1.9.13.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Creating symlink: /app/hadoop/tmp/mapred/local/1551779619606/parquet-encoding-1.6.0.jar <- /usr/lib/sqoop/parquet-encoding-1.6.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: Localized file:/usr/lib/sqoop/lib/parquet-encoding-1.6.0.jar as file:/app/hadoop/tmp/mapred/local/1551779619606/parquet-encoding-1.6.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619572/ant-eclipse-1.0-jvm1.2.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619573/mysql-connector-java-5.1.46-bin.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619574/paranamer-2.7.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619575/commons-jexl-2.1.1.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619576/commons-codec-1.4.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619577/jackson-core-2.3.1.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619578/parquet-jackson-1.6.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619579/jackson-annotations-2.3.1.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619580/parquet-hadoop-1.6.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619581/commons-logging-1.1.1.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619582/opencsv-2.3.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619583/hsqldb-1.8.0.10.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619584/kite-data-hive-1.1.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619585/xz-1.5.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619586/commons-lang3-3.4.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619587/parquet-column-1.6.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619588/kite-data-mapreduce-1.1.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619589/jackson-core-asl-1.9.13.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619590/parquet-generator-1.6.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619591/jackson-databind-2.3.1.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619592/parquet-common-1.6.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619593/avro-1.8.1.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619594/snappy-java-1.1.1.6.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619595/kite-hadoop-compatibility-1.1.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619596/parquet-avro-1.6.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619597/slf4j-api-1.6.1.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619598/ant-contrib-1.0b3.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619599/avro-mapred-1.8.1-hadoop2.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619600/sqoop-1.4.7.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619601/commons-io-1.4.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619602/parquet-format-2.2.0-rc1.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619603/kite-data-core-1.1.0.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619604/commons-compress-1.8.1.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619605/jackson-mapper-asl-1.9.13.jar 19/03/05 15:23:41 INFO mapred.LocalDistributedCacheManager: file:/app/hadoop/tmp/mapred/local/1551779619606/parquet-encoding-1.6.0.jar 19/03/05 15:23:41 INFO mapreduce.Job: The url to track the job: http://localhost:8080/ 19/03/05 15:23:41 INFO mapreduce.Job: Running job: job_local562596839_0001 19/03/05 15:23:41 INFO mapred.LocalJobRunner: OutputCommitter set in config null 19/03/05 15:23:41 INFO mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter 19/03/05 15:23:41 WARN mapred.LocalJobRunner: job_local562596839_0001 org.apache.hadoop.security.AccessControlException: Permission denied: user=root, access=WRITE, inode="/":hduser:supergroup:drwxr-xr-x at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkFsPermission(FSPermissionChecker.java:271) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:257) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:238) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:179) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:6547) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:6529) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkAncestorAccess(FSNamesystem.java:6481) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirsInternal(FSNamesystem.java:4290) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirsInt(FSNamesystem.java:4260) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:4233) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:853) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:600) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:619) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:975) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2040) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2036) at java.base/java.security.AccessController.doPrivileged(Native Method) at java.base/javax.security.auth.Subject.doAs(Subject.java:423) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1692) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2034) at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.base/java.lang.reflect.Constructor.newInstance(Constructor.java:490) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:73) at org.apache.hadoop.hdfs.DFSClient.primitiveMkdir(DFSClient.java:2744) at org.apache.hadoop.hdfs.DFSClient.mkdirs(DFSClient.java:2713) at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:870) at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:866) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.mkdirsInternal(DistributedFileSystem.java:866) at org.apache.hadoop.hdfs.DistributedFileSystem.mkdirs(DistributedFileSystem.java:859) at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:1819) at org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter.setupJob(FileOutputCommitter.java:291) at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:511) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Permission denied: user=root, access=WRITE, inode="/":hduser:supergroup:drwxr-xr-x at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkFsPermission(FSPermissionChecker.java:271) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:257) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:238) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:179) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:6547) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:6529) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkAncestorAccess(FSNamesystem.java:6481) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirsInternal(FSNamesystem.java:4290) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirsInt(FSNamesystem.java:4260) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:4233) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:853) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:600) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:619) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:975) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2040) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2036) at java.base/java.security.AccessController.doPrivileged(Native Method) at java.base/javax.security.auth.Subject.doAs(Subject.java:423) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1692) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2034) at org.apache.hadoop.ipc.Client.call(Client.java:1470) at org.apache.hadoop.ipc.Client.call(Client.java:1401) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at com.sun.proxy.$Proxy12.mkdirs(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.mkdirs(ClientNamenodeProtocolTranslatorPB.java:539) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102) at com.sun.proxy.$Proxy13.mkdirs(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.primitiveMkdir(DFSClient.java:2742) ... 9 more 19/03/05 15:23:42 INFO mapreduce.Job: Job job_local562596839_0001 running in uber mode : false 19/03/05 15:23:42 INFO mapreduce.Job: map 0% reduce 0% 19/03/05 15:23:42 INFO mapreduce.Job: Job job_local562596839_0001 failed with state FAILED due to: NA 19/03/05 15:23:42 INFO mapreduce.Job: Counters: 0 19/03/05 15:23:42 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead 19/03/05 15:23:42 INFO mapreduce.ImportJobBase: Transferred 0 bytes in 3.9343 seconds (0 bytes/sec) 19/03/05 15:23:42 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead 19/03/05 15:23:42 INFO mapreduce.ImportJobBase: Retrieved 0 records. 19/03/05 15:23:42 ERROR tool.ImportTool: Import failed: Import job failed! thank you for the help i have been facing this problem with sqoop kindly guide me possible solutions as soon as possible
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
