[
https://issues.apache.org/jira/browse/SQOOP-3147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ahmed Kamal updated SQOOP-3147:
-------------------------------
Summary: Import data from MySQL To Hive Table in S3 in Parquet format
(was: Import data from MySQL To Hive External Table in S3 in Parquet format)
> Import data from MySQL To Hive Table in S3 in Parquet format
> ------------------------------------------------------------
>
> Key: SQOOP-3147
> URL: https://issues.apache.org/jira/browse/SQOOP-3147
> Project: Sqoop
> Issue Type: Bug
> Affects Versions: 1.4.6
> Reporter: Ahmed Kamal
>
> Using this command succeeds only if the Hive Table's location is HDFS. If the
> table is backed by S3 it throws a strange exception
> sqoop import --connect "jdbc:mysql://connectionUrl" --table "tableName"
> --as-parquetfile --verbose --username=uname --password=pass --hive-import
> --delete-target-dir --hive-database dev_kamal --hive-table customer_car_type
> --hive-overwrite -m 150
> *Exception :*
> 17/03/07 12:13:13 INFO hive.metastore: Trying to connect to metastore with
> URI thrift://ip-10-0-0-47.eu-west-1.compute.internal:9083
> 17/03/07 12:13:13 INFO hive.metastore: Opened a connection to metastore,
> current connections: 1
> 17/03/07 12:13:13 INFO hive.metastore: Connected to metastore.
> 17/03/07 12:13:17 DEBUG util.ClassLoaderStack: Restoring classloader:
> sun.misc.Launcher$AppClassLoader@3e9b1010
> 17/03/07 12:13:17 ERROR sqoop.Sqoop: Got exception running Sqoop:
> org.apache.avro.SchemaParseException:
> org.codehaus.jackson.JsonParseException: Unexpected end-of-input: was
> expecting closing quote for a string value
> at [Source: java.io.StringReader@3fb42ec7; line: 1, column: 6001]
> org.apache.avro.SchemaParseException:
> org.codehaus.jackson.JsonParseException: Unexpected end-of-input: was
> expecting closing quote for a string value
> at [Source: java.io.StringReader@3fb42ec7; line: 1, column: 6001]
> at org.apache.avro.Schema$Parser.parse(Schema.java:929)
> at org.apache.avro.Schema$Parser.parse(Schema.java:917)
> at
> org.kitesdk.data.DatasetDescriptor$Builder.schemaLiteral(DatasetDescriptor.java:475)
> at
> org.kitesdk.data.spi.hive.HiveUtils.descriptorForTable(HiveUtils.java:154)
> at
> org.kitesdk.data.spi.hive.HiveAbstractMetadataProvider.load(HiveAbstractMetadataProvider.java:104)
> at
> org.kitesdk.data.spi.filesystem.FileSystemDatasetRepository.load(FileSystemDatasetRepository.java:192)
> at org.kitesdk.data.Datasets.load(Datasets.java:108)
> at org.kitesdk.data.Datasets.load(Datasets.java:165)
> at org.kitesdk.data.Datasets.load(Datasets.java:187)
> at
> org.apache.sqoop.mapreduce.ParquetJob.configureImportJob(ParquetJob.java:78)
> at
> org.apache.sqoop.mapreduce.DataDrivenImportJob.configureMapper(DataDrivenImportJob.java:108)
> at
> org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:260)
> at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:673)
> at
> org.apache.sqoop.manager.MySQLManager.importTable(MySQLManager.java:118)
> at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:497)
> at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)
> at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
> at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
> at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
> at org.apache.sqoop.Sqoop.main(Sqoop.java:236)
> Caused by: org.codehaus.jackson.JsonParseException: Unexpected end-of-input:
> was expecting closing quote for a string value
> at [Source: java.io.StringReader@3fb42ec7; line: 1, column: 6001]
> at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1433)
> at
> org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:521)
> at
> org.codehaus.jackson.impl.JsonParserMinimalBase._reportInvalidEOF(JsonParserMinimalBase.java:454)
> at
> org.codehaus.jackson.impl.ReaderBasedParser._finishString2(ReaderBasedParser.java:1342)
> at
> org.codehaus.jackson.impl.ReaderBasedParser._finishString(ReaderBasedParser.java:1330)
> at
> org.codehaus.jackson.impl.ReaderBasedParser.getText(ReaderBasedParser.java:200)
> at
> org.codehaus.jackson.map.deser.std.BaseNodeDeserializer.deserializeObject(JsonNodeDeserializer.java:203)
> at
> org.codehaus.jackson.map.deser.std.BaseNodeDeserializer.deserializeArray(JsonNodeDeserializer.java:224)
> at
> org.codehaus.jackson.map.deser.std.BaseNodeDeserializer.deserializeObject(JsonNodeDeserializer.java:200)
> at
> org.codehaus.jackson.map.deser.std.JsonNodeDeserializer.deserialize(JsonNodeDeserializer.java:58)
> at
> org.codehaus.jackson.map.deser.std.JsonNodeDeserializer.deserialize(JsonNodeDeserializer.java:15)
> at
> org.codehaus.jackson.map.ObjectMapper._readValue(ObjectMapper.java:2704)
> at
> org.codehaus.jackson.map.ObjectMapper.readTree(ObjectMapper.java:1344)
> at org.apache.avro.Schema$Parser.parse(Schema.java:927)
> ... 21 more
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
