[ 
https://issues.apache.org/jira/browse/SQOOP-3469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17070778#comment-17070778
 ] 

Pierre Arnaud Auque commented on SQOOP-3469:
--------------------------------------------

Thank you for your answer Thomas,

"org.apache.sqoop.submission.engine.mapreduce.configuration.directory"" , helps 
me to solve another error where Sqoop didn't find hadoop conf.

I tried to play with the bash file as you mentioned, but Sqoop still want to 
look for its library where I start the server. Even if its echo the following 
when the server start:

echo "Sqoop home directory: ${BASEDIR}"

SQOOP_CLIENT_LIB=${BASEDIR}/shell/lib
SQOOP_SERVER_LIB=${BASEDIR}/server/lib
SQOOP_TOOLS_LIB=${BASEDIR}/tools

 

with BASEDIR = /usr/bin/sqoop/

 

Regards,

 

> Bug when starting sqoop2 server
> -------------------------------
>
>                 Key: SQOOP-3469
>                 URL: https://issues.apache.org/jira/browse/SQOOP-3469
>             Project: Sqoop
>          Issue Type: Bug
>          Components: sqoop2-server
>    Affects Versions: 1.99.7
>         Environment:  
> Ubuntu docker container
> {color:#cc7832}with following pacakage {color}recommends \ssh \openjdk-8-jdk 
> \net-tools \netcat \
> +environement variable:+
> SQOOP_HOME=/usr/lib/sqoop/
> SQOOP_SERVER_EXTRA_LIB = /usr/lib/sqoop/server/lib
> YARN_RESOURCEMANAGER_USER=root
> YARN_NODEMANAGER_USER=root
> HDFS_NAMENODE_USER=root
> HDFS_DATANODE_USER=root
> HDFS_SECONDARYNAMENODE_USER=root
> PDSH_RCMD_TYPE=ssh
> +sqoop.properties unchanged exepect:+ 
> {color:#cc7832}org.apache.sqoop.submission.engine.mapreduce.configuration.directory{color}{color:#808080}={color}{color:#6a8759}/data/hadoop-3.2.1/bin
> {color}
>  
>            Reporter: Pierre Arnaud Auque
>            Priority: Major
>
>  
> Sqoop2 installed following the Apache online guide.
>  
> The command, I have done, from "/data" folder:
>  * sqoop2-tool upgrade ==> No Issue
>  * sqoop2-tool verifiy ==> bug Exception in thread "main" 
> java.lang.NoSuchMethodError: 
>  * sqoop2-server stop
>  * sqoop2-server start
>  
> Then I created conenctor and jobs for an import from mySQL to HDFS. When 
> starting the job the following error appears in the logs:
>  
> {color:#6897bb}org.apache.sqoop.common.SqoopException{color}: 
> CONN_0011:Failed to create ConnectorClassLoader
> {color:#6a8759} at 
> org.apache.sqoop.connector.ConnectorManagerUtils.createConnectorClassLoader(ConnectorManagerUtils.java:122)
> {color}{color:#6a8759} at 
> org.apache.sqoop.job.mr.MRUtils.initConnectorClassLoaders(MRUtils.java:52)
> {color}{color:#6a8759} at 
> org.apache.sqoop.job.mr.SqoopNullOutputFormat$SqoopDestroyerOutputCommitter.setupJob(SqoopNullOutputFormat.java:64)
> {color}{color:#6a8759} at 
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:541)
> {color}Caused by: 
> {color:#6897bb}java.security.PrivilegedActionException{color}: 
> {color:#6897bb}java.io.FileNotFoundException{color}: 
> /data/sqoop-{color:#9876aa}connector-generic-jdbc-1.99.7.jar{color} (No such 
> file or directory)
> {color:#6a8759} at java.security.AccessController.doPrivileged(Native Method)
> {color}{color:#6a8759} at 
> org.apache.sqoop.connector.ConnectorManagerUtils.createConnectorClassLoader(ConnectorManagerUtils.java:112)
> {color} ... {color:#9876aa}3{color} more
> Caused by: {color:#6897bb}java.io.FileNotFoundException{color}: 
> /data/sqoop-{color:#9876aa}connector-generic-jdbc-1.99.7.jar{color} (No such 
> file or directory)
>  
>  
>  
> It seems that the environement is not well configured, scoop wantes to find 
> its own lib where I started the server.
> If I start the server from sqoop/server/lib, it works.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to