hi, To run the terminal on the server, you need to open a port on the server to let the notebook and terminal communicate.
Currently using a random port. Consider adding a parameter to the specified port in the shell's interpreter configuration as per your suggestion. I am going to create an issue, and I will complete this task some time later. Terminal in docker, you need to use docker bridge network, you should be able to remotely access the services of all ports in docker. > On Aug 30, 2019, at 12:16 AM, xiufeng liu <toxiuf...@gmail.com> wrote: > > Besides, the ip address 192.168.0.2 > <http://192.168.0.2:35599/?noteId=2EN14VVZ5¶graphId=paragraph_1567093498023_-273931001&t=1567093527757> > is my subnet ip address. The shell should obtain my public IP address, > instead of this subnet ip address. > http://192.168.0.2:35599?noteId=2EN14VVZ5¶graphId=paragraph_1567093498023_-273931001&t=1567093527757 > > <http://192.168.0.2:35599/?noteId=2EN14VVZ5¶graphId=paragraph_1567093498023_-273931001&t=1567093527757> > > On Thu, Aug 29, 2019 at 6:07 PM xiufeng liu <toxiuf...@gmail.com > <mailto:toxiuf...@gmail.com>> wrote: > Hi again, > > It might be due to the firewall as I run on a remote server. I copied to run > on my local desktop, and it can work fine. > I could see that it will open a random port for the shell, for example, > 35599, in my previous test, which is not good as the port might not be open. > I think it would be good if one can specify the port for the interactive > shell, e.g., in the configuration file? > > /Xiufeng > > On Thu, Aug 29, 2019 at 5:53 PM xiufeng liu <toxiuf...@gmail.com > <mailto:toxiuf...@gmail.com>> wrote: > Hi again, > I have tried not to use docker, but it is same. here is the log > > INFO [2019-08-29 15:45:18,840] ({ParallelScheduler-Worker-2} > AbstractScheduler.java[runJob]:142) - Job paragraph_1567093498023_-273931001 > finished by scheduler org.apache.zeppelin.shell.ShellInterpreter752743685 > INFO [2019-08-29 15:45:27,167] ({ParallelScheduler-Worker-1} > AbstractScheduler.java[runJob]:116) - Job paragraph_1567093498023_-273931001 > started by scheduler org.apache.zeppelin.shell.TerminalInterpreter1624562114 > INFO [2019-08-29 15:45:27,183] ({ParallelScheduler-Worker-1} > Log.java[initialized]:193) - Logging initialized @13965ms to > org.eclipse.jetty.util.log.Slf4jLog > INFO [2019-08-29 15:45:27,190] ({ParallelScheduler-Worker-1} > TerminalInterpreter.java[internalInterpret]:114) - loop = 0 > WARN [2019-08-29 15:45:27,236] ({Thread-7} > ContextHandler.java[setContextPath]:1593) - > o.e.j.s.ServletContextHandler@71fa1926{/,null,UNAVAILABLE} contextPath ends > with / > INFO [2019-08-29 15:45:27,244] ({Thread-7} TerminalThread.java[run]:65) - > WebRoot is > jar:file:/home/xiuli/zeppelin/interpreter/sh/zeppelin-shell-0.9.0-SNAPSHOT.jar!/html > INFO [2019-08-29 15:45:27,263] ({pool-1-thread-2} > RemoteInterpreterServer.java[getStatus]:866) - job:null > INFO [2019-08-29 15:45:27,263] ({pool-1-thread-2} > RemoteInterpreterServer.java[getStatus]:866) - > job:org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob@fc56d7a8 > INFO [2019-08-29 15:45:27,263] ({pool-1-thread-2} > RemoteInterpreterServer.java[getStatus]:868) - getStatus: RUNNING > INFO [2019-08-29 15:45:27,307] ({Thread-7} Server.java[doStart]:370) - > jetty-9.4.z-SNAPSHOT; built: 2019-04-29T20:42:08.989Z; git: > e1bc35120a6617ee3df052294e433f3a25ce7097; jvm 1.8.0_201-b09 > INFO [2019-08-29 15:45:27,339] ({Thread-7} > DefaultSessionIdManager.java[doStart]:365) - DefaultSessionIdManager > workerName=node0 > INFO [2019-08-29 15:45:27,339] ({Thread-7} > DefaultSessionIdManager.java[doStart]:370) - No SessionScavenger set, using > defaults > INFO [2019-08-29 15:45:27,341] ({Thread-7} > HouseKeeper.java[startScavenging]:149) - node0 Scavenging every 660000ms > INFO [2019-08-29 15:45:27,373] ({Thread-7} ContextHandler.java[doStart]:855) > - Started o.e.j.s.ServletContextHandler@71fa1926{/terminal,null,AVAILABLE} > INFO [2019-08-29 15:45:27,384] ({Thread-7} > AbstractConnector.java[doStart]:292) - Started > ServerConnector@950392e{HTTP/1.1,[http/1.1]}{0.0.0.0:35599 > <http://0.0.0.0:35599/>} > INFO [2019-08-29 15:45:27,385] ({Thread-7} Server.java[doStart]:410) - > Started @14167ms > INFO [2019-08-29 15:45:27,797] ({ParallelScheduler-Worker-1} > TerminalInterpreter.java[createTerminalDashboard]:154) - > <div class="row" style="width:100%"> > <div class="col-md-12" ng-switch=TERMINAL_SOCKET_STATUS> > <b>Terminal - man-sc02 (192.168.0.2)</b> > <b style="color: #999; margin-left:10px;">STATUS: </b> > <i ng-switch-when='TERMINAL_SOCKET_CONNECT' > ng-style="{'color':'green'}">CONNECTED</i> > <i ng-switch-when='TERMINAL_SOCKET_CLOSE' > ng-style="{'color':'red'}">DISCONNECTED</i> > <i ng-switch-default ng-style="{'color':'red'}">ERROR</i> > <a ng-if="TERMINAL_SOCKET_STATUS!='TERMINAL_SOCKET_CONNECT'" class="fa > fa-info-circle interpreter-binding-mode-info-link" aria-hidden="true" > tooltip-placement="bottom" uib-tooltip="Please run this paragraph again"></a> > > <!--button class="btn btn-default btn-xs" style="margin-left:40px;" > ng-click="" tooltip-placement="top" uib-tooltip="upload file to > host"><span class="icon-plus shortcut-icon"></span> Upload File > </button> > <button class="btn btn-default btn-xs" style="margin-left:4px;" > ng-click="" tooltip-placement="top" uib-tooltip="download file from > host"> <span class="icon-arrow-down shortcut-icon"></span> Download File > </button--> > > </div> > </div> > > <hr style="margin-top: 10px; margin-bottom: 10px;"/> > > <form style="width:100%"> > <iframe > src="http://192.168.0.2:35599?noteId=2EN14VVZ5¶graphId=paragraph_1567093498023_-273931001&t=1567093527757 > > <http://192.168.0.2:35599/?noteId=2EN14VVZ5¶graphId=paragraph_1567093498023_-273931001&t=1567093527757>" > height="400" width="100%" frameborder="0" scrolling="0"></iframe> > </form> > > INFO [2019-08-29 15:45:27,800] ({ParallelScheduler-Worker-1} > AbstractScheduler.java[runJob]:142) - Job paragraph_1567093498023_-273931001 > finished by scheduler org.apache.zeppelin.shell.TerminalInterpreter1624562114 > > On Thu, Aug 29, 2019 at 5:01 PM xiufeng liu <toxiuf...@gmail.com > <mailto:toxiuf...@gmail.com>> wrote: > > Hi Xun, > I probably know the reason. I compile the source from Dockfile. The following > ip address is the container address, and port, which won't work if access > outside of the container. Do you think it is a bug for running Zeppelin in > Docker? > http://172.17.0.3:42877?noteId=2ENZ85UFU¶graphId=paragraph_1567090139520_204251118&t=1567090151527 > > <http://172.17.0.3:42877/?noteId=2ENZ85UFU¶graphId=paragraph_1567090139520_204251118&t=1567090151527> > > /Xiufeng > > On Thu, Aug 29, 2019 at 3:56 PM Xun Liu <neliu...@163.com > <mailto:neliu...@163.com>> wrote: > hi, xiufeng liu: > > Please send me your zeppelin-interpreter-shll.log file. > > >> On Aug 29, 2019, at 9:50 PM, Jeff Zhang <zjf...@gmail.com >> <mailto:zjf...@gmail.com>> wrote: >> >> + Xun who implement the interactive shell. >> >> >> >> xiufeng liu <toxiuf...@gmail.com <mailto:toxiuf...@gmail.com>> 于2019年8月29日周四 >> 下午9:44写道： >> Dear Jeff, >> >> Thanks! It works. >> But, the interactive shell does not work (see the attached picture). Does >> it need some special configuration? Thanks >> /Xiufeng >> >> On Thu, Aug 29, 2019 at 3:05 PM Jeff Zhang <zjf...@gmail.com >> <mailto:zjf...@gmail.com>> wrote: >> Please also exclude r module as well. >> >> xiufeng liu <toxiuf...@gmail.com <mailto:toxiuf...@gmail.com>> 于2019年8月29日周四 >> 下午7:53写道： >> Yes, i have used the root account. Now I used the non-root account to >> compile, but got another error: >> The command I used is mvn -e clean package -Pscala-2.11 -Pbuild-distr >> -Pspark-2.3 -Pr -Phadoop-2.7 -Dhadoop.version=2.7.3 -DskipTests -pl !beam' >> >> ----------------- >> >> ERROR] >> /zeppelin/r/src/main/scala/org/apache/zeppelin/rinterpreter/RContext.scala:31: >> error: object SparkZeppelinContext is not a member of package >> org.apache.zeppelin.spark >> [INFO] import org.apache.zeppelin.spark.{SparkInterpreter, >> SparkZeppelinContext} >> [INFO] ^ >> [ERROR] >> /zeppelin/r/src/main/scala/org/apache/zeppelin/rinterpreter/RContext.scala:48: >> error: not found: type SparkZeppelinContext >> [INFO] private var z: Option[SparkZeppelinContext] = None >> [INFO] ^ >> [ERROR] >> /zeppelin/r/src/main/scala/org/apache/zeppelin/rinterpreter/RContext.scala:128: >> error: not found: type SparkZeppelinContext >> [INFO] private def initializeSparkR(sc : SparkContext, sql : SQLContext, z >> : SparkZeppelinContext) : Unit = synchronized { >> [INFO] >> ^ >> [ERROR] >> /zeppelin/r/src/main/java/org/apache/zeppelin/rinterpreter/RStatics.java:28: >> error: object SparkZeppelinContext is not a member of package >> org.apache.zeppelin.spark >> [INFO] import org.apache.zeppelin.spark.SparkZeppelinContext; >> [INFO] ^ >> [ERROR] >> /zeppelin/r/src/main/java/org/apache/zeppelin/rinterpreter/RStatics.java:45: >> error: not found: type SparkZeppelinContext >> [INFO] public static SparkZeppelinContext setZ(SparkZeppelinContext newZ) { >> [INFO] ^ >> [ERROR] >> /zeppelin/r/src/main/java/org/apache/zeppelin/rinterpreter/RStatics.java:45: >> error: not found: type SparkZeppelinContext >> [INFO] public static SparkZeppelinContext setZ(SparkZeppelinContext newZ) { >> [INFO] ^ >> [ERROR] 6 errors found >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] Reactor Summary: >> [INFO] >> [INFO] Zeppelin ........................................... SUCCESS [ 16.712 >> s] >> [INFO] Zeppelin: Interpreter .............................. SUCCESS [ 15.426 >> s] >> [INFO] Zeppelin: Interpreter API .......................... SUCCESS [ 49.017 >> s] >> [INFO] Zeppelin: Interpreter Parent ....................... SUCCESS [ 1.230 >> s] >> [INFO] Zeppelin: Zengine .................................. SUCCESS [ 13.530 >> s] >> [INFO] Zeppelin: Display system apis ...................... SUCCESS [ 13.154 >> s] >> [INFO] Zeppelin: Groovy interpreter ....................... SUCCESS [ 3.510 >> s] >> [INFO] Zeppelin: Spark Parent ............................. SUCCESS [ 2.825 >> s] >> [INFO] Zeppelin: Spark Shims .............................. SUCCESS [ 2.398 >> s] >> [INFO] Zeppelin: Spark1 Shims ............................. SUCCESS [ 10.266 >> s] >> [INFO] Zeppelin: Spark2 Shims ............................. SUCCESS [ 9.687 >> s] >> [INFO] Zeppelin: Python interpreter ....................... SUCCESS [ 7.686 >> s] >> [INFO] Zeppelin: Spark Interpreter ........................ SUCCESS [ 27.392 >> s] >> [INFO] Zeppelin: Spark Scala Parent ....................... SUCCESS [ 5.968 >> s] >> [INFO] Zeppelin: Spark Interpreter Scala_2.10 ............. SUCCESS [ 10.189 >> s] >> [INFO] Zeppelin: Spark Interpreter Scala_2.11 ............. SUCCESS [ 9.291 >> s] >> [INFO] Zeppelin: Spark Interpreter Scala_2.12 ............. SUCCESS [ 10.062 >> s] >> [INFO] Zeppelin: Spark dependencies ....................... SUCCESS [02:51 >> min] >> [INFO] Zeppelin: Shell interpreter ........................ SUCCESS [ 7.017 >> s] >> [INFO] Zeppelin: Submarine interpreter .................... SUCCESS [ 7.459 >> s] >> [INFO] Zeppelin: Markdown interpreter ..................... SUCCESS [ 1.551 >> s] >> [INFO] Zeppelin: Angular interpreter ...................... SUCCESS [ 0.929 >> s] >> [INFO] Zeppelin: Livy interpreter ......................... SUCCESS [ 6.981 >> s] >> [INFO] Zeppelin: HBase interpreter ........................ SUCCESS [ 11.671 >> s] >> [INFO] Zeppelin: Apache Pig Interpreter ................... SUCCESS [ 19.523 >> s] >> [INFO] Zeppelin: JDBC interpreter ......................... SUCCESS [ 2.675 >> s] >> [INFO] Zeppelin: File System Interpreters ................. SUCCESS [ 2.058 >> s] >> [INFO] Zeppelin: Flink .................................... SUCCESS [ 21.618 >> s] >> [INFO] Zeppelin: Apache Ignite interpreter ................ SUCCESS [ 6.968 >> s] >> [INFO] Zeppelin: Kylin interpreter ........................ SUCCESS [ 1.093 >> s] >> [INFO] Zeppelin: Lens interpreter ......................... SUCCESS [ 8.114 >> s] >> [INFO] Zeppelin: Apache Cassandra interpreter ............. SUCCESS [ 39.287 >> s] >> [INFO] Zeppelin: Elasticsearch interpreter ................ SUCCESS [ 6.340 >> s] >> [INFO] Zeppelin: BigQuery interpreter ..................... SUCCESS [ 13.322 >> s] >> [INFO] Zeppelin: Alluxio interpreter ...................... SUCCESS [ 6.911 >> s] >> [INFO] Zeppelin: Scio ..................................... SUCCESS [ 29.864 >> s] >> [INFO] Zeppelin: Neo4j interpreter ........................ SUCCESS [ 8.356 >> s] >> [INFO] Zeppelin: Sap ...................................... SUCCESS [ 1.049 >> s] >> [INFO] Zeppelin: Scalding interpreter ..................... SUCCESS [01:14 >> min] >> [INFO] Zeppelin: Java interpreter ......................... SUCCESS [ 0.950 >> s] >> [INFO] Zeppelin: Hazelcast Jet interpreter ................ SUCCESS [ 2.663 >> s] >> [INFO] Zeppelin: Apache Geode interpreter ................. SUCCESS [ 6.643 >> s] >> [INFO] Zeppelin: web Application .......................... SUCCESS [02:45 >> min] >> [INFO] Zeppelin: Server ................................... SUCCESS [ 11.623 >> s] >> [INFO] Zeppelin: Jupyter Support .......................... SUCCESS [ 0.726 >> s] >> [INFO] Zeppelin: Plugins Parent ........................... SUCCESS [ 1.800 >> s] >> [INFO] Zeppelin: Plugin S3NotebookRepo .................... SUCCESS [ 0.819 >> s] >> [INFO] Zeppelin: Plugin GitHubNotebookRepo ................ SUCCESS [ 0.893 >> s] >> [INFO] Zeppelin: Plugin AzureNotebookRepo ................. SUCCESS [ 0.919 >> s] >> [INFO] Zeppelin: Plugin GCSNotebookRepo ................... SUCCESS [ 2.610 >> s] >> [INFO] Zeppelin: Plugin ZeppelinHubRepo ................... SUCCESS [ 0.789 >> s] >> [INFO] Zeppelin: Plugin FileSystemNotebookRepo ............ SUCCESS [ 0.940 >> s] >> [INFO] Zeppelin: Plugin StandardLauncher .................. SUCCESS [ 0.865 >> s] >> [INFO] Zeppelin: Plugin Kubernetes StandardLauncher ....... SUCCESS [ 1.685 >> s] >> [INFO] Zeppelin: Plugin SparkInterpreterLauncher .......... SUCCESS [ 0.924 >> s] >> [INFO] Zeppelin: Plugin Docker Launcher ................... SUCCESS [ 4.015 >> s] >> [INFO] Zeppelin: Plugin Cluster Launcher .................. SUCCESS [ 1.729 >> s] >> [INFO] Zeppelin: Packaging distribution ................... SUCCESS [01:27 >> min] >> [INFO] Zeppelin: R Interpreter ............................ FAILURE [ 10.697 >> s] >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] BUILD FAILURE >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] Total time: 16:03 min >> [INFO] Finished at: 2019-08-29T08:49:12+00:00 >> [INFO] Final Memory: 492M/2006M >> [INFO] >> ------------------------------------------------------------------------ >> [WARNING] The requested profile "hadoop-2.7" could not be activated because >> it does not exist. >> [ERROR] Failed to execute goal >> org.scala-tools:maven-scala-plugin:2.15.2:compile (default) on project >> zeppelin-zrinterpreter_2.11: wrap: org.apache.commons.exec.ExecuteException: >> Process exited with an error: 1(Exit value: 1) -> [Help 1] >> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute >> goal org.scala-tools:maven-scala-plugin:2.15.2:compile (default) on project >> zeppelin-zrinterpreter_2.11: wrap: org.apache.commons.exec.ExecuteException: >> Process exited with an error: 1(Exit value: 1) >> at >> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:212) >> at >> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) >> at >> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) >> at >> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116) >> at >> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80) >> at >> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51) >> at >> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128) >> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307) >> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193) >> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106) >> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:863) >> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288) >> at org.apache.maven.cli.MavenCli.main(MavenCli.java:199) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:498) >> at >> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289) >> at >> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229) >> at >> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415) >> at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356) >> Caused by: org.apache.maven.plugin.MojoExecutionException: wrap: >> org.apache.commons.exec.ExecuteException: Process exited with an error: >> 1(Exit value: 1) >> at org_scala_tools_maven.ScalaMojoSupport.execute(ScalaMojoSupport.java:350) >> at >> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134) >> at >> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:207) >> ... 20 more >> Caused by: org.apache.commons.exec.ExecuteException: Process exited with an >> error: 1(Exit value: 1) >> at >> org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346) >> at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149) >> at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:136) >> at >> org_scala_tools_maven_executions.JavaMainCallerByFork.run(JavaMainCallerByFork.java:80) >> at >> org_scala_tools_maven.ScalaCompilerSupport.compile(ScalaCompilerSupport.java:124) >> at >> org_scala_tools_maven.ScalaCompilerSupport.doExecute(ScalaCompilerSupport.java:80) >> at org_scala_tools_maven.ScalaMojoSupport.execute(ScalaMojoSupport.java:342) >> ... 22 more >> [ERROR] >> [ERROR] Re-run Maven using the -X switch to enable full debug logging. >> [ERROR] >> [ERROR] For more information about the errors and possible solutions, please >> read the following articles: >> [ERROR] [Help 1] >> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException >> <http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException> >> [ERROR] >> [ERROR] After correcting the problems, you can resume the build with the >> command >> [ERROR] mvn <goals> -rf :zeppelin-zrinterpreter_2.11 >> The command '/bin/sh -c mvn -e clean package -Pscala-2.11 -Pbuild-distr >> -Pspark-2.3 -Pr -Phadoop-2.7 -Dhadoop.version=2.7.3 -DskipTests -pl !beam' >> returned a non-zero code: 1 >> xiuli@man-sc02:~/docker-zeppelin$ >> >> >> On Thu, 29 Aug 2019, 09:12 Jeff Zhang, <zjf...@gmail.com >> <mailto:zjf...@gmail.com>> wrote: >> What is your build command ？ And do you use root to build it ? >> >> xiufeng liu <toxiuf...@gmail.com <mailto:toxiuf...@gmail.com>> 于2019年8月29日周四 >> 下午2:55写道： >> Dear Jeff, >> >> Thanks a lot! >> I have excluded the beam module, but I got another compile error. Could you >> help to take a look? Thanks >> >> /afancy >> >> ------------- >> [WARNING] The requested profile "hadoop-2.6" could not be activated because >> it does not exist. >> [ERROR] Failed to execute goal >> com.github.eirslett:frontend-maven-plugin:1.6:npm (npm build) on project >> zeppelin-web: Failed to run task: 'npm run build:dist' failed. >> org.apache.commons.exec.ExecuteException: Process exited with an error: 3 >> (Exit value: 3) -> [Help 1] >> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute >> goal com.github.eirslett:frontend-maven-plugin:1.6:npm (npm build) on >> project zeppelin-web: Failed to run task >> at >> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:212) >> at >> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) >> at >> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) >> at >> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116) >> at >> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80) >> at >> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51) >> at >> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128) >> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307) >> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193) >> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106) >> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:863) >> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288) >> at org.apache.maven.cli.MavenCli.main(MavenCli.java:199) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:498) >> at >> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289) >> at >> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229) >> at >> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415) >> at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356) >> Caused by: org.apache.maven.plugin.MojoFailureException: Failed to run task >> at >> com.github.eirslett.maven.plugins.frontend.mojo.AbstractFrontendMojo.execute(AbstractFrontendMojo.java:100) >> at >> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134) >> at >> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:207) >> ... 20 more >> Caused by: >> com.github.eirslett.maven.plugins.frontend.lib.TaskRunnerException: 'npm run >> build:dist' failed. >> at >> com.github.eirslett.maven.plugins.frontend.lib.NodeTaskExecutor.execute(NodeTaskExecutor.java:63) >> at >> com.github.eirslett.maven.plugins.frontend.mojo.NpmMojo.execute(NpmMojo.java:62) >> at >> com.github.eirslett.maven.plugins.frontend.mojo.AbstractFrontendMojo.execute(AbstractFrontendMojo.java:94) >> ... 22 more >> Caused by: >> com.github.eirslett.maven.plugins.frontend.lib.ProcessExecutionException: >> org.apache.commons.exec.ExecuteException: Process exited with an error: 3 >> (Exit value: 3) >> at >> com.github.eirslett.maven.plugins.frontend.lib.ProcessExecutor.execute(ProcessExecutor.java:82) >> at >> com.github.eirslett.maven.plugins.frontend.lib.ProcessExecutor.executeAndRedirectOutput(ProcessExecutor.java:64) >> at >> com.github.eirslett.maven.plugins.frontend.lib.NodeExecutor.executeAndRedirectOutput(NodeExecutor.java:29) >> at >> com.github.eirslett.maven.plugins.frontend.lib.NodeTaskExecutor.execute(NodeTaskExecutor.java:58) >> ... 24 more >> Caused by: org.apache.commons.exec.ExecuteException: Process exited with an >> error: 3 (Exit value: 3) >> at >> org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:404) >> at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:166) >> at >> com.github.eirslett.maven.plugins.frontend.lib.ProcessExecutor.execute(ProcessExecutor.java:74) >> ... 27 more >> [ERROR] >> [ERROR] Re-run Maven using the -X switch to enable full debug logging. >> [ERROR] >> [ERROR] For more information about the errors and possible solutions, please >> read the following articles: >> [ERROR] [Help 1] >> http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException >> <http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException> >> >> On Thu, Aug 29, 2019 at 3:25 AM Jeff Zhang <zjf...@gmail.com >> <mailto:zjf...@gmail.com>> wrote: >> The problem is that there's no beam-runners-flink 2.0.0 for scala 2.10 >> >> https://mvnrepository.com/artifact/org.apache.beam/beam-runners-flink >> <https://mvnrepository.com/artifact/org.apache.beam/beam-runners-flink> >> >> There's several approach for it . >> >> 1. exclude beam module when building. Add -pl !beam >> 2. Use -Pscala-2.10 -Pspark-1.6 >> 3. Upgrade beam version to 2.5.0 which support scala 2.11 >> >> >> And please create a ticket for it. >> >> >> afancy <grou...@gmail.com <mailto:grou...@gmail.com>> 于2019年8月28日周三 >> 下午11:31写道： >> Dear all, >> >> I use the following command to compile the source code on Ubuntu 16.04, but >> got the following error. Could you help? thanks >> mvn -e clean package -DskipTests -Pspark-2.3 -Phadoop-2.6 -Pr -Pscala-2.11 >> -Pr >> >> / afancy >> >> >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] Reactor Summary: >> [INFO] >> [INFO] Zeppelin ........................................... SUCCESS [ 16.782 >> s] >> [INFO] Zeppelin: Interpreter .............................. SUCCESS [ 15.618 >> s] >> [INFO] Zeppelin: Interpreter API .......................... SUCCESS [ 48.745 >> s] >> [INFO] Zeppelin: Interpreter Parent ....................... SUCCESS [ 1.562 >> s] >> [INFO] Zeppelin: Zengine .................................. SUCCESS [ 13.692 >> s] >> [INFO] Zeppelin: Display system apis ...................... SUCCESS [ 13.278 >> s] >> [INFO] Zeppelin: Groovy interpreter ....................... SUCCESS [ 3.623 >> s] >> [INFO] Zeppelin: Spark Parent ............................. SUCCESS [ 3.073 >> s] >> [INFO] Zeppelin: Spark Shims .............................. SUCCESS [ 2.808 >> s] >> [INFO] Zeppelin: Spark1 Shims ............................. SUCCESS [ 10.583 >> s] >> [INFO] Zeppelin: Spark2 Shims ............................. SUCCESS [ 9.562 >> s] >> [INFO] Zeppelin: Python interpreter ....................... SUCCESS [ 8.850 >> s] >> [INFO] Zeppelin: Spark Interpreter ........................ SUCCESS [ 27.756 >> s] >> [INFO] Zeppelin: Spark Scala Parent ....................... SUCCESS [ 6.425 >> s] >> [INFO] Zeppelin: Spark Interpreter Scala_2.10 ............. SUCCESS [ 10.443 >> s] >> [INFO] Zeppelin: Spark Interpreter Scala_2.11 ............. SUCCESS [ 9.480 >> s] >> [INFO] Zeppelin: Spark Interpreter Scala_2.12 ............. SUCCESS [ 10.540 >> s] >> [INFO] Zeppelin: Spark dependencies ....................... SUCCESS [ 32.757 >> s] >> [INFO] Zeppelin: Shell interpreter ........................ SUCCESS [ 7.767 >> s] >> [INFO] Zeppelin: Submarine interpreter .................... SUCCESS [ 7.759 >> s] >> [INFO] Zeppelin: Markdown interpreter ..................... SUCCESS [ 1.920 >> s] >> [INFO] Zeppelin: Angular interpreter ...................... SUCCESS [ 1.130 >> s] >> [INFO] Zeppelin: Livy interpreter ......................... SUCCESS [ 7.521 >> s] >> [INFO] Zeppelin: HBase interpreter ........................ SUCCESS [ 11.602 >> s] >> [INFO] Zeppelin: Apache Pig Interpreter ................... SUCCESS [ 20.028 >> s] >> [INFO] Zeppelin: JDBC interpreter ......................... SUCCESS [ 2.921 >> s] >> [INFO] Zeppelin: File System Interpreters ................. SUCCESS [ 2.375 >> s] >> [INFO] Zeppelin: Flink .................................... SUCCESS [ 22.011 >> s] >> [INFO] Zeppelin: Apache Ignite interpreter ................ SUCCESS [ 7.318 >> s] >> [INFO] Zeppelin: Kylin interpreter ........................ SUCCESS [ 1.477 >> s] >> [INFO] Zeppelin: Lens interpreter ......................... SUCCESS [ 8.949 >> s] >> [INFO] Zeppelin: Apache Cassandra interpreter ............. SUCCESS [ 39.572 >> s] >> [INFO] Zeppelin: Elasticsearch interpreter ................ SUCCESS [ 6.692 >> s] >> [INFO] Zeppelin: BigQuery interpreter ..................... SUCCESS [ 2.479 >> s] >> [INFO] Zeppelin: Alluxio interpreter ...................... SUCCESS [ 7.018 >> s] >> [INFO] Zeppelin: Scio ..................................... SUCCESS [ 30.180 >> s] >> [INFO] Zeppelin: Neo4j interpreter ........................ SUCCESS [ 8.619 >> s] >> [INFO] Zeppelin: Sap ...................................... SUCCESS [ 1.423 >> s] >> [INFO] Zeppelin: Scalding interpreter ..................... SUCCESS [01:12 >> min] >> [INFO] Zeppelin: Java interpreter ......................... SUCCESS [ 1.267 >> s] >> [INFO] Zeppelin: Beam interpreter ......................... FAILURE [ 9.666 >> s] >> [INFO] Zeppelin: Hazelcast Jet interpreter ................ SKIPPED >> [INFO] Zeppelin: Apache Geode interpreter ................. SKIPPED >> [INFO] Zeppelin: web Application .......................... SKIPPED >> [INFO] Zeppelin: Server ................................... SKIPPED >> [INFO] Zeppelin: Jupyter Support .......................... SKIPPED >> [INFO] Zeppelin: Plugins Parent ........................... SKIPPED >> [INFO] Zeppelin: Plugin S3NotebookRepo .................... SKIPPED >> [INFO] Zeppelin: Plugin GitHubNotebookRepo ................ SKIPPED >> [INFO] Zeppelin: Plugin AzureNotebookRepo ................. SKIPPED >> [INFO] Zeppelin: Plugin GCSNotebookRepo ................... SKIPPED >> [INFO] Zeppelin: Plugin ZeppelinHubRepo ................... SKIPPED >> [INFO] Zeppelin: Plugin FileSystemNotebookRepo ............ SKIPPED >> [INFO] Zeppelin: Plugin StandardLauncher .................. SKIPPED >> [INFO] Zeppelin: Plugin Kubernetes StandardLauncher ....... SKIPPED >> [INFO] Zeppelin: Plugin SparkInterpreterLauncher .......... SKIPPED >> [INFO] Zeppelin: Plugin Docker Launcher ................... SKIPPED >> [INFO] Zeppelin: Plugin Cluster Launcher .................. SKIPPED >> [INFO] Zeppelin: Packaging distribution ................... SKIPPED >> [INFO] Zeppelin: R Interpreter ............................ SKIPPED >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] BUILD FAILURE >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] Total time: 08:51 min >> [INFO] Finished at: 2019-08-28T15:19:36+00:00 >> [INFO] Final Memory: 374M/1653M >> [INFO] >> ------------------------------------------------------------------------ >> [WARNING] The requested profile "hadoop-2.6" could not be activated because >> it does not exist. >> [ERROR] Failed to execute goal on project zeppelin-beam: Could not resolve >> dependencies for project >> org.apache.zeppelin:zeppelin-beam:jar:0.9.0-SNAPSHOT: Could not find >> artifact org.apache.beam:beam-runners-flink_2.11:jar:2.0.0 in central >> (https://repo.maven.apache.org/maven2 >> <https://repo.maven.apache.org/maven2>) -> [Help 1] >> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute >> goal on project zeppelin-beam: Could not resolve dependencies for project >> org.apache.zeppelin:zeppelin-beam:jar:0.9.0-SNAPSHOT: Could not find >> artifact org.apache.beam:beam-runners-flink_2.11:jar:2.0.0 in central >> (https://repo.maven.apache.org/maven2 <https://repo.maven.apache.org/maven2>) >> at >> org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies(LifecycleDependencyResolver.java:221) >> at >> org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.resolveProjectDependencies(LifecycleDependencyResolver.java:127) >> at >> org.apache.maven.lifecycle.internal.MojoExecutor.ensureDependenciesAreResolved(MojoExecutor.java:245) >> at >> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:199) >> at >> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) >> at >> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) >> at >> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116) >> at >> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80) >> at >> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51) >> at >> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128) >> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307) >> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193) >> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106) >> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:863) >> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288) >> at org.apache.maven.cli.MavenCli.main(MavenCli.java:199) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:498) >> at >> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289) >> at >> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229) >> at >> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415) >> at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356) >> Caused by: org.apache.maven.project.DependencyResolutionException: Could not >> resolve dependencies for project >> org.apache.zeppelin:zeppelin-beam:jar:0.9.0-SNAPSHOT: Could not find >> artifact org.apache.beam:beam-runners-flink_2.11:jar:2.0.0 in central >> (https://repo.maven.apache.org/maven2 <https://repo.maven.apache.org/maven2>) >> at >> org.apache.maven.project.DefaultProjectDependenciesResolver.resolve(DefaultProjectDependenciesResolver.java:211) >> at >> org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies(LifecycleDependencyResolver.java:195) >> ... 23 more >> Caused by: org.eclipse.aether.resolution.DependencyResolutionException: >> Could not find artifact org.apache.beam:beam-runners-flink_2.11:jar:2.0.0 in >> central (https://repo.maven.apache.org/maven2 >> <https://repo.maven.apache.org/maven2>) >> at >> org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:384) >> at >> org.apache.maven.project.DefaultProjectDependenciesResolver.resolve(DefaultProjectDependenciesResolver.java:205) >> ... 24 more >> Caused by: org.eclipse.aether.resolution.ArtifactResolutionException: Could >> not find artifact org.apache.beam:beam-runners-flink_2.11:jar:2.0.0 in >> central (https://repo.maven.apache.org/maven2 >> <https://repo.maven.apache.org/maven2>) >> at >> org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolve(DefaultArtifactResolver.java:444) >> at >> org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolveArtifacts(DefaultArtifactResolver.java:246) >> at >> org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:367) >> ... 25 more >> Caused by: org.eclipse.aether.transfer.ArtifactNotFoundException: Could not >> find artifact org.apache.beam:beam-runners-flink_2.11:jar:2.0.0 in central >> (https://repo.maven.apache.org/maven2 <https://repo.maven.apache.org/maven2>) >> at >> org.eclipse.aether.connector.basic.ArtifactTransportListener.transferFailed(ArtifactTransportListener.java:39) >> at >> org.eclipse.aether.connector.basic.BasicRepositoryConnector$TaskRunner.run(BasicRepositoryConnector.java:355) >> at >> org.eclipse.aether.util.concurrency.RunnableErrorForwarder$1.run(RunnableErrorForwarder.java:67) >> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) >> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) >> at java.lang.Thread.run(Thread.java:748) >> [ERROR] >> [ERROR] Re-run Maven using the -X switch to enable full debug logging. >> [ERROR] >> [ERROR] For more information about the errors and possible solutions, please >> read the following articles: >> [ERROR] [Help 1] >> http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException >> >> <http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException> >> [ERROR] >> [ERROR] After correcting the problems, you can resume the build with the >> command >> [ERROR] mvn <goals> -rf :zeppelin-beam >> The command '/bin/sh -c mvn -e clean package -DskipTests -Pspark-2.3 >> -Phadoop-2.6 -Pr -Pscala-2.11 -Pr' returned a non-zero code: 1 >> xiuli@man-sc02:~/docker-zeppelin$ >> >> >> -- >> Best Regards >> >> Jeff Zhang >> >> >> -- >> Best Regards >> >> Jeff Zhang >> >> >> -- >> Best Regards >> >> Jeff Zhang >> >> >> -- >> Best Regards >> >> Jeff Zhang >
