[jira] [Created] (ZEPPELIN-6121) Write a Dockerfile for python interpreter image build

2024-10-05 Thread SeungYoungOh (Jira)
SeungYoungOh created ZEPPELIN-6121: -- Summary: Write a Dockerfile for python interpreter image build Key: ZEPPELIN-6121 URL: https://issues.apache.org/jira/browse/ZEPPELIN-6121 Project: Zeppelin

[GitHub] [zeppelin] Reamer commented on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-06-22 Thread GitBox
Reamer commented on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-864889515 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For q

[GitHub] [zeppelin] zjffdu commented on a change in pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-06-22 Thread GitBox
zjffdu commented on a change in pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#discussion_r655220571 ## File path: zeppelin-plugins/launcher/yarn/src/main/java/org/apache/zeppelin/interpreter/launcher/YarnRemoteInterpreterProcess.java ## @@ -259,13 +266,

[GitHub] [zeppelin] asfgit closed pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-06-22 Thread GitBox
asfgit closed pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [zeppelin] Reamer removed a comment on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-06-22 Thread GitBox
Reamer removed a comment on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-864889515 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [zeppelin] asfgit closed pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-06-21 Thread GitBox
asfgit closed pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [zeppelin] Reamer removed a comment on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-06-21 Thread GitBox
Reamer removed a comment on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-864889515 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [zeppelin] Reamer commented on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-06-21 Thread GitBox
Reamer commented on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-864889515 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For q

[GitHub] [zeppelin] zjffdu commented on a change in pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-06-21 Thread GitBox
zjffdu commented on a change in pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#discussion_r655222659 ## File path: zeppelin-plugins/launcher/yarn/src/main/java/org/apache/zeppelin/interpreter/launcher/YarnRemoteInterpreterProcess.java ## @@ -259,13 +266,

[GitHub] [zeppelin] zjffdu commented on a change in pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-06-21 Thread GitBox
zjffdu commented on a change in pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#discussion_r655220707 ## File path: zeppelin-server/src/main/java/org/apache/zeppelin/socket/NotebookSocket.java ## @@ -67,7 +67,7 @@ public String getProtocol() { } p

[GitHub] [zeppelin] zjffdu commented on a change in pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-06-21 Thread GitBox
zjffdu commented on a change in pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#discussion_r655220571 ## File path: zeppelin-plugins/launcher/yarn/src/main/java/org/apache/zeppelin/interpreter/launcher/YarnRemoteInterpreterProcess.java ## @@ -259,13 +266,

[GitHub] [zeppelin] Reamer commented on a change in pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-06-20 Thread GitBox
Reamer commented on a change in pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#discussion_r655079099 ## File path: zeppelin-plugins/launcher/yarn/src/main/java/org/apache/zeppelin/interpreter/launcher/YarnRemoteInterpreterProcess.java ## @@ -259,13 +266,

[GitHub] [zeppelin] zjffdu commented on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-06-20 Thread GitBox
zjffdu commented on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-864567409 @Reamer Do you have any more comment ? Otherwise I will merge it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

[GitHub] [zeppelin] zjffdu commented on a change in pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-06-16 Thread GitBox
zjffdu commented on a change in pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#discussion_r652430602 ## File path: zeppelin-plugins/launcher/yarn/src/main/java/org/apache/zeppelin/interpreter/launcher/YarnLauncherUtil.java ## @@ -0,0 +1,49 @@ +/* + * Lic

[GitHub] [zeppelin] zjffdu commented on a change in pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-06-14 Thread GitBox
zjffdu commented on a change in pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#discussion_r649650890 ## File path: zeppelin-plugins/launcher/yarn/src/test/java/org/apache/zeppelin/interpreter/launcher/YarnLauncherUtilTest.java ## @@ -0,0 +1,41 @@ +/* + *

[GitHub] [zeppelin] Reamer commented on a change in pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-06-06 Thread GitBox
Reamer commented on a change in pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#discussion_r646271563 ## File path: zeppelin-jupyter-interpreter/src/main/java/org/apache/zeppelin/jupyter/JupyterKernelInterpreter.java ## @@ -216,6 +259,23 @@ private void l

[GitHub] [zeppelin] zjffdu commented on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-06-04 Thread GitBox
zjffdu commented on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-854380073 CI is fixed now, ready for review @Reamer -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [zeppelin] zjffdu commented on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-06-03 Thread GitBox
zjffdu commented on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-854380073 CI is fixed now, ready for review @Reamer -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [zeppelin] zjffdu commented on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-06-01 Thread GitBox
zjffdu commented on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-852767277 CI is failed, I am looking at that -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [zeppelin] zjffdu commented on a change in pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-06-01 Thread GitBox
zjffdu commented on a change in pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#discussion_r643680742 ## File path: zeppelin-plugins/launcher/yarn/src/main/java/org/apache/zeppelin/interpreter/launcher/YarnRemoteInterpreterProcess.java ## @@ -316,6 +347,2

[GitHub] [zeppelin] Reamer commented on a change in pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-05-20 Thread GitBox
Reamer commented on a change in pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#discussion_r636668467 ## File path: zeppelin-jupyter-interpreter/src/main/java/org/apache/zeppelin/jupyter/JupyterKernelInterpreter.java ## @@ -183,8 +195,43 @@ public String

[GitHub] [zeppelin] Reamer commented on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-05-20 Thread GitBox
Reamer commented on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-845683022 Thank you for the clarification. I have created a [Jira ticket](https://issues.apache.org/jira/browse/ZEPPELIN-5384). -- This is an automated message from the Apache Git Servi

[jira] [Created] (ZEPPELIN-5384) Add a property to download a conda environment in python interpreter

2021-05-20 Thread Philipp Dallig (Jira)
Philipp Dallig created ZEPPELIN-5384: Summary: Add a property to download a conda environment in python interpreter Key: ZEPPELIN-5384 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5384

[GitHub] [zeppelin] zjffdu commented on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-05-18 Thread GitBox
the download. Actually for spark yarn mode, it would still use yarn cache mechanism to distribute archives [1]. Of course, for k8s mode, we can use other property to download the archive in `JupyterKernelInterpreter.java` for pure python interpreter, but for pyspark, it is not necessary, because i

[GitHub] [zeppelin] Reamer edited a comment on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-05-18 Thread GitBox
Reamer edited a comment on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-843240046 Hi @zjffdu, > We can leverage yarn's resource cache mechanism. That means the same conda env downloaded by yarn_app_1 can be reused by yarn_app_2. If we download it

[GitHub] [zeppelin] Reamer commented on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-05-18 Thread GitBox
Reamer commented on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-843240046 Hi @zjffdu, > We can leverage yarn's resource cache mechanism. That means the same conda env downloaded by yarn_app_1 can be reused by yarn_app_2. If we download it in Ju

[GitHub] [zeppelin] zjffdu commented on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-05-17 Thread GitBox
zjffdu commented on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-842054131 @Reamer Actually `YarnRemoteInterpreterProcess` doesn't do the downloading, it just upload the conda to hdfs as yarn app resource, and yarn will download it from hdfs before sta

[GitHub] [zeppelin] zjffdu edited a comment on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-05-17 Thread GitBox
zjffdu edited a comment on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-842054131 @Reamer Actually `YarnRemoteInterpreterProcess` doesn't do the downloading, it just upload the conda to hdfs as yarn app resource, and yarn will download it from hdfs bef

[GitHub] [zeppelin] zjffdu edited a comment on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-05-16 Thread GitBox
zjffdu edited a comment on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-842054131 @Reamer Actually `YarnRemoteInterpreterProcess` doesn't do the downloading, it just upload the conda to hdfs as yarn app resource, and yarn will download it from hdfs bef

[GitHub] [zeppelin] zjffdu commented on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-05-16 Thread GitBox
zjffdu commented on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-842054131 @Reamer Actually `YarnRemoteInterpreterProcess` doesn't do the downloading, it just upload the conda to hdfs as yarn app resource, and yarn will download it from hdfs before sta

[GitHub] [zeppelin] Reamer commented on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-05-10 Thread GitBox
Reamer commented on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-836766584 > What do you think ? Can we move the Conda environment download from `YarnRemoteInterpreterProcess.java` to the actual Python interpreter. I think that would

[GitHub] [zeppelin] zjffdu commented on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-05-10 Thread GitBox
zjffdu commented on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-836747887 Thanks @Reamer for the investigation, so how about using `python.archives` for specifying conda env archives in both yarn and k8s, in this PR, I will make it work in yarn and we

[GitHub] [zeppelin] Reamer commented on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-05-06 Thread GitBox
Reamer commented on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-833645596 > At the moment I don't know if `spark.archives` supports a download via HTTP. I will find out as soon as possible. If this is possible, `python.archive` should also do the down

[GitHub] [zeppelin] Reamer commented on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-05-03 Thread GitBox
a configuration parameter that does almost the same as the spark equilant. > But for python interpreter, I don't think there's unified approach for that for now. Buy we can introduce unified configuration for that. e.g. We can introduce `python.archive` which will be trans

[GitHub] [zeppelin] zjffdu commented on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-05-01 Thread GitBox
zjffdu commented on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-830638631 For spark interpreter, we can leverage `spark.archives` to download and setup conda environment in both driver(spark interpreter) and executor. But for python interpreter, I

[GitHub] [zeppelin] Reamer edited a comment on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-04-27 Thread GitBox
Reamer edited a comment on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-827815927 You are right, putting the Conda environment in a cloud storage will be the best option. Do you have any idea what possibilities for integration `spark.archives` supports

[GitHub] [zeppelin] Reamer commented on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-04-27 Thread GitBox
Reamer commented on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-827815927 You are right, putting the Conda environment in a cloud storage will be the best option. Do you have any idea what possibilities for integration `spark.archives` supports? Local

[GitHub] [zeppelin] zjffdu commented on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-04-25 Thread GitBox
out of control of zeppelin. That's why this approach here only works for python interpreter which zeppelin can control its python environment. But of course we should make the configuration between spark and python interpreter as similar as possible. -- This is an automated message fro

[GitHub] [zeppelin] zjffdu commented on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-04-25 Thread GitBox
out of control of zeppelin. That's why this approach here only works for python interpreter which zeppelin can control its python environment. But of course we should make the configuration between spark and python interpreter as similar as possible. -- This is an automated message fro

[GitHub] [zeppelin] zjffdu commented on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-04-23 Thread GitBox
zjffdu commented on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-825500280 Thanks @Reamer `spark.archives` seems to be able to work both in yarn and k8s, let me try this. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [zeppelin] Reamer edited a comment on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-04-23 Thread GitBox
Reamer edited a comment on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-825479159 > Although the image size may look a little big, the physical size or downloading size would be the same of using the current python interpreter image and then downl

[GitHub] [zeppelin] Reamer commented on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-04-23 Thread GitBox
Reamer commented on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-825479159 > Although the image size may look a little big, the physical size or downloading size would be the same of using the current python interpreter image and then download

[GitHub] [zeppelin] zjffdu commented on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-04-22 Thread GitBox
pelin interpreter images is quite difficult. I would like to see the user (download and) activate a specific conda environment in his note. > The main advantage is that the image of the Zeppelin interpreter would be much smaller. But these python interpreter images can share them sam

[GitHub] [zeppelin] Reamer commented on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-04-22 Thread GitBox
Reamer commented on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-824736245 > I mean allowing user to choose different image for their notes. Customizing image won't be a frequent operation IIUC Maintaining different Zeppelin interpreter images is

[GitHub] [zeppelin] zjffdu edited a comment on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-04-22 Thread GitBox
zjffdu edited a comment on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-824603467 > Updates of the image with a changed Python version and libraries are not really possible because you don't know which other notebooks might be broken afterwards.

[GitHub] [zeppelin] zjffdu edited a comment on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-04-22 Thread GitBox
zjffdu edited a comment on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-824603467 > Updates of the image with a changed Python version and libraries are not really possible because you don't know which other notebooks might be broken afterwards.

[GitHub] [zeppelin] zjffdu commented on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-04-22 Thread GitBox
zjffdu commented on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-824603467 > Updates of the image with a changed Python version and libraries are not really possible because you don't know which other notebooks might be broken afterwards. I mean

[GitHub] [zeppelin] zjffdu edited a comment on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-04-22 Thread GitBox
zjffdu edited a comment on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-824601359 @Reamer Actually the approach here also apply for pyspark interpreter but with different setting, I have verified that -- This is an automated message from the Apache

[GitHub] [zeppelin] zjffdu commented on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-04-22 Thread GitBox
zjffdu commented on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-824601359 @Reamer Actually the approach here also apply for pyspark interpreter, I have verified that -- This is an automated message from the Apache Git Service. To respond to the mes

[GitHub] [zeppelin] Reamer commented on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-04-21 Thread GitBox
Reamer commented on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-824591596 > Regarding your experience, would building conda env into docker image works for users ? It works, but it's not as flexible as your approach with YARN. At the moment it'

[GitHub] [zeppelin] zjffdu commented on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-04-21 Thread GitBox
for their python interpreter. If they want to use other packages, they can use `!pip install` in zeppelin to install packages -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [zeppelin] Reamer commented on pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-04-21 Thread GitBox
Reamer commented on pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#issuecomment-824057131 I think this is also a great feature for the K8s launcher. Unfortunately, I don't see any way to manipulate files before launching, like you did with YARN. Any ideas how we can

[GitHub] [zeppelin] zjffdu commented on a change in pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-04-20 Thread GitBox
zjffdu commented on a change in pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#discussion_r616831897 ## File path: zeppelin-plugins/launcher/yarn/src/main/java/org/apache/zeppelin/interpreter/launcher/YarnRemoteInterpreterProcess.java ## @@ -266,6 +270,3

[GitHub] [zeppelin] zjffdu commented on a change in pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-04-20 Thread GitBox
zjffdu commented on a change in pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#discussion_r616830110 ## File path: zeppelin-plugins/launcher/yarn/src/main/java/org/apache/zeppelin/interpreter/launcher/YarnRemoteInterpreterProcess.java ## @@ -242,13 +244,

[GitHub] [zeppelin] zjffdu commented on a change in pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-04-20 Thread GitBox
zjffdu commented on a change in pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#discussion_r616830363 ## File path: zeppelin-plugins/launcher/yarn/src/main/java/org/apache/zeppelin/interpreter/launcher/YarnRemoteInterpreterProcess.java ## @@ -316,6 +344,2

[GitHub] [zeppelin] cuspymd commented on a change in pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-04-20 Thread GitBox
cuspymd commented on a change in pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097#discussion_r616816582 ## File path: zeppelin-plugins/launcher/yarn/src/main/java/org/apache/zeppelin/interpreter/launcher/YarnRemoteInterpreterProcess.java ## @@ -242,13 +244

[GitHub] [zeppelin] zjffdu opened a new pull request #4097: [ZEPPELIN-5330]. Support conda env for python interpreter in yarn mode

2021-04-18 Thread GitBox
zjffdu opened a new pull request #4097: URL: https://github.com/apache/zeppelin/pull/4097 ### What is this PR for? A few sentences describing the overall goals of the pull request's commits. First time? Check out the contributing guide - https://zeppelin.apache.org/contribution/contri

[jira] [Created] (ZEPPELIN-5330) Support conda env for python interpreter in yarn mode

2021-04-16 Thread Jeff Zhang (Jira)
Jeff Zhang created ZEPPELIN-5330: Summary: Support conda env for python interpreter in yarn mode Key: ZEPPELIN-5330 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5330 Project: Zeppelin

[jira] [Created] (ZEPPELIN-5086) Error IOException: error=13, Permission denied with conda commands on python-interpreter

2020-10-08 Thread Jose Humberto Cruvinel (Jira)
Jose Humberto Cruvinel created ZEPPELIN-5086: Summary: Error IOException: error=13, Permission denied with conda commands on python-interpreter Key: ZEPPELIN-5086 URL: https://issues.apache.org/jira

Re: Cursor in Python interpreter jumps

2020-05-30 Thread denny wong
Hi We have encountered this issue in Zeppelin 0.8.2.  Any idea when will it be fixed? [ZEPPELIN-3131] Cursor in Python interpreter jumps to start when typing certain characters - ASF JIRA | | | | [ZEPPELIN-3131] Cursor in Python interpreter jumps to start when typing

[GitHub] [zeppelin] asfgit closed pull request #3604: [ZEPPELIN-4564] Changed path separator in Python interpreter to allow it to work on windows as well

2020-01-19 Thread GitBox
asfgit closed pull request #3604: [ZEPPELIN-4564] Changed path separator in Python interpreter to allow it to work on windows as well URL: https://github.com/apache/zeppelin/pull/3604 This is an automated message from the

[GitHub] [zeppelin] zjffdu commented on issue #3604: [ZEPPELIN-4564] Changed path separator in Python interpreter to allow it to work on windows as well

2020-01-19 Thread GitBox
zjffdu commented on issue #3604: [ZEPPELIN-4564] Changed path separator in Python interpreter to allow it to work on windows as well URL: https://github.com/apache/zeppelin/pull/3604#issuecomment-575980784 LGTM This is an

[jira] [Created] (ZEPPELIN-4564) Python Interpreter fails on Windows because of classpath issue

2020-01-16 Thread Muhammad Faaiz Taufiq (Jira)
Muhammad Faaiz Taufiq created ZEPPELIN-4564: --- Summary: Python Interpreter fails on Windows because of classpath issue Key: ZEPPELIN-4564 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4564

[jira] [Created] (ZEPPELIN-4477) Unable to build the zeppelin artifact from source (0.8.1). Failing build on "Python interpreter"

2019-12-10 Thread Benjamin (Jira)
Benjamin created ZEPPELIN-4477: -- Summary: Unable to build the zeppelin artifact from source (0.8.1). Failing build on "Python interpreter" Key: ZEPPELIN-4477 URL: https://issues.apache.org/jira/browse/ZEP

Re: Python interpreter

2019-10-31 Thread Denny Wong
Hi Currently, we are using Zep 0.8.1 and the python docker interpreter. Each user runs his notebook in his own docker python container. If user wants to install 3rd party modules (pip install) on demand, it doesn’t seem to work. How to install 3rd party modules via pip in the python container o

[jira] [Created] (ZEPPELIN-4345) Python Interpreter is not working in Windows

2019-09-23 Thread Ananth Kumar (Jira)
Ananth Kumar created ZEPPELIN-4345: -- Summary: Python Interpreter is not working in Windows Key: ZEPPELIN-4345 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4345 Project: Zeppelin

[jira] [Created] (ZEPPELIN-4266) Python interpreter - support for virtualenv/ pyenv

2019-07-20 Thread Layne Sadler (JIRA)
Layne Sadler created ZEPPELIN-4266: -- Summary: Python interpreter - support for virtualenv/ pyenv Key: ZEPPELIN-4266 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4266 Project: Zeppelin

[jira] [Created] (ZEPPELIN-4264) python interpreter isn't running on any of my notebooks

2019-07-18 Thread Batool Khader (JIRA)
Batool Khader created ZEPPELIN-4264: --- Summary: python interpreter isn't running on any of my notebooks Key: ZEPPELIN-4264 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4264 Project: Zep

[GitHub] [zeppelin] asfgit closed pull request #3348: changed-readme-for-python-interpreter-for-apache-zeppelin

2019-05-13 Thread GitBox
asfgit closed pull request #3348: changed-readme-for-python-interpreter-for-apache-zeppelin URL: https://github.com/apache/zeppelin/pull/3348 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [zeppelin] zjffdu commented on issue #3348: changed-readme-for-python-interpreter-for-apache-zeppelin

2019-05-13 Thread GitBox
zjffdu commented on issue #3348: changed-readme-for-python-interpreter-for-apache-zeppelin URL: https://github.com/apache/zeppelin/pull/3348#issuecomment-491829180 Thanks @d3adp007 , merging This is an automated message from

[jira] [Created] (ZEPPELIN-4114) The Python interpreter crashes when Conda is used in combination with iPython in Zeppelin v0.8.1

2019-04-10 Thread Peter Moorthamer (JIRA)
Peter Moorthamer created ZEPPELIN-4114: -- Summary: The Python interpreter crashes when Conda is used in combination with iPython in Zeppelin v0.8.1 Key: ZEPPELIN-4114 URL: https://issues.apache.org/jira

[GitHub] [zeppelin] felixcheung commented on issue #3348: changed-readme-for-python-interpreter-for-apache-zeppelin

2019-04-07 Thread GitBox
felixcheung commented on issue #3348: changed-readme-for-python-interpreter-for-apache-zeppelin URL: https://github.com/apache/zeppelin/pull/3348#issuecomment-480631063 LGTM! This is an automated message from the Apache Git

[GitHub] [zeppelin] d3adp007 opened a new pull request #3348: changed-readme-for-python-interpreter-for-apache-zeppelin

2019-04-06 Thread GitBox
d3adp007 opened a new pull request #3348: changed-readme-for-python-interpreter-for-apache-zeppelin URL: https://github.com/apache/zeppelin/pull/3348 ### What is this PR for? Fixed some of the grammatical issues with the documentation for Python Interpreter for Apache Zeppelin

[jira] [Created] (ZEPPELIN-4111) Changed the readme for Python Interpreter for Apache Zeppelin

2019-04-06 Thread Nikhil Nagpal (JIRA)
Nikhil Nagpal created ZEPPELIN-4111: --- Summary: Changed the readme for Python Interpreter for Apache Zeppelin Key: ZEPPELIN-4111 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4111 Project

[jira] [Created] (ZEPPELIN-4087) python Interpreter has hardcoded tmp path

2019-03-25 Thread Carsten Braess (JIRA)
Carsten Braess created ZEPPELIN-4087: Summary: python Interpreter has hardcoded tmp path Key: ZEPPELIN-4087 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4087 Project: Zeppelin

[GitHub] zeppelin issue #3115: [ZEPPELIN-3687] Fix IndexError in python interpreter w...

2018-08-13 Thread oxygen311
Github user oxygen311 commented on the issue: https://github.com/apache/zeppelin/pull/3115 @zjffdu @felixcheung Travis tests fixed ---

[GitHub] zeppelin issue #3115: [ZEPPELIN-3687] Fix IndexError in python interpreter w...

2018-08-08 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/3115 LGTM, did you configure travis ? I don't see your travis build ---

[GitHub] zeppelin issue #3115: [ZEPPELIN-3687] Fix IndexError in python interpreter w...

2018-08-08 Thread oxygen311
Github user oxygen311 commented on the issue: https://github.com/apache/zeppelin/pull/3115 @zjffdu Done ---

[GitHub] zeppelin issue #3115: [ZEPPELIN-3687] Fix IndexError in python interpreter w...

2018-08-07 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/3115 Could you add unit test ? ---

[GitHub] zeppelin pull request #3115: Fix IndexError in python interpreter with empty...

2018-08-07 Thread oxygen311
GitHub user oxygen311 opened a pull request: https://github.com/apache/zeppelin/pull/3115 Fix IndexError in python interpreter with empty input ### What is this PR for? If input of python or pyspark interpreter is empty (contains only comments), it will fail with `IndexError

[jira] [Created] (ZEPPELIN-3687) Python interpreter fails if input is empty

2018-08-07 Thread Alexey Zabelkin (JIRA)
Alexey Zabelkin created ZEPPELIN-3687: - Summary: Python interpreter fails if input is empty Key: ZEPPELIN-3687 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3687 Project: Zeppelin

[jira] [Created] (ZEPPELIN-3625) Pandasql interpreter fails to query over python interpreter dataframe

2018-07-15 Thread Khalid Huseynov (JIRA)
Khalid Huseynov created ZEPPELIN-3625: - Summary: Pandasql interpreter fails to query over python interpreter dataframe Key: ZEPPELIN-3625 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3625

[GitHub] zeppelin pull request #2282: [ZEPPELIN-2447] Fix python interpreter as to us...

2018-07-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/zeppelin/pull/2282 ---

[jira] [Created] (ZEPPELIN-3284) z.getInterpreterContext().out().clear() broken in Python interpreter

2018-03-02 Thread Lee moon soo (JIRA)
Lee moon soo created ZEPPELIN-3284: -- Summary: z.getInterpreterContext().out().clear() broken in Python interpreter Key: ZEPPELIN-3284 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3284 Project

[jira] [Created] (ZEPPELIN-3131) Cursor in Python interpreter jumps to start when typing certain characters

2018-01-09 Thread Timo (JIRA)
Timo created ZEPPELIN-3131: -- Summary: Cursor in Python interpreter jumps to start when typing certain characters Key: ZEPPELIN-3131 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3131 Project: Zeppelin

[jira] [Created] (ZEPPELIN-2983) python interpreter not working

2017-10-10 Thread Karim Gehad (JIRA)
Karim Gehad created ZEPPELIN-2983: - Summary: python interpreter not working Key: ZEPPELIN-2983 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2983 Project: Zeppelin Issue Type: Bug

[jira] [Created] (ZEPPELIN-2921) does not work conda environment in python interpreter

2017-09-07 Thread CloverHearts (JIRA)
CloverHearts created ZEPPELIN-2921: -- Summary: does not work conda environment in python interpreter Key: ZEPPELIN-2921 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2921 Project: Zeppelin

[jira] [Created] (ZEPPELIN-2655) python interpreter output error when use sys.reload

2017-06-15 Thread Jiang Wenwei (JIRA)
Jiang Wenwei created ZEPPELIN-2655: -- Summary: python interpreter output error when use sys.reload Key: ZEPPELIN-2655 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2655 Project: Zeppelin

[GitHub] zeppelin issue #2282: [ZEPPELIN-2447] Fix python interpreter as to use max r...

2017-06-10 Thread jongyoul
Github user jongyoul commented on the issue: https://github.com/apache/zeppelin/pull/2282 Let me check --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or i

[GitHub] zeppelin issue #2282: [ZEPPELIN-2447] Fix python interpreter as to use max r...

2017-06-09 Thread paularmand
Github user paularmand commented on the issue: https://github.com/apache/zeppelin/pull/2282 Pong @jongyoul . I wrote the unit test, but it is not passing on Jenkins. I have trouble setting up my local IDE to run the python tests in IntelliJ (all other tests, except the python ones, ar

[jira] [Created] (ZEPPELIN-2625) Test case failure in Python Interpreter and Zeppelin-web sever module on x86

2017-06-07 Thread vandita (JIRA)
vandita created ZEPPELIN-2625: - Summary: Test case failure in Python Interpreter and Zeppelin-web sever module on x86 Key: ZEPPELIN-2625 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2625 Project

[GitHub] zeppelin issue #2282: [ZEPPELIN-2447] Fix python interpreter as to use max r...

2017-06-04 Thread jongyoul
Github user jongyoul commented on the issue: https://github.com/apache/zeppelin/pull/2282 ping. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the f

Re: How to change the python installation location for Python interpreter?

2017-05-27 Thread BigData Consultant
va:191) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102) at com.sun.proxy.$Proxy13.create(Unknown Source) at org.apache.hadoop.hdfs.DFSOutputStream.newStreamForCreate(DFSOutputStream.java:1648) ... 30 more On Sun, May 28, 2017

Re: How to change the python installation location for Python interpreter?

2017-05-27 Thread moon soo Lee
Hi, You can set your python executable path in 'zeppelin.python' property, Python interpreter setting in the interpreter menu. If your system has conda installed, then you can manage environment using %python.conda. Please take a look http://zeppelin.apache.org/docs/latest/i

Re: How to change the python installation location for Python interpreter in Zeppelin?

2017-05-26 Thread BigData Consultant
ata Consultant 于2017年5月27日周六 > 下午1:03写道: > >> Where is the python installation location specified for Python >> interpreter in Zeppelin? >> >> How to change the python installation location for Python interpreter >> with new python installation directory in Zeppelin? >> >> Help would be much appreciated. >> >> Thanks. >> >

Re: How to change the python installation location for Python interpreter in Zeppelin?

2017-05-26 Thread Jeff Zhang
Set zeppelin.python to python installation path in interpreter setting page BigData Consultant 于2017年5月27日周六 下午1:03写道: > Where is the python installation location specified for Python interpreter > in Zeppelin? > > How to change the python installation location for Python inte

How to change the python installation location for Python interpreter in Zeppelin?

2017-05-26 Thread BigData Consultant
Where is the python installation location specified for Python interpreter in Zeppelin? How to change the python installation location for Python interpreter with new python installation directory in Zeppelin? Help would be much appreciated. Thanks.

How to change the python installation location for Python interpreter?

2017-05-26 Thread BigData Consultant
Hi Team, Where is the python installation location specified for Python interpreter? How to change the python installation location for Python interpreter with new python installation directory? Help would be much appreciated. Thanks.

[GitHub] zeppelin issue #2282: [ZEPPELIN-2447] Fix python interpreter as to use max r...

2017-05-03 Thread paularmand
Github user paularmand commented on the issue: https://github.com/apache/zeppelin/pull/2282 @zjffdu I'll have a look. Can expect something later on this week. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] zeppelin issue #2282: [ZEPPELIN-2447] Fix python interpreter as to use max r...

2017-05-02 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/2282 @paularmand Selenium test is flaky, one thing left is unit test. Could you add unit test in `PythonInterpreterTest` ? --- If your project is set up for it, you can reply to this email and have y

  1   2   >