Re: Read Hbase table in pyspark gives java.lang.ClassNotFoundException: org.apache.phoenix.jdbc.PhoenixDriver

2017-10-25 Thread Indtiny S
Hi, I have those libraries but where to place those libraries so that zeppelin can pick up. or is there any way to set the library path using sparkcontext i.e using sc? Regards In On Wed, Oct 25, 2017 at 9:22 PM, Jongyoul Lee wrote: > Hi, > > I'm not sure but you can try to locate them under

[jira] [Created] (ZEPPELIN-3010) SparkInterpreterModeTest#testYarnClusterMode test failing consistently

2017-10-25 Thread Sonia Garudi (JIRA)
Sonia Garudi created ZEPPELIN-3010: -- Summary: SparkInterpreterModeTest#testYarnClusterMode test failing consistently Key: ZEPPELIN-3010 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3010 Projec

[GitHub] zeppelin issue #2631: ZEPPELIN-2197. Interpreter Lifecycle Manager

2017-10-25 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/2631 @Tagar Good point, Currently there's no such things in frontend. For now, what user see in frontend is that a new interpreter group is created. (For spark interpreter, a new spark app is started)

[jira] [Created] (ZEPPELIN-3009) Don't iterate all the properties when getting property from ZeppelinConfiguration

2017-10-25 Thread Jeff Zhang (JIRA)
Jeff Zhang created ZEPPELIN-3009: Summary: Don't iterate all the properties when getting property from ZeppelinConfiguration Key: ZEPPELIN-3009 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3009

[GitHub] zeppelin issue #2631: ZEPPELIN-2197. Interpreter Lifecycle Manager

2017-10-25 Thread Tagar
Github user Tagar commented on the issue: https://github.com/apache/zeppelin/pull/2631 One last thing - from user experience it would be convenient to know when their interpreters timed out. Something like a popup or just some sort of a graphical flag would do, I guess? Not s

[GitHub] zeppelin issue #2631: ZEPPELIN-2197. Interpreter Lifecycle Manager

2017-10-25 Thread Tagar
Github user Tagar commented on the issue: https://github.com/apache/zeppelin/pull/2631 @zjffdu got it - thank you. ---

[GitHub] zeppelin issue #2631: ZEPPELIN-2197. Interpreter Lifecycle Manager

2017-10-25 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/2631 @Gauravshah It won't be killed. Because JobRunner in zeppelin server process will poll the job status periodically . Add one more test to verify it. ---

[GitHub] zeppelin issue #2631: ZEPPELIN-2197. Interpreter Lifecycle Manager

2017-10-25 Thread Gauravshah
Github user Gauravshah commented on the issue: https://github.com/apache/zeppelin/pull/2631 @zjffdu what if I am not on my desk and not polling the job ? ---

[GitHub] zeppelin issue #2627: [ZEPPELIN-2368]. Option to run all paragraphs *sequent...

2017-10-25 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/2627 @namanmishra91 In that case, the paragraph will be execute twice. One improvement thing I think we can do it in frontend is to freeze the frontend to disable user run paragraphes when user click th

[GitHub] zeppelin pull request #2632: [HotFix] - Incorrect interpreter dir

2017-10-25 Thread zjffdu
Github user zjffdu closed the pull request at: https://github.com/apache/zeppelin/pull/2632 ---

[GitHub] zeppelin pull request #2632: [HotFix] - Incorrect interpreter dir

2017-10-25 Thread zjffdu
GitHub user zjffdu opened a pull request: https://github.com/apache/zeppelin/pull/2632 [HotFix] - Incorrect interpreter dir ### What is this PR for? This is for the bug hotfix introduced in #2592 . The issue is that new interpreter created can not run properly because the i

[GitHub] zeppelin issue #2631: ZEPPELIN-2197. Interpreter Lifecycle Manager

2017-10-25 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/2631 @jongyoul For now, only Interpreter Process's lifecycle is controlled in TimeoutLifecycleManager. session level control will be done in future if necessary. https://github.com/apache/zeppelin/pull

[GitHub] zeppelin issue #2631: ZEPPELIN-2197. Interpreter Lifecycle Manager

2017-10-25 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/2631 @Tagar It won't be killed, because LifecycleManager will know client is polling job progress via api Interpreter.getProgress. https://github.com/apache/zeppelin/pull/2631/files#diff-f55969c5887615

[jira] [Created] (ZEPPELIN-3008) Please update Scala 2.11 version from 2.11.7 to 2.11.8

2017-10-25 Thread JIRA
François Garillot created ZEPPELIN-3008: --- Summary: Please update Scala 2.11 version from 2.11.7 to 2.11.8 Key: ZEPPELIN-3008 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3008 Project: Zepp

[GitHub] zeppelin issue #2627: [ZEPPELIN-2368]. Option to run all paragraphs *sequent...

2017-10-25 Thread namanmishra91
Github user namanmishra91 commented on the issue: https://github.com/apache/zeppelin/pull/2627 @zjffdu Yes, that's right. ---

[GitHub] zeppelin issue #2631: ZEPPELIN-2197. Interpreter Lifecycle Manager

2017-10-25 Thread Tagar
Github user Tagar commented on the issue: https://github.com/apache/zeppelin/pull/2631 Thank you @zjffdu. I just thought about this scenario: a Spark job runs for 1.5 hours, would it be killed by the LifeCycleManager in this case? (assuming here default timeout of 1 hour) If i

Re: Read Hbase table in pyspark gives java.lang.ClassNotFoundException: org.apache.phoenix.jdbc.PhoenixDriver

2017-10-25 Thread Jongyoul Lee
Hi, I'm not sure but you can try to locate them under interpreter/spark if you can do it JL On Wed, Oct 25, 2017 at 3:05 PM, Indtiny S wrote: > Hi, > I am trying to read Hbase tables in pyspark data frame, > I am using the below code > but I am getting the ClassNotFoundException error > > df=

[GitHub] zeppelin issue #2630: [HOTFIX] fix build spark and R interpreters

2017-10-25 Thread jongyoul
Github user jongyoul commented on the issue: https://github.com/apache/zeppelin/pull/2630 Yes, I know the current situation and this PR solves what kind of problem, but our merge script uses squash merge from PR branch and it means if that PR branch has `property` in that branch, it w

[GitHub] zeppelin issue #2630: [HOTFIX] fix build spark and R interpreters

2017-10-25 Thread tinkoff-dwh
Github user tinkoff-dwh commented on the issue: https://github.com/apache/zeppelin/pull/2630 @jongyoul this branch has no conflicts with branch master. In CI all ok, because branch of PR has field property. After merge jobs falls (CI, branch master) https://travis-ci.org/apache/z

[GitHub] zeppelin issue #2631: ZEPPELIN-2197. Interpreter Lifecycle Manager

2017-10-25 Thread jongyoul
Github user jongyoul commented on the issue: https://github.com/apache/zeppelin/pull/2631 I have a basic question. Does it work in `scoped` and `isolated`? ---

[GitHub] zeppelin issue #2630: [HOTFIX] fix build spark and R interpreters

2017-10-25 Thread jongyoul
Github user jongyoul commented on the issue: https://github.com/apache/zeppelin/pull/2630 Yes, what I wondered is how that PR passed our CI. `property` doesn't exist in the class and it shouldn't have passed CI. May we have a hole on our CI? ---

Re: Error while building Zeppelin master

2017-10-25 Thread Jongyoul Lee
This looks like a bug building in Window env. Can you do that on Linux or Mac? On Tue, Oct 24, 2017 at 11:56 PM, Andrea Santurbano wrote: > Hi guys, > when i try to build Zeppelin from apache master repo on Windows 10 i get > this error: > > [ERROR] Failed to execute goal > org.apache.maven.plug

[jira] [Created] (ZEPPELIN-3007) Display a note name without any path in the tab title

2017-10-25 Thread Tinkoff DWH (JIRA)
Tinkoff DWH created ZEPPELIN-3007: - Summary: Display a note name without any path in the tab title Key: ZEPPELIN-3007 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3007 Project: Zeppelin

Re: Read Hbase table in pyspark

2017-10-25 Thread Indtiny S
please help on this . On Wed, Oct 25, 2017 at 11:35 AM, Indtiny S wrote: > Hi, > I am trying to read Hbase tables in pyspark data frame, > I am using the below code > but I am getting the ClassNotFoundException error > > df=sqlContext.read.format('jdbc').options(driver="org. > apache.phoenix.j

[GitHub] zeppelin issue #2628: [ZEPPELIN-2999] Cannot create shell interpreter withou...

2017-10-25 Thread prabhjyotsingh
Github user prabhjyotsingh commented on the issue: https://github.com/apache/zeppelin/pull/2628 Thanks for the review, will merge this if no more discussion. ---

[GitHub] zeppelin pull request #2628: [ZEPPELIN-2999] Cannot create shell interpreter...

2017-10-25 Thread prabhjyotsingh
GitHub user prabhjyotsingh reopened a pull request: https://github.com/apache/zeppelin/pull/2628 [ZEPPELIN-2999] Cannot create shell interpreter without timeout property ### What is this PR for? A user can not run any shell interpreter if "shell.command.timeout.millisecs" is not

[GitHub] zeppelin pull request #2628: [ZEPPELIN-2999] Cannot create shell interpreter...

2017-10-25 Thread prabhjyotsingh
Github user prabhjyotsingh closed the pull request at: https://github.com/apache/zeppelin/pull/2628 ---

[GitHub] zeppelin issue #2631: ZEPPELIN-2197. Interpreter Lifecycle Manager

2017-10-25 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/2631 @Leemoonsoo @jongyoul @Tagar Please help review. Thanks ---

[GitHub] zeppelin pull request #2631: ZEPPELIN-2197. Interpreter Lifecycle Manager

2017-10-25 Thread zjffdu
GitHub user zjffdu opened a pull request: https://github.com/apache/zeppelin/pull/2631 ZEPPELIN-2197. Interpreter Lifecycle Manager ### What is this PR for? This PR implement the lifecycle manager. There're 2 implementions. * NullLifecycleManager. Nothing is done as befor

[GitHub] zeppelin issue #2630: [HOTFIX] fix build spark and R interpreters

2017-10-25 Thread tinkoff-dwh
Github user tinkoff-dwh commented on the issue: https://github.com/apache/zeppelin/pull/2630 @jongyoul @zjffdu after merge https://github.com/apache/zeppelin/pull/2596 https://github.com/apache/zeppelin/pull/2596/files#diff-dbda0c4083ad9c59ff05f0273b5e760fR935 `proper