[GitHub] zeppelin issue #1559: [ZEPPELIN-1461] Doesn't display "description" value in...

2016-10-27 Thread prabhjyotsingh
Github user prabhjyotsingh commented on the issue:

https://github.com/apache/zeppelin/pull/1559
  
Tested on local LGTM.
+1 for adding more test cases!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1514: ZEPPELIN-1516. NPE LivySparkSQLInterpreter thro...

2016-10-27 Thread zjffdu
Github user zjffdu closed the pull request at:

https://github.com/apache/zeppelin/pull/1514


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1514: ZEPPELIN-1516. NPE LivySparkSQLInterpreter thro...

2016-10-27 Thread zjffdu
GitHub user zjffdu reopened a pull request:

https://github.com/apache/zeppelin/pull/1514

ZEPPELIN-1516. NPE LivySparkSQLInterpreter thrown with %livy.sql interpreter

### What is this PR for?
This PR fixed NPE issue in `LivySparkSQLIntepreter`, also it resolves the 
multiple thread issues discussed in #1503


### What type of PR is it?
[Bug Fix]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-1516

### How should this be tested?
* Enable shiro
* Log in 2 users in 2 browsers
* Start livy sql paragraph at almost the same time
* 2 livy sessions are created correctly. 

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/zjffdu/zeppelin ZEPPELIN-1516

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1514.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1514


commit 0b5825c6769ecb3382c4d2569380fde70d8a032b
Author: Jeff Zhang 
Date:   2016-10-14T01:27:52Z

ZEPPELIN-1516. NPE LivySparkSQLInterpreter thrown with %livy.sql interpreter

commit fc5692df27ed4d2313b0c0d43bcc26f11efab5f3
Author: Jeff Zhang 
Date:   2016-10-27T05:38:03Z

add test




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-1584) Zeppelin on Windows 10 fails to load conf and interpreter

2016-10-27 Thread Dustin DeMeo (JIRA)
Dustin DeMeo created ZEPPELIN-1584:
--

 Summary: Zeppelin on Windows 10 fails to load conf and interpreter
 Key: ZEPPELIN-1584
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1584
 Project: Zeppelin
  Issue Type: Bug
  Components: Core, Interpreters
Affects Versions: 0.6.2
 Environment: * Notebook w/ i5-5200 CPU / 16GB RAM
* Windows 10 Home Anniversary (64-bit Version 10.0.14393)
* Chrome 53.0.2785.143 m (64-bit)
* Spark 2.0.1 installed to C:\spark
* Zeppelin 0.6.2 download (prebuilt) installed to C:\zeppelin
* java version "1.8.0_112" installed to C:\Program Files\Java\jre1.8.0_112
* jdk version "1.8.0_112" installed to C:\Program Files\Java\jdk1.8.0_112
* Windows environment %JAVA_HOME%, %JDK_HOME%, %SPARK_HOME%, and %HADOOP_HOME% 
set via Windows 10 "Advanced system settings"
* Current setup successfully runs spark 2.0.1 through spark-shell, 
spark-submit, ScalaIDE, and IntelliJ
* Run from cmd (both as user and as administrator):
** c:\zeppelin\bin>zeppelin.cmd
** c:\zeppelin\bin>zeppelin.cmd --config ../conf
** I have also tried running all of the cmd files in bin as well as 
zeppelin-env.cmd before running zeppelin.cmd
Reporter: Dustin DeMeo


Hi [~moon], [~Pallavi], and [~luxs...@gmail.com]

This issue is similar to [ZEPPELIN-647] (see last comment) and [ZEPPELIN-1506] 
except I was able to create a notebook and I couldn't find any errors related 
to JSP support in the log.

Two issues I cannot seem to resolve are:
# zeppelin does not load the configuration file
# The UI opens but spark does not run the code because zeppelin cannot create 
an interpreter

Note, I tried to invoke the embedded spark interpreter directly with cmd (as 
found in the zeppelin log) and got the following error:

{panel:title=Relevant cmd stdout}
C:\Users\lab>c:\zeppelin\bin\interpreter.cmd -d c:\zeppelin\interpreter\spark 
-p 60076 -l c:\zeppelin/local-repo/2C2APP9EQ
The filename, directory name, or volume label syntax is incorrect.
{panel}

I tried changing the / to \ and got the same error:

{panel:title=Relevant cmd stdout}
C:\Users\lab>c:\zeppelin\bin\interpreter.cmd -d c:\zeppelin\interpreter\spark 
-p 60076 -l c:\zeppelin\local-repo\2C2APP9EQ
The filename, directory name, or volume label syntax is incorrect.
{panel}

I noticed that the local-repo/[] folder wasn't created so I created it, tried 
to invoke the embedded spark interpreter from cmd again, and got the new error: 

{panel:title=Relevant cmd stdout}
C:\Users\lab>mkdir c:\zeppelin\local-repo\2C2APP9EQ
C:\Users\lab>c:\zeppelin\bin\interpreter.cmd -d c:\zeppelin\interpreter\spark 
-p 60076 -l c:\zeppelin\local-repo\2C2APP9EQ
The system cannot find the path specified.
{panel}

I have attached relevant information, screenshots, and logs. Below are some 
interesting errors/warnings/info.

Thanks

{panel:title=Relevant ZEPPELIN_HOME/conf/zeppelin-env.cmd}
set ZEPPELIN_JAVA_OPTS=-Dspark.driver.memory=10g -Dspark.cores.max=2
set SPARK_HOME=C:\spark
{panel}

{panel:title=Relevant cmd stdout}
c:\zeppelin\bin>zeppelin.cmd
...
  WARNING: A HTTP GET method, public javax.ws.rs.core.Response 
org.apache.zeppelin.rest.InterpreterRestApi.listInterpreter(java.lang.String), 
should not consume any entity.
  WARNING: A sub-resource method, public javax.ws.rs.core.Response 
org.apache.zeppelin.rest.NotebookRestApi.createNote(java.lang.String) throws 
java.io.IOException, with URI template, "/", is treated as a resource method
  WARNING: A sub-resource method, public javax.ws.rs.core.Response 
org.apache.zeppelin.rest.NotebookRestApi.getNotebookList() throws 
java.io.IOException, with URI template, "/", is treated as a resource method
The filename, directory name, or volume label syntax is incorrect.
{panel}

{panel:title=Relevant ZEPPELIN_HOME/logs/10_26.log}
 WARN [2016-10-27 00:03:27,486] ({main} ZeppelinConfiguration.java[create]:94) 
- Failed to load configuration, proceeding with a default
...
ERROR [2016-10-27 00:03:29,981] ({main} Interpreter.java[register]:315) - 
Static initialization is deprecated. You should change it to use 
interpreter-setting.json in your jar or 
interpreter/{interpreter}/interpreter-setting.json
 INFO [2016-10-27 00:03:29,981] ({main} InterpreterFactory.java[init]:154) - 
Interpreter python.python found. 
class=org.apache.zeppelin.python.PythonInterpreter
 INFO [2016-10-27 00:03:30,000] ({main} InterpreterFactory.java[init]:154) - 
Interpreter sh.sh found. class=org.apache.zeppelin.shell.ShellInterpreter
 INFO [2016-10-27 00:03:30,422] ({main} InterpreterFactory.java[init]:154) - 
Interpreter spark.spark found. class=org.apache.zeppelin.spark.SparkInterpreter
...
INFO [2016-10-27 00:05:42,207] ({pool-1-thread-2} 
RemoteInterpreterProcess.java[reference]:148) - Run interpreter process 
[c:\zeppelin\bin\interpreter.cmd, -d, c:\zeppelin\interpreter\spark, -p, 59903, 
-l, c:\zeppelin/local-repo/2C2APP9EQ]
 INFO [2016-1

[GitHub] zeppelin pull request #1553: [ZEPPELIN-1575] Notebook Repo settings UI

2016-10-27 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1553


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-1585) Add testcase of PySparkInterpreter.

2016-10-27 Thread Shim HyungSung (JIRA)
Shim HyungSung created ZEPPELIN-1585:


 Summary: Add testcase of PySparkInterpreter.
 Key: ZEPPELIN-1585
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1585
 Project: Zeppelin
  Issue Type: Test
  Components: pySpark
Affects Versions: 0.7.0
Reporter: Shim HyungSung
 Fix For: 0.7.0


Zeppelin don't have testcase for PySparkInterpreter so I think we need it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] zeppelin pull request #1564: [ZEPPELIN-1585] Testcase for PySparkInterpreter...

2016-10-27 Thread astroshim
GitHub user astroshim opened a pull request:

https://github.com/apache/zeppelin/pull/1564

[ZEPPELIN-1585] Testcase for PySparkInterpreter.

### What is this PR for?
This PR adds PySparkInterpreter testcase.


### What type of PR is it?
Improvement


### What is the Jira issue?


### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/astroshim/zeppelin feat/pySparkInterpreterTest

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1564.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1564


commit 499aa6bf3439b9e2524de59067f6d88eb6aec9bf
Author: astroshim 
Date:   2016-10-19T23:31:04Z

add PySparkInterpreter testcase

commit 3fe0c7e4baf447756e8aeef218401e70a4d65041
Author: astroshim 
Date:   2016-10-21T10:55:15Z

Merge branch 'master' into feat/pySparkInterpreterTest

commit 51aa813f0e4a9c2000f72e1ec10279f9f9328915
Author: astroshim 
Date:   2016-10-21T14:43:45Z

add PySparkInterpreter testcase.

commit 265a82b93a66ec568bc3550c89b89fd562a403cb
Author: astroshim 
Date:   2016-10-21T15:50:04Z

change scope




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1497: [ZEPPELIN-1233] Support Redis interpreter

2016-10-27 Thread darionyaphet
Github user darionyaphet commented on the issue:

https://github.com/apache/zeppelin/pull/1497
  
Aha. A lot of files conflict and I can't resolve that . Maybe I will close 
this one and reopen another .


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1497: [ZEPPELIN-1233] Support Redis interpreter

2016-10-27 Thread HeartSaVioR
Github user HeartSaVioR commented on the issue:

https://github.com/apache/zeppelin/pull/1497
  
Follow this:
1. create a new branch which is based on current master
2. cherry-pick your commits (write down your last commit id)
3. change branch to PR's branch
4. git reset --hard `last commit id`
5. git push --force

`last commit id` might be replaced with branch name you created, but I 
didn't try it.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1565: [ZEPPELIN-1564] Enable note deletion and paragr...

2016-10-27 Thread minahlee
GitHub user minahlee opened a pull request:

https://github.com/apache/zeppelin/pull/1565

[ZEPPELIN-1564] Enable note deletion and paragraph output clear from main 
page

### What is this PR for?
* Enables removing note and clear all paragraph's output from Zeppelin main 
page.
* Add rest api for clearing all paragraph output
Next possible improvement can be removing notes in folder level.

### What type of PR is it?
Improvement

### What is the Jira issue?
[ZEPPELIN-1564](https://issues.apache.org/jira/browse/ZEPPELIN-1564)

### Screenshots (if appropriate)
![oct-27-2016 
18-26-03](https://cloud.githubusercontent.com/assets/8503346/19761938/e013ea02-9c72-11e6-9a08-0a70aca145d2.gif)


### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? yes


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/minahlee/zeppelin ZEPPELIN-1564

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1565.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1565


commit cb70a6e9593c2dc748e04dc2d43ebac9c1b52a5a
Author: Mina Lee 
Date:   2016-10-27T07:50:18Z

Clear all paragraphs and remove note from main page

commit 8b25f27ecc6c2674f50377f7828c9c4d723db012
Author: Mina Lee 
Date:   2016-10-27T08:07:29Z

Add clearAllParagraphOutput unit test

commit f0962579e143f47946e8fa64f247abe91373f2f1
Author: Mina Lee 
Date:   2016-10-27T08:53:33Z

Add rest api for clear all paragraph result and add test

commit 4f61c31c5b8e8ff0855bfe0e272bd7cd92bd1f39
Author: Mina Lee 
Date:   2016-10-27T09:10:58Z

Add rest api endpoint for clear paragraph result to document

commit 70eb294e26e41da953385ff94379fe3e7cec4716
Author: Mina Lee 
Date:   2016-10-27T09:14:42Z

Remove unused import




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1176: [Zeppelin 1165 : improve] Paragraph dynamic relationsh...

2016-10-27 Thread xiufengliu
Github user xiufengliu commented on the issue:

https://github.com/apache/zeppelin/pull/1176
  
Dear corneadoug:
May I ask if this pull request work is based on the zeppelin 7.0? Are there 
any problems to use it for now since I saw there are some conflicting files in 
the above checks? Thanks

/Xiufeng


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1540: [ZEPPELIN-1566] Make paragraph editable with double cl...

2016-10-27 Thread anthonycorbacho
Github user anthonycorbacho commented on the issue:

https://github.com/apache/zeppelin/pull/1540
  
Awesome, **LGTM**


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1540: [ZEPPELIN-1566] Make paragraph editable with double cl...

2016-10-27 Thread minahlee
Github user minahlee commented on the issue:

https://github.com/apache/zeppelin/pull/1540
  
@jongyoul @anthonycorbacho Thank you for review! Merging if there is no 
more discussion.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-1586) Add security check in Notebook Rest api

2016-10-27 Thread Anthony Corbacho (JIRA)
Anthony Corbacho created ZEPPELIN-1586:
--

 Summary: Add security check in Notebook Rest api
 Key: ZEPPELIN-1586
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1586
 Project: Zeppelin
  Issue Type: Bug
  Components: security, rest-api
Affects Versions: 0.7.0
Reporter: Anthony Corbacho
Assignee: Anthony Corbacho
Priority: Critical


Notebook rest api endpoint doesnt provide any security check of any kind, that 
meant that any body can use the rest api and do whatever they want.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] zeppelin issue #1565: [ZEPPELIN-1564] Enable note deletion and paragraph out...

2016-10-27 Thread minahlee
Github user minahlee commented on the issue:

https://github.com/apache/zeppelin/pull/1565
  
@khalidhuseynov Thank you for review. I made "clear paragraph output" in 
main page for the case that note's output data is too big so it causes Zeppelin 
fail to load note and hang. 
Here are tickets reporting this issue: 
[ZEPPELIN-1564](https://issues.apache.org/jira/browse/ZEPPELIN-1564), 
[ZEPPELIN-1491](https://issues.apache.org/jira/browse/ZEPPELIN-1491)

The more optimal solution would be improving data loading and rendering 
itself. We might not need "clear paragraph output" button once we improve this 
performance issue.

I believe having delete button on the main page is beneficial in terms of 
UX in case user wants to delete multiple notes. They won't need to navigate 
into each note to delete them. I am planning to implement remove folder & edit 
folder name in main page after this PR is merged.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1552: [ZEPPELIN-1576] bump flink to 1.1.3

2016-10-27 Thread minahlee
Github user minahlee commented on the issue:

https://github.com/apache/zeppelin/pull/1552
  
Merging if there is no more discussion


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---