Spark performance after update to 0.8.2

2020-03-24 Thread Sebastian Albrecht
Hi, i just upgraded from zeppelin 0.7.3 to 0.8.2. I am using zeppelin for spark in local mode and 0.8.2 came with spark updated to 2.2.1. I now experience slower spark job executions. I can show it in these log snippets: task executions with 0.7.3: milliseconds, 0.8.2: seconds 0.7.3 INFO [2020-03-

Re: Spark performance after update to 0.8.2

2020-03-24 Thread Jeff Zhang
Do you use the same version of spark for zeppelin 0.7 & 0.8 ? What kind of job do you run ? Is it easy to reproduce it ? Sebastian Albrecht 于2020年3月24日周二 下午4:24写道: > Hi, > i just upgraded from zeppelin 0.7.3 to 0.8.2. I am using zeppelin for > spark in local mode and 0.8.2 came with spark update

Re: Spark performance after update to 0.8.2

2020-03-24 Thread Sebastian Albrecht
Hi Jeff, Am Di., 24. März 2020 um 09:39 Uhr schrieb Jeff Zhang : > Do you use the same version of spark for zeppelin 0.7 & 0.8 ? What kind of > job do you run ? Is it easy to reproduce it ? > Zeppelin comes with spark 2.1.0 in 0.7.3 and spark 2.2.1 in 0.8.2, so different version. In this case it

Re: Spark performance after update to 0.8.2(Internet mail)

2020-03-24 Thread lewinma(lewinma)
Hi, jeff, are there some docs about the architecture about zeppelin? Any kind of help would be very grateful. From: Sebastian Albrecht Reply-To: "users@zeppelin.apache.org" Date: Tuesday, March 24, 2020 at 19:11 To: "users@zeppelin.apache.org" Subject: Re: Spark performance after update to 0

Re: Spark performance after update to 0.8.2(Internet mail)

2020-03-24 Thread Jeff Zhang
Hi lewinma, The most comprehensive document is the zeppelin official docs. Let us know what kind of problem/concern that you would like to address. BTW, we do need to improve the docs, maybe we should do better on docs in the next release. lewinma(lewinma) 于2020年3月24日周二 下午9:52写道: > Hi, jeff,

Re: Spark performance after update to 0.8.2(Internet mail)

2020-03-24 Thread lewinma(lewinma)
Thank you for your reply. And I want to know is there some demo or doc about how to profiling and debug zeppelin on a local machine. Thanks a lot. From: Jeff Zhang Reply-To: "users@zeppelin.apache.org" Date: Tuesday, March 24, 2020 at 23:40 To: users Subject: Re: Spark performance after update

Re: Spark performance after update to 0.8.2(Internet mail)

2020-03-24 Thread Jeff Zhang
Hi lewinma, Here's one article about how to debug zeppelin https://medium.com/@zjffdu/how-to-debug-and-diagnose-apache-zeppelin-6fc239df8a49 Regarding profiling, any java profiling tool could be used. lewinma(lewinma) 于2020年3月25日周三 上午12:08写道: > Thank you for your reply. > > And I want to know

Re: Spark performance after update to 0.8.2(Internet mail)

2020-03-24 Thread lewinma(lewinma)
Thank you, jeff, we may could create a repo namely like awesome-zeppelin 😊 From: Jeff Zhang Reply-To: "users@zeppelin.apache.org" Date: Wednesday, March 25, 2020 at 10:10 To: users Subject: Re: Spark performance after update to 0.8.2(Internet mail) Hi lewinma, Here's one article about how

Re: Spark performance after update to 0.8.2(Internet mail)

2020-03-24 Thread Jeff Zhang
hmm,that sounds like a good idea lewinma(lewinma) 于2020年3月25日周三 上午10:52写道: > Thank you, jeff, we may could create a repo namely like > awesome-zeppelin 😊 > > > > *From: *Jeff Zhang > *Reply-To: *"users@zeppelin.apache.org" > *Date: *Wednesday, March 25, 2020 at 10:10 > *To: *users > *Subje

Re: [VOTE] Release Apache Zeppelin 0.9.0-preview1 (RC1)

2020-03-24 Thread Jongyoul Lee
+1 2020년 3월 24일 (화) 오전 12:15, Jeff Zhang 님이 작성: > Hi folks, > > I propose the following RC to be released for the Apache Zeppelin > 0.9.0-preview1 release. > > > The commit id is a74365c0813b451db1bc78def7d1ad1279429224 : > > https://gitbox.apache.org/repos/asf?p=zeppelin.git;a=commit;h=a74365c08