Re: Python interpreter Pending issue with K8S mode

park HTH view my Linkedin profile <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this email's

Re: Scala 2.12 version mismatch for Spark Interpreter

tps://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this email's technical content is explicitly disclaimed. The author will in no cas

Re: Scala 2.12 version mismatch for Spark Interpreter

apologies should say the docker image should be on 3.1.1 view my Linkedin profile <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may

Re: Spark on k8s cluster mode, from outside of the cluster. [SOLVED]

ity will be offering ready build dockers shortly from the official spark community site for different versions. HTH view my Linkedin profile <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or d

Adding main and access titles to Zeppelin's chart

Hi, Is there anyway one can add the main and axis titles to Zeppelin charts such as "Company XYZ daily prices", x= day, Y = price etc Thanks Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com

Re: Adding main and access titles to Zeppelin's chart

Thanks Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* http://talebzadehmich.wordpress.com *Disclaimer:* Use it at your own risk. Any a

Using Zeppelin continuously with the same UI open

in the run. Then in order to make this work I recycle (stop/start) Zeppelin daemon and things start working. Is this behavior expected or is this due to excessive memory usage/GC issue. FYI I am using zeppelin-0.6.1 Thanks Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profi

Re: Using Zeppelin continuously with the same UI open

x27;TIMECREATED,12,19)> minutesago).select(substring('TIMECREATED,12,19).as("TIMECREATED"), 'SECURITY, substring('PRICE,1,7).as("PRICE")).orderBy('TIMECREATED) rs } case _ => { sys.error("No valid option provided")

Re: Multiple concurrent spark notebooks

above. HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* http://talebzadehmich.wordpress.com *Disclaimer:* Use it at your own risk. A

Re: Problem with local jars in Zeppelin 0.6.1 with Spark 2.0.0

What are you doing in Spark that causes Zeppelin to throw that error. Have you loaded Jars to the interpreter as dependencies as well? [image: Inline images 1] HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <ht

Re: zeppelin with spark 2.0.1

what have you defined your export MASTER= and export SPARK_HOME= in zeppelin-env.sh Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*

Re: zeppelin with spark 2.0.1

comment out spark_home in zeppelin-env.sh and restart zeppelin to test Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*

Re: zeppelin with spark 2.0.1

put this in your env file export MASTER=spark://:7077 # Spark master url. eg. spark://master_addr:7077 as is in /etc/hosts and reboot zeppelin Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <ht

Sharing RDDS across applications and users

something like Apache Ignite. Has anyone really tried this. Will that work with multiple applications? It looks feasible as RDDs are immutable and so are registered tempTables etc. Thanks Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id

Re: Sharing RDDS across applications and users

Thanks Chanh, Can it share RDDs. Personally I have not used either Alluxio or Ignite. 1. Are there major differences between these two 2. Have you tried Alluxio for sharing Spark RDDs and if so do you have any experience you can kindly share Regards Dr Mich Talebzadeh LinkedIn

Re: Sharing RDDS across applications and users

t set. For example the same tempTable etc? Cheers Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* http://talebzadehmich.wordpress.com

Re: Sharing RDDS across applications and users

so I assume Ignite will not work with Spark version >=2? Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* http://talebzadehmich.word

Re: Sharing RDDS across applications and users

HDFS with in-memory storage where app 2 can pick up app1 results from memory or even SSD and do the work. Actually I am surprised why Spark has not incorporated this type of memory as temporary storage. Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/vi

Re: Sharing RDDS across applications and users

Hi, I think tempTable is private to the session that creates it. In Hive temp tables created by "CREATE TEMPORARY TABLE" are all private to the session. Spark is no different. The alternative may be everyone creates tempTable from the same DF? HTH Dr Mich Talebzadeh LinkedI

Zeppelin using Spark to access Hbase throws error

'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=rhes564,16201,1477246132044, seqNum=0 Is this related to Hbase region server? Thanks Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedi

Re: Zeppelin using Spark to access Hbase throws error

Hi Felix, Yes it is the same host that I run Spark shell and I start Zeppelin on. Have you observed this before? Thanks Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view

Re: spark streaming with Kafka

since only one SparkContext may be running in this JVM (see SPARK-2243). The other SparkContext was created at: So I am not Zeppelin what can do this through Zeppelin HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw &

Zeppelin or Jupiter

it vis-à-vis Zeppelin? Thanks Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* http://talebzadehmich.wordpress.com *Disclaimer:* Use it a

Re: Zeppelin or Jupiter

also noticed recently that Hortonworks are actively promoting Zeppelin. However, I do appreciate that there are fans of Python around. May be a strategy would to offer both. Having said that there are hard core users that would never give up on Tableau! Regards Dr Mich Talebzadeh LinkedIn

Re: Zeppelin or Jupiter

Guys, How Active Directory/LDAP and Kerberos are integrated with Zeppelin? thanks Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*

Re: [ANNOUNCE] Apache Zeppelin 0.7.0 released

excellent news Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* http://talebzadehmich.wordpress.com *Disclaimer:* Use it at your own ris

Re: Real-time Updated Plots with Kafka

you can use zeppelin scheduler to execute it every few seconds assuming that zeppelin has sufficient to execute every instance of the code Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view

Zeppelin versus Jupyter versus H2O Flow

Hi, Has anyone recently evaluated Zeppelin versus Jupyter versus H2O Flow by any chance? I have used Zeppelin and really a fan of it. However, I have not any exposure to Jupyter or H2O Flow. I was wondering anyone has pros and cons for each of these products by any chance. Thanks, Dr Mich

Cloudera Data Science Workbench and Zeppelin

Hi, As I understood Cloudera Data Science Workbench was based on Zeppelin. Zeppelin as open source was supported by Hortonworks and Cloudera took Zeppelin and created the Workbench. As anyone within Zeppelin community come across this Workbench and how do you rate it? Thanks Dr Mich

Re: Cloudera Data Science Workbench and Zeppelin

I was under the impression that it was based on zeppelin or originally started based on it. it would be interesting to see how it was developed as it is a relatively new comer. HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

Re: Cloudera Data Science Workbench and Zeppelin

thanks Felix. What is your experience of it if you cab share please? Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*

Connecting from Zeppelin 0.7.3 to Oracle 12c semds Spark 2.3.0 is not supported

Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* http://talebzadehmich.wordpress.com *Disclaimer:* Use it at your own risk. Any a

Re: Connecting from Zeppelin 0.7.3 to Oracle 12c semds Spark 2.3.0 is not supported

sure thanks I sorted it out. regards, Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* http://talebzadehmich.wordpress.com *Disclaimer