Re: quick question: best to use cluster mode or client mode for production?

2017-02-23 Thread Sam Elamin
I personally use spark submit as it's agnostic to which platform your spark clusters are working on e.g. Emr dataproc databricks etc On Thu, 23 Feb 2017 at 08:53, nancy henry wrote: > Hi Team, > > I have set of hc.sql("hivequery") kind of scripts which i am running right > now in spark-shell >

quick question: best to use cluster mode or client mode for production?

2017-02-23 Thread nancy henry
Hi Team, I have set of hc.sql("hivequery") kind of scripts which i am running right now in spark-shell How should i schedule it in production making it spark-shell -i script.scala or keeping it in jar file through eclipse and use spark-submit deploy mode cluster? which is advisable?

quick question

2016-12-01 Thread kant kodali
Assume I am running a Spark Client Program in client mode and Spark Cluster in Stand alone mode. I want some clarification of the following things 1. Build a DAG 2. DAG Scheduler 3. TASK Scheduler I want to which of the above part is done by SPARK CLIENT and which of the above parts are done by

Re: quick question

2016-08-25 Thread kant kodali
I/WebSockets_API Hope this helps! - Kevin On Wed, Aug 24, 2016 at 3:52 PM, kant kodali < kanth...@gmail.com > wrote: -- Forwarded message -- From: kant kodali < kanth...@gmail.com > Date: Wed, Aug 24, 2016 at 1:49 PM Subject: quick question To: d...@spark.apache.org , us

Re: quick question

2016-08-25 Thread Sivakumaran S
created using >>>> WebSockets. This technology essentially allows your web page to keep an >>>> active line of communication between the client and server, in which case >>>> you can detect and display new information without requiring any user >>&

Re: quick question

2016-08-25 Thread kant kodali
kant kodali < kanth...@gmail.com > Date: Wed, Aug 24, 2016 at 1:49 PM Subject: quick question To: d...@spark.apache.org , us...@spark.apache.org In this picture what does "Dashboards" really mean? is there a open source project which can allow me to push the results back to Dashb

Re: quick question

2016-08-25 Thread Sivakumaran S
information on this >>> concept, as well as links to several different implementations (based on >>> your programming language preferences). >>> >>> https://developer.mozilla.org/en-US/docs/Web/API/WebSockets_API >>> <https://developer.mozilla.org/

Re: quick question

2016-08-25 Thread kant kodali
orwarded message -- From: kant kodali < kanth...@gmail.com > Date: Wed, Aug 24, 2016 at 1:49 PM Subject: quick question To: d...@spark.apache.org , us...@spark.apache.org In this picture what does "Dashboards" really mean? is there a open source project which can all

Re: quick question

2016-08-25 Thread Sivakumaran S
ll as links to several different implementations (based on >> your programming language preferences). >> >> https://developer.mozilla.org/en-US/docs/Web/API/WebSockets_API >> <https://developer.mozilla.org/en-US/docs/Web/API/WebSockets_API> >> >> Hop

Re: quick question

2016-08-24 Thread kant kodali
Wed, Aug 24, 2016 at 1:49 PM Subject: quick question To: d...@spark.apache.org , us...@spark.apache.org In this picture what does "Dashboards" really mean? is there a open source project which can allow me to push the results back to Dashboards such that Dashboards are always in sync with rea

Re: quick question

2016-08-24 Thread Sivakumaran S
n-US/docs/Web/API/WebSockets_API > <https://developer.mozilla.org/en-US/docs/Web/API/WebSockets_API> > > Hope this helps! > - Kevin > > On Wed, Aug 24, 2016 at 3:52 PM, kant kodali <mailto:kanth...@gmail.com>> wrote: > > -- Forwarded message ---