It was too simple to setup .. I just had not spent time .. and also with respect to running the spark-app in yarn-client mode and connecting to it was a good suggestion. Thank you! Sunil.
On Tue, Nov 3, 2015 at 7:46 PM, Asim Jalis <asimja...@gmail.com> wrote: > Hi Sunil, > > Yes. This should work. I have used something much simpler in the past such > as server-socket. This starts listening on a specific port and then you can > telnet to that port from your client and start telnet with rlwrap to get > history and editing. > > Asim > > On Tue, Nov 3, 2015 at 12:00 AM, Sunil S Nandihalli < > sunil.nandiha...@gmail.com> wrote: > >> I can embed an nrepl-server in a driver program and submit that jar and >> then connect the nrepl-server to my emacs cider and work with it. I have >> just never done it. May be it is time to understand how instead of just >> doing >> >> M-x cider-jack-in >> >> Thanks Asim for pointing in the right direction. >> Regards, >> Sunil. >> >> >> On Tue, Nov 3, 2015 at 12:05 PM, Sunil S Nandihalli < >> sunil.nandiha...@gmail.com> wrote: >> >>> Thanks Asim for this suggestion. I wanted to do it but did not have the >>> bandwidth to explore how to do it.. I am new to spark.. I usually do >>> repl-driven dev for local apps... Have you done repl-driven using spark and >>> clojure? do you have pointers as to how to do it.. I can explore if you >>> tell me that there really are no problems in doing that. >>> >>> Regards, >>> Sunil. >>> >>> On Tue, Nov 3, 2015 at 12:48 AM, Asim Jalis <asimja...@gmail.com> wrote: >>> >>>> Hi Sunil, >>>> >>>> Here is something to think about. Can you use the REPL for your >>>> workflow instead? >>>> >>>> If the changes are all in the Spark driver code you can run the driver >>>> inside the REPL and then test out the changes in the REPL. Once you have >>>> something that works you can save that and deploy an uberjar. >>>> >>>> Deploying an uberjar 4-5 times an hour feels like it goes against the >>>> spirit of Clojure. >>>> >>>> Asim >>>> >>>> On Sun, Nov 1, 2015 at 10:10 PM, Sunil S Nandihalli < >>>> sunil.nandiha...@gmail.com> wrote: >>>> >>>>> Hi Asim, >>>>> I needed to run lein uberjar to submit the jar to run a distributed >>>>> job on a apache-spark cluster. and my uberjar is currently taking >>>>> anywhere >>>>> from 2 to 4 minutes to finish. I have have had to run uberjar fairly >>>>> frequently during my iterations ( 4 to 5 times in an hour) . I am new to >>>>> spark. So I need to quickly iterate with changes in the code. >>>>> >>>>> Thanks for asking. >>>>> Regards, >>>>> Sunil. >>>>> >>>>> On Mon, Nov 2, 2015 at 6:09 AM, Asim Jalis <asimja...@gmail.com> >>>>> wrote: >>>>> >>>>>> Hi Sunil, >>>>>> >>>>>> I am wondering why you want to speed up lein uberjar. >>>>>> >>>>>> How frequently do you need to run this? >>>>>> >>>>>> What is your use case and workflow around this? >>>>>> >>>>>> Thanks. >>>>>> >>>>>> Asim >>>>>> >>>>>> On Mon, Oct 26, 2015 at 2:04 AM, Sunil S Nandihalli < >>>>>> sunil.nandiha...@gmail.com> wrote: >>>>>> >>>>>>> Hi Everybody, >>>>>>> My lein uberjar takes about 2 minutes to run. It also recompiles >>>>>>> all the clj files everytime. Is there a way to speedup lein-uberjar .. >>>>>>> Or >>>>>>> may be make it incremental? >>>>>>> Thanks, >>>>>>> Sunil. >>>>>>> >>>>>>> -- >>>>>>> You received this message because you are subscribed to the Google >>>>>>> Groups "Clojure" group. >>>>>>> To post to this group, send email to clojure@googlegroups.com >>>>>>> Note that posts from new members are moderated - please be patient >>>>>>> with your first post. >>>>>>> To unsubscribe from this group, send email to >>>>>>> clojure+unsubscr...@googlegroups.com >>>>>>> For more options, visit this group at >>>>>>> http://groups.google.com/group/clojure?hl=en >>>>>>> --- >>>>>>> You received this message because you are subscribed to the Google >>>>>>> Groups "Clojure" group. >>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>> send an email to clojure+unsubscr...@googlegroups.com. >>>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>>> >>>>>> >>>>>> -- >>>>>> You received this message because you are subscribed to the Google >>>>>> Groups "Clojure" group. >>>>>> To post to this group, send email to clojure@googlegroups.com >>>>>> Note that posts from new members are moderated - please be patient >>>>>> with your first post. >>>>>> To unsubscribe from this group, send email to >>>>>> clojure+unsubscr...@googlegroups.com >>>>>> For more options, visit this group at >>>>>> http://groups.google.com/group/clojure?hl=en >>>>>> --- >>>>>> You received this message because you are subscribed to the Google >>>>>> Groups "Clojure" group. >>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>> send an email to clojure+unsubscr...@googlegroups.com. >>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>> >>>>> >>>>> -- >>>>> You received this message because you are subscribed to the Google >>>>> Groups "Clojure" group. >>>>> To post to this group, send email to clojure@googlegroups.com >>>>> Note that posts from new members are moderated - please be patient >>>>> with your first post. >>>>> To unsubscribe from this group, send email to >>>>> clojure+unsubscr...@googlegroups.com >>>>> For more options, visit this group at >>>>> http://groups.google.com/group/clojure?hl=en >>>>> --- >>>>> You received this message because you are subscribed to the Google >>>>> Groups "Clojure" group. >>>>> To unsubscribe from this group and stop receiving emails from it, send >>>>> an email to clojure+unsubscr...@googlegroups.com. >>>>> For more options, visit https://groups.google.com/d/optout. >>>>> >>>> >>>> -- >>>> You received this message because you are subscribed to the Google >>>> Groups "Clojure" group. >>>> To post to this group, send email to clojure@googlegroups.com >>>> Note that posts from new members are moderated - please be patient with >>>> your first post. >>>> To unsubscribe from this group, send email to >>>> clojure+unsubscr...@googlegroups.com >>>> For more options, visit this group at >>>> http://groups.google.com/group/clojure?hl=en >>>> --- >>>> You received this message because you are subscribed to the Google >>>> Groups "Clojure" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to clojure+unsubscr...@googlegroups.com. >>>> For more options, visit https://groups.google.com/d/optout. >>>> >>> >>> >> -- >> You received this message because you are subscribed to the Google >> Groups "Clojure" group. >> To post to this group, send email to clojure@googlegroups.com >> Note that posts from new members are moderated - please be patient with >> your first post. >> To unsubscribe from this group, send email to >> clojure+unsubscr...@googlegroups.com >> For more options, visit this group at >> http://groups.google.com/group/clojure?hl=en >> --- >> You received this message because you are subscribed to the Google Groups >> "Clojure" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to clojure+unsubscr...@googlegroups.com. >> For more options, visit https://groups.google.com/d/optout. >> > > -- > You received this message because you are subscribed to the Google > Groups "Clojure" group. > To post to this group, send email to clojure@googlegroups.com > Note that posts from new members are moderated - please be patient with > your first post. > To unsubscribe from this group, send email to > clojure+unsubscr...@googlegroups.com > For more options, visit this group at > http://groups.google.com/group/clojure?hl=en > --- > You received this message because you are subscribed to the Google Groups > "Clojure" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to clojure+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "Clojure" group. To post to this group, send email to clojure@googlegroups.com Note that posts from new members are moderated - please be patient with your first post. To unsubscribe from this group, send email to clojure+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/clojure?hl=en --- You received this message because you are subscribed to the Google Groups "Clojure" group. To unsubscribe from this group and stop receiving emails from it, send an email to clojure+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
