Thanks Asim for this suggestion. I wanted to do it but did not have the bandwidth to explore how to do it.. I am new to spark.. I usually do repl-driven dev for local apps... Have you done repl-driven using spark and clojure? do you have pointers as to how to do it.. I can explore if you tell me that there really are no problems in doing that.
Regards, Sunil. On Tue, Nov 3, 2015 at 12:48 AM, Asim Jalis <[email protected]> wrote: > Hi Sunil, > > Here is something to think about. Can you use the REPL for your workflow > instead? > > If the changes are all in the Spark driver code you can run the driver > inside the REPL and then test out the changes in the REPL. Once you have > something that works you can save that and deploy an uberjar. > > Deploying an uberjar 4-5 times an hour feels like it goes against the > spirit of Clojure. > > Asim > > On Sun, Nov 1, 2015 at 10:10 PM, Sunil S Nandihalli < > [email protected]> wrote: > >> Hi Asim, >> I needed to run lein uberjar to submit the jar to run a distributed job >> on a apache-spark cluster. and my uberjar is currently taking anywhere >> from 2 to 4 minutes to finish. I have have had to run uberjar fairly >> frequently during my iterations ( 4 to 5 times in an hour) . I am new to >> spark. So I need to quickly iterate with changes in the code. >> >> Thanks for asking. >> Regards, >> Sunil. >> >> On Mon, Nov 2, 2015 at 6:09 AM, Asim Jalis <[email protected]> wrote: >> >>> Hi Sunil, >>> >>> I am wondering why you want to speed up lein uberjar. >>> >>> How frequently do you need to run this? >>> >>> What is your use case and workflow around this? >>> >>> Thanks. >>> >>> Asim >>> >>> On Mon, Oct 26, 2015 at 2:04 AM, Sunil S Nandihalli < >>> [email protected]> wrote: >>> >>>> Hi Everybody, >>>> My lein uberjar takes about 2 minutes to run. It also recompiles all >>>> the clj files everytime. Is there a way to speedup lein-uberjar .. Or may >>>> be make it incremental? >>>> Thanks, >>>> Sunil. >>>> >>>> -- >>>> You received this message because you are subscribed to the Google >>>> Groups "Clojure" group. >>>> To post to this group, send email to [email protected] >>>> Note that posts from new members are moderated - please be patient with >>>> your first post. >>>> To unsubscribe from this group, send email to >>>> [email protected] >>>> For more options, visit this group at >>>> http://groups.google.com/group/clojure?hl=en >>>> --- >>>> You received this message because you are subscribed to the Google >>>> Groups "Clojure" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to [email protected]. >>>> For more options, visit https://groups.google.com/d/optout. >>>> >>> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "Clojure" group. >>> To post to this group, send email to [email protected] >>> Note that posts from new members are moderated - please be patient with >>> your first post. >>> To unsubscribe from this group, send email to >>> [email protected] >>> For more options, visit this group at >>> http://groups.google.com/group/clojure?hl=en >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "Clojure" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to [email protected]. >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> -- >> You received this message because you are subscribed to the Google >> Groups "Clojure" group. >> To post to this group, send email to [email protected] >> Note that posts from new members are moderated - please be patient with >> your first post. >> To unsubscribe from this group, send email to >> [email protected] >> For more options, visit this group at >> http://groups.google.com/group/clojure?hl=en >> --- >> You received this message because you are subscribed to the Google Groups >> "Clojure" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected]. >> For more options, visit https://groups.google.com/d/optout. >> > > -- > You received this message because you are subscribed to the Google > Groups "Clojure" group. > To post to this group, send email to [email protected] > Note that posts from new members are moderated - please be patient with > your first post. > To unsubscribe from this group, send email to > [email protected] > For more options, visit this group at > http://groups.google.com/group/clojure?hl=en > --- > You received this message because you are subscribed to the Google Groups > "Clojure" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "Clojure" group. To post to this group, send email to [email protected] Note that posts from new members are moderated - please be patient with your first post. To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/clojure?hl=en --- You received this message because you are subscribed to the Google Groups "Clojure" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
