Re: Cron job fails to run a paragraph that runs correctly manually

2016-06-15 Thread moon soo Lee
I just created a fix. https://github.com/apache/zeppelin/pull/1019 Please try it when you have time and let me know if it does not solve your problem. Thanks, moon On Wed, Jun 15, 2016 at 4:05 PM Jose Rivera-Rubio < jose.riv...@internavenue.com> wrote: > Not at all, thank you!! > > *Jose Rivera*

Re: Cron job fails to run a paragraph that runs correctly manually

2016-06-15 Thread Jose Rivera-Rubio
Not at all, thank you!! *Jose Rivera* p.s. We're Hiring ! *Data Engineer Lead **Intern Avenue * Watch Intern Avenue on: BBC Dragons’ Den e: jose.riv...@internavenue.com | www.intern

Re: Cron job fails to run a paragraph that runs correctly manually

2016-06-15 Thread moon soo Lee
Thanks for share the problem. Let me try create a fix. Best, moon On Wed, Jun 15, 2016 at 3:56 PM Jose Rivera-Rubio < jose.riv...@internavenue.com> wrote: > Hi, thanks for the quick reply. > > I do have 'auto-restart interpreter' after the cron job is executed, as my > task is quite memory inten

Re: Cron job fails to run a paragraph that runs correctly manually

2016-06-15 Thread Jose Rivera-Rubio
Hi, thanks for the quick reply. I do have 'auto-restart interpreter' after the cron job is executed, as my task is quite memory intensive. Apart from the multiple-interpreter issue, I think there's also the case of concurrency being the instigator of the SIGTERM kill signal. Thanks, Jose *Jose

Re: Cron job fails to run a paragraph that runs correctly manually

2016-06-15 Thread moon soo Lee
Thanks for good finding. Do you use cron scheduling with 'auto-restart interpreter on cron execution' checked? 'Notebook.CronJob.execute' checks only last paragraph. Therefore if multiple type of interpreter is being used in a note and If 'auto-restart interpreter on cron execution' is checked, th

Re: Cron job fails to run a paragraph that runs correctly manually

2016-06-15 Thread Jose Rivera-Rubio
It seems to be working if I only have one paragraph (or one interpreter type) in the notebook (note) with the cron job. Can this be related with the `Notebook.CronJob.execute` checks on the very last paragraph of the notebook, creating erratic behaviour when running multiple paragraphs in parallel

Re: Cron job fails to run a paragraph that runs correctly manually

2016-06-15 Thread Jose Rivera-Rubio
I have tried increasing this timeout but still get the SIGTERM (kill) signal. How can I debug this? I have timed the script in the terminal, wit `time sh script.sh` , then modifying the timeouts to be well above this number and tried the cron job without success. Thank you *Jose Rivera* p.s. We