Hi, thanks for the quick reply. I do have 'auto-restart interpreter' after the cron job is executed, as my task is quite memory intensive.
Apart from the multiple-interpreter issue, I think there's also the case of concurrency being the instigator of the SIGTERM kill signal. Thanks, Jose *Jose Rivera* p.s. We're Hiring <https://www.internavenue.com/about/jobs/>! *Data Engineer Lead **Intern Avenue <http://www.internavenue.com/>* Watch Intern Avenue on: BBC Dragons’ Den <http://www.internavenue.com/dragons-den> e: jose.riv...@internavenue.com <janos.fe...@internavenue.com> | www.internavenue.com | Great Interns Online On 15 June 2016 at 21:29, moon soo Lee <m...@apache.org> wrote: > Thanks for good finding. Do you use cron scheduling with 'auto-restart > interpreter on cron execution' checked? > > 'Notebook.CronJob.execute' checks only last paragraph. Therefore if > multiple type of interpreter is being used in a note and If 'auto-restart > interpreter on cron execution' is checked, there is possibility to restart > interpreter process while some paragraph is still running. > > Thanks, > moon > > On Wed, Jun 15, 2016 at 9:38 AM Jose Rivera-Rubio < > jose.riv...@internavenue.com> wrote: > >> It seems to be working if I only have one paragraph (or one interpreter >> type) in the notebook (note) with the cron job. Can this be related with the >> `Notebook.CronJob.execute` >> checks on the very last paragraph of the notebook, creating erratic >> behaviour when running multiple paragraphs in parallel or paragraphs use >> different interpreters? >> >> *Jose Rivera* >> p.s. We're Hiring <https://www.internavenue.com/about/jobs/>! >> >> *Data Engineer Lead **Intern Avenue <http://www.internavenue.com/>* >> Watch Intern Avenue on: BBC Dragons’ Den >> <http://www.internavenue.com/dragons-den> >> e: jose.riv...@internavenue.com <janos.fe...@internavenue.com> | >> www.internavenue.com | Great Interns Online >> >> On 15 June 2016 at 17:27, Jose Rivera-Rubio <jose.riv...@internavenue.com >> > wrote: >> >>> I have tried increasing this timeout but still get the SIGTERM (kill) >>> signal. >>> >>> How can I debug this? >>> >>> I have timed the script in the terminal, wit `time sh script.sh` , then >>> modifying the timeouts to be well above this number and tried the cron job >>> without success. >>> >>> Thank you >>> >>> *Jose Rivera* >>> p.s. We're Hiring <https://www.internavenue.com/about/jobs/>! >>> >>> *Data Engineer Lead **Intern Avenue <http://www.internavenue.com/>* >>> Watch Intern Avenue on: BBC Dragons’ Den >>> <http://www.internavenue.com/dragons-den> >>> e: jose.riv...@internavenue.com <janos.fe...@internavenue.com> | >>> www.internavenue.com | Great Interns Online >>> >>> On 18 February 2016 at 17:57, moon soo Lee <m...@apache.org> wrote: >>> >>>> Hi Jose Rivera, >>>> >>>> If your script takes more than the timeout defined here >>>> https://github.com/apache/incubator-zeppelin/blob/master/shell/src/main/java/org/apache/zeppelin/shell/ShellInterpreter.java#L49, >>>> the process will be terminated. >>>> Otherwise, it looks like something send SIGTERM (kill) signal to your >>>> script. >>>> >>>> Or another case? >>>> >>>> Thanks, >>>> moon >>>> >>>> On Wed, Feb 17, 2016 at 10:22 AM Jose Rivera-Rubio < >>>> jose.riv...@internavenue.com> wrote: >>>> >>>>> Hi, >>>>> >>>>> I have a paragraph that runs a shell script to import data from a >>>>> MySQL db to Parquet files using Python and Pyspark (it's legacy import >>>>> code, that's why it's in a shell script instead of the python code >>>>> directly >>>>> in the paragraph). >>>>> >>>>> The issue is that if I manually run the paragraph it does the import >>>>> correctly, no issues at all. However, if I set a cron job so it runs >>>>> periodically it fails with this cryptic error: >>>>> >>>>> Paragraph received a SIGTERM. >>>>> ExitValue: 143 >>>>> >>>>> Any ideas? >>>>> >>>>> Thanks! >>>>> >>>>> *Jose Rivera* >>>>> p.s. We're Hiring <https://www.internavenue.com/about/jobs/>! >>>>> >>>>> *Data Engineer Lead **Intern Avenue <http://www.internavenue.com/>* >>>>> Watch Intern Avenue on: BBC Dragons’ Den >>>>> <http://www.internavenue.com/dragons-den> >>>>> e: jose.riv...@internavenue.com <janos.fe...@internavenue.com> | >>>>> www.internavenue.com | Great Interns Online >>>>> >>>> >>> >>
