Hello, users! Our analysts run notes with such interpreters: markdown, one or two jdbc and pyspark. The interpreters are instantiated Per User in isolated process and Per Note in isolated process.
And the analysts complain that sometimes paragraphs aren't processed and stay in status 'Pending'. We noticed that it happen when number of started interpreter processes is about 90-100. If admin restarts one of the popular interpreter (that is killing some interpreter processes), the paragraphs become 'Running'. We can't see any workload on zeppelin server when paragraphs are pended. RAM is sufficiently, iowait ~ 0 Also we can't find out any parameters about maximum interpreter processes. Has anyone of you faced the same problem? How can this problem be solved? Thanks, Maksim Belousov
