I often have notebooks that have a %sh as the 1st paragraph. This scps some file from another server, and then a number of spark or sparksql paragraphs are after that.
If I click on the run-all paragraphs at the top of the notebook the 1st %sh paragraph kicks off as expected, but the 2nd %spark notebook starts too at the same time. The others go into pending state and then start once the spark one has completed. Is this a bug? Or am I doing something wrong? Thanks
