Re: intermittent error (failed to upload files) in livy2.pyspark

Thanks Jeff. The log has been sent to you. On Wed, Aug 22, 2018 at 5:44 PM Jeff Zhang wrote: > > Could you attach the livy server log ? It is weird to me that driver need > to add file /usr/hdp/current/spark2-client/python/lib/pyspark.zip, it > should come from hadoop dist cache instead of a loc

Re: intermittent error (failed to upload files) in livy2.pyspark

Could you attach the livy server log ? It is weird to me that driver need to add file /usr/hdp/current/spark2-client/python/lib/pyspark.zip, it should come from hadoop dist cache instead of a local file Lian Jiang 于2018年8月23日周四 上午7:02写道： > Hi, > > I am using HDP3.0 (zeppelin 0.8.0) and my notebo

Fwd: intermittent error (failed to upload files) in livy2.pyspark

Hi, I am using HDP3.0 (zeppelin 0.8.0) and my notebook using livy2.pyspark interpreter crashes (RPC channel is stopped) the livy session frequently. The yarn log tells: 18/08/22 22:39:47 ERROR ApplicationMaster: RECEIVED SIGNAL TERM 18/08/22 22:39:47 INFO SparkContext: Invoking stop() from shutd