unsubscribe

2020-01-23 Thread Arcadius Ahouansou
unsubscribe

Re: How to prevent and track data loss/dropped due to watermark during structure streaming aggregation

2020-01-23 Thread stevech.hu
Anyone know the answers or pointers? thanks. -- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ - To unsubscribe e-mail: user-unsubscr...@spark.apache.org

detect idle sparkcontext to release resources

2020-01-23 Thread Nicolas Paris
hi we have many users on the spark on yarn cluster. most of them forget to release their sparkcontext after analysis (spark-thrift or pyspark jupyter kernels). I wonder how to detect their is no activity on the sparkcontext to kill them. Thanks -- nicolas --