Re: Continuous processing mode and python udf

2019-08-13 Thread Hyukjin Kwon
that's fixed in https://github.com/apache/spark/commit/b83b7927b3a85c1a4945e2224ed811b5bb804477 2019년 8월 13일 (화) 오후 12:37, zenglong chen 님이 작성: > Does Spark 2.4.0 support Python UDFs with Continuous Processing mode? > I try it and occur error like below: > WARN scheduler.TaskSetManager: Lost

Continuous processing mode and python udf

2019-08-12 Thread zenglong chen
Does Spark 2.4.0 support Python UDFs with Continuous Processing mode? I try it and occur error like below: WARN scheduler.TaskSetManager: Lost task 4.0 in stage 0.0 (TID 4, 172.22.9.179, executor 1): java.util.NoSuchElementException: None.get at scala.None$.get(Option.scala:347) at scala.None$