Jozef Vilcek created FLINK-15773:
------------------------------------

             Summary: ClosureCleaner fails with joda DateTimeZone
                 Key: FLINK-15773
                 URL: https://issues.apache.org/jira/browse/FLINK-15773
             Project: Flink
          Issue Type: Bug
          Components: API / Core
    Affects Versions: 1.9.1
            Reporter: Jozef Vilcek


Flink fails to launch my Apache Beam job which uses windowing function with 
time zone. Closure cleaner reports time zone as not serializable. Part of stack 
trace:

 
{noformat}
org.joda.time.tz.DateTimeZoneBuilder$OfYear@3b035d0c is not serializable. The 
object probably contains or references non serializable fields.
        org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:151)
        org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:126)
        org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:126)
        org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:126)
        org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:126)
        org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:126)
        org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:126)
        org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:71)
        org.apache.flink.api.java.DataSet.clean(DataSet.java:186)
        org.apache.flink.api.java.DataSet.flatMap(DataSet.java:267)
 ....{noformat}
Actual instance of DateTimeZone is 
[PrecalculatedZone|[https://github.com/JodaOrg/joda-time/blob/v2.10.5/src/main/java/org/joda/time/tz/DateTimeZoneBuilder.java#L1373]]
 which itself is serializable but it's fields are not necessarily standalone 
java serializable, because enclosing class it managing their serialization and 
deserialization. 

 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to