IllegalMutationException in PTransform

2022-05-05 Thread Yuri Jin
e some advice on the following questions. 1. How can we find the problematic part? I did some unit tests, but I couldn't reproduce them. 2. Have you experienced the same error and solved it? 3. Only Direct runner enforces immutability for DoFns. Is it safe to use the "enforceImmutability=false" option? Any comments would be appreciated. Thanks, Yuri Jin

Re: IllegalMutationException in PTransform

2022-05-06 Thread Yuri Jin
(_) => () } } // For reference, we are using Scio v0.11.5 and Beam v2.36.0. Thank you, Yuri Jin On Thu, May 5, 2022 at 10:36 PM Reuven Lax wrote: > What is the type of the input - do you have a custom coder? Are you able > to paste the code for yo

Re: IllegalMutationException in PTransform

2022-05-06 Thread Yuri Jin
ect in structuralValue. >> >> On Fri, May 6, 2022 at 11:26 AM Yuri Jin wrote: >> >>> Reuven, thanks for the reply. >>> >>> The input type is "KafkaRecord[Array[Byte], Array[Byte]]" and uses the >>> "KafkaRecordCoder.of(Nullab

Re: IllegalMutationException in PTransform

2022-05-09 Thread Yuri Jin
-2.0/rawhttp-core/src/main/java/rawhttp/core/RawHttp.java#L130 I'm thinking of implementing it in a different way. Any advice on that? Thank you, Yuri Jin On Fri, May 6, 2022 at 2:49 PM Siyu Lin wrote: > Hi Reuven, > > Do you mean we should have coder explicitly defined for all inp