Thanks Boyuan!
From: Boyuan Zhang
Date: Wednesday, November 25, 2020 at 10:52 AM
To: Tao Li
Cc: "user@beam.apache.org" , Kyle Weaver
Subject: Re: Potential issue with the flink runner in streaming mode
Thanks for reporting this issue, Tao. That's all I need for debugging
*To: *Tao Li
> *Cc: *"user@beam.apache.org" , Kyle Weaver <
> kcwea...@google.com>
> *Subject: *Re: Potential issue with the flink runner in streaming mode
>
>
>
> And is it a batch pipeline or a streaming pipeline?
>
>
>
> On Tue, Nov 24, 2020 a
Zhang
Date: Tuesday, November 24, 2020 at 3:27 PM
To: Tao Li
Cc: "user@beam.apache.org" , Kyle Weaver
Subject: Re: Potential issue with the flink runner in streaming mode
And is it a batch pipeline or a streaming pipeline?
On Tue, Nov 24, 2020 at 3:25 PM Tao Li
mailto:t...@zillow.c
2020 at 3:19 PM
> *To: *"user@beam.apache.org" , Kyle Weaver <
> kcwea...@google.com>, Boyuan Zhang
> *Subject: *Re: Potential issue with the flink runner in streaming mode
>
>
>
> Thanks @Kyle Weaver for filing the jira.
>
>
>
> @Boyuan Zhang you
Correction: And as discussed with Kyle, adding
“--experiments=use_deprecated_read” worked with 2.25.
From: Tao Li
Date: Tuesday, November 24, 2020 at 3:19 PM
To: "user@beam.apache.org" , Kyle Weaver
, Boyuan Zhang
Subject: Re: Potential issue with the flink runner in streaming mo
:54 PM
To: "user@beam.apache.org"
Subject: Re: Potential issue with the flink runner in streaming mode
Hi Tao,
I want to make sure that I understand your problem correctly. So within the
2.25.0 version, you are not able to write the sink but within 2.24.0 you can do
so. Do I under
this a
>> regression?
>>
>>
>>
>> *From: *Kyle Weaver
>> *Reply-To: *"user@beam.apache.org"
>> *Date: *Tuesday, November 24, 2020 at 11:08 AM
>> *To: *"user@beam.apache.org"
>> *Subject: *Re: Potential issue with the f
eaver
> *Reply-To: *"user@beam.apache.org"
> *Date: *Tuesday, November 24, 2020 at 11:08 AM
> *To: *"user@beam.apache.org"
> *Subject: *Re: Potential issue with the flink runner in streaming mode
>
>
>
> I wonder if this issue is related to the migrati
Yep it works with “--experiments=use_deprecated_read”. Is this a regression?
From: Kyle Weaver
Reply-To: "user@beam.apache.org"
Date: Tuesday, November 24, 2020 at 11:08 AM
To: "user@beam.apache.org"
Subject: Re: Potential issue with the flink runner in streaming mode
I
I wonder if this issue is related to the migration to Splittable DoFn [1].
Can you try running your pipeline again with the option
--experiments=use_deprecated_read?
[1] https://beam.apache.org/blog/beam-2.25.0/
On Tue, Nov 24, 2020 at 10:19 AM Tao Li wrote:
> Hi Beam community,
>
>
>
> I am ru
Hi Beam community,
I am running into a problem with
“org.apache.beam:beam-runners-flink-1.11:2.25.0” and
“org.apache.beam:beam-runners-flink-1.10:2.25.0”. I am doing some local testing
with the flink runners in embedded mode. The problem is that I cannot save data
into local files using those
11 matches
Mail list logo
