Someone told me that maybe this issue is Mesos specific. I'm kind of a
newbie in Flink, and I digged into the code but can not get a conclusion.
Here I just wanna have a better JoinWindow that emits the result and delete
it from the window state immediately when joined successfully, is there any
ot
Hi Si-li
Thanks for the notice.
I just want to double-check is the original problem has been solved? As I
found that the created issue FLINK-18464 has been closed with reason "can
not reproduce". Am I missing something here?
Best,
Congxian
Si-li Liu 于2020年7月10日周五 下午6:06写道：
> Sorry
>
> I can'
Sorry
I can't reproduce it with reduce/aggregate/fold/apply and due to some
limitations in my working environment, I can't use flink 1.10 or 1.11.
Congxian Qiu 于2020年7月5日周日 下午6:21写道：
> Hi
>
> First, Could you please try this problem still there if use flink 1.10 or
> 1.11?
>
> It seems strange,
Hi
First, Could you please try this problem still there if use flink 1.10 or
1.11?
It seems strange, from the error message, here is an error when trying to
convert a non-Window state(VoidNameSpace) to a Window State (serializer is
the serializer of Window state, but the state is non-Window state
Thanks for your help
1. I started the job from scratch, not a savepoint or externalized
checkpoint
2. No job graph change
3. env.setStreamTimeCharacteristic(TimeCharacteristic.EventTime)
4. My Flink version is 1.9.1
Khachatryan Roman 于2020年7月3日周五 下午4:49写道：
> I still wasn't able to reproduce the
I still wasn't able to reproduce the issue.
Can you also clarify:
- Are you starting the job from a savepoint or externalized checkpoint?
- If yes, was the job graph changed?
- What StreamTimeCharacteristic is set, if any?
- What exact version of Flink do you use?
Regards,
Roman
On Fri, Jul 3,
Hi, Thanks for your help.
The checkpoint configuration is
checkpoint.intervalMS=30
checkpoint.timeoutMS=30
The error callstack is from JM's log, which happened in every cp. Currently
I don't have a success cp yet.
Khachatryan Roman 于2020年7月3日周五 上午3:50写道：
> Hi,
>
> Thanks for the detai
Hi,
Thanks for the details.
However, I was not able to reproduce the issue. I used parallelism levels
4, file system backend and tried different timings for
checkpointing, windowing and source.
Do you encounter this problem deterministically, is it always 1st
checkpoint?
What checkpointing interva
Hi, this is our production code so I have to modify it a little bit, such
as variable name and function name. I think 3 classes I provide here is
enough.
I try to join two streams, but I don't want to use the default join
function, because I want to send the joined log immediately and remove it
fr
Thanks for the clarification.
Can you also share the code of other parts, particularly MyFunction?
Regards,
Roman
On Thu, Jul 2, 2020 at 12:49 PM Si-li Liu wrote:
> Rocksdb backend has the same problem
>
> Khachatryan Roman 于2020年7月2日周四 下午6:11写道：
>
>> Thanks for reporting this.
>>
>> Looks l
Rocksdb backend has the same problem
Khachatryan Roman 于2020年7月2日周四 下午6:11写道：
> Thanks for reporting this.
>
> Looks like the window namespace was replaced by VoidNamespace in state
> entry.
> I've created https://issues.apache.org/jira/browse/FLINK-18464 to further
> investigate it.
>
> Regards
Thanks for reporting this.
Looks like the window namespace was replaced by VoidNamespace in state
entry.
I've created https://issues.apache.org/jira/browse/FLINK-18464 to further
investigate it.
Regards,
Roman
On Thu, Jul 2, 2020 at 10:52 AM Si-li Liu wrote:
> I'm using flink 1.9 on Mesos and
I'm using flink 1.9 on Mesos and I try to use my own trigger and evictor.
The state is stored to memory.
input.setParallelism(processParallelism)
.assignTimestampsAndWatermarks(new UETimeAssigner)
.keyBy(_.key)
.window(TumblingEventTimeWindows.of(Time.minutes(20)))
13 matches
Mail list logo
