Hi devs,
Thanks Giannis for your suggestion. It seems that the last email wasn't
sent to the dev ML. It is also an interesting topic for devs and user-zh.
Best regards,
Jing
-- Forwarded message -
From: Giannis Polyzos
Date: Tue, Aug 22, 2023 at 11:11 AM
Subject: [Discussion] Sl
Hi Pathy,
I want to know if the 'id' in {id, customerId, amount, timestamp} stands
for 'requestId'? If not, how is this 'id' field generated and can we add
'requestId' field in the event?
Thx,
Xiangyu
Jiten Pathy 于2023年8月22日周二 14:04写道：
> Hi,
> We are currently evaluating Flink for our analyti
Hi Xiangyu,
Yes, that's correct. It is the requestId, we will have for each request.
On Wed, 23 Aug 2023 at 13:47, xiangyu feng wrote:
> Hi Pathy,
>
> I want to know if the 'id' in {id, customerId, amount, timestamp} stands
> for 'requestId'? If not, how is this 'id' field generated and can we
Hi Pathy,
Pls check if following SQL fits ur need,
CREATE TABLE event1 (id BIGINT, customer_id STRING, amount INT, ts TIMESTAMP
);
CREATE VIEW event2 AS
SELECT *
FROM event1;
CREATE VIEW event3 AS
SELECT *
FROM event1;
CREATE VIEW temp1 AS
SELECT id AS event2.id,
"Total" AS Total,
SUM(event3.
Hello,
If checkpointing is NOT enabled and re-start strategy is configured then flink
retries the whole job execution i.e. enabling checkpointing is must for re-try
or not?
Rgds,
Kamal
Hi, Kamal.
If we don't enable checkpointing, the job will be started with the startup
mode each time.
For example, the job reads Kafka from the earliest offset and writes to
mysql. If the job failover without checkpointing, the tasks will consume
Kafka from the earliest offset again.
I think it i
This is a pretty hard problem. I would be inclined to try Queryable State (
https://nightlies.apache.org/flink/flink-docs-master/docs/dev/datastream/fault-tolerance/queryable_state/)
first.
-0xe1a
On Mon, Aug 21, 2023 at 11:04 PM Jiten Pathy wrote:
> Hi,
> We are currently evaluating Flink for
Hi Christian,
Thanks for your understanding. We will take a look at 1.17.2, once the 1.18
release is done. In the meantime, there might be someone in the community
who volunteers to be the 1.17.2 release manager. You will see related email
threads on the Dev. Stay tuned please :-)
Best regards,
J
Hi, Kamal
As Hang says, some extra info about job failover strategy for reference in
[1]
[1]
https://nightlies.apache.org/flink/flink-docs-master/docs/ops/state/task_failure_recovery/
Best,
Ron
Hang Ruan 于2023年8月23日周三 22:27写道：
> Hi, Kamal.
>
> If we don't enable checkpointing, the job will be
Thanks.
Only query is that whether checkpointing and job re-start strategy are
independent to each other? If checkpointing is not enabled and re-start
strategy is given then flink will still re-try the job as per configuration?
Checkpointing is not enabled as there is no state to maintain.
If
10 matches
Mail list logo
