Piotrek
[1]
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=158866741
pon., 28 wrz 2020 o 15:14 s_penakalap...@yahoo.com
<mailto:s_penakalap...@yahoo.com> mailto:s_penakalap...@yahoo.com>> napisał(a):
Hi All,
Need your help in Flink B
> Piotrek
>
> [1]
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=158866741
>
> pon., 28 wrz 2020 o 15:14 s_penakalap...@yahoo.com <
> s_penakalap...@yahoo.com> napisał(a):
>
> Hi All,
>
> Need your help in Flink Batch processing: scenario described
could help here.
Piotrek
[1] https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=158866741
pon., 28 wrz 2020 o 15:14 s_penakalap...@yahoo.com
napisał(a):
Hi All,
Need your help in Flink Batch processing: scenario described below:
we have multiple vehicles, we get data from each vehicl
66741
pon., 28 wrz 2020 o 15:14 s_penakalap...@yahoo.com
napisał(a):
> Hi All,
>
> Need your help in Flink Batch processing: scenario described below:
>
> we have multiple vehicles, we get data from each vehicle at a very high
> speed, 1 record per minute.
> thresholds c
Hi All,
Need your help in Flink Batch processing: scenario described below:
we have multiple vehicles, we get data from each vehicle at a very high speed,
1 record per minute.thresholds can be set by the owner for each vehicle.
Say: we have 3 vehicles, threshold is set for 2 vehicles. Vehicle 1
ready focusing on realizing the ideas mentioned in FLIP1,
> wish to contirbute to flink in months.
>
> Best,
>
> Zhijiang
>
> --
> 发件人:Si-li Liu
> 发送时间:2017年2月17日(星期五) 11:22
> 收件人:user
> 主 题:Re: Flink ba
--发件人:Si-li
Liu 发送时间:2017年2月17日(星期五) 11:22收件人:user
主 题:Re: Flink batch processing fault tolerance
Hi,
It's the reason why I gave up use Flink for my current project and pick up
traditional Hadoop Framework again.
2017-02-17 10:56 GMT+08:00 Renjie Liu :
https://cwiki.apache.org/confluence/di
a Krettek [mailto:aljos...@apache.org]
>> *Sent:* Thursday, February 16, 2017 2:48 PM
>> *To:* user@flink.apache.org
>> *Subject:* Re: Flink batch processing fault tolerance
>>
>>
>>
>> Hi,
>>
>> yes, this is indeed true. We had some plans for
gt;
>
>
>
>
> *From:* Aljoscha Krettek [mailto:aljos...@apache.org]
> *Sent:* Thursday, February 16, 2017 2:48 PM
> *To:* user@flink.apache.org
> *Subject:* Re: Flink batch processing fault tolerance
>
>
>
> Hi,
>
> yes, this is indeed true. We had some plans fo
Hi Aljoscha,
Could you share your plans of resolving it?
Best,
Anton
From: Aljoscha Krettek [mailto:aljos...@apache.org]
Sent: Thursday, February 16, 2017 2:48 PM
To: user@flink.apache.org
Subject: Re: Flink batch processing fault tolerance
Hi,
yes, this is indeed true. We had some plans for
Hi,
yes, this is indeed true. We had some plans for how to resolve this but
they never materialised because of the focus on Stream Processing. We might
unite the two in the future and then you will get fault-tolerant
batch/stream processing in the same API.
Best,
Aljoscha
On Wed, 15 Feb 2017 at 0
Hi, all:
I'm learning flink's doc and curious about the fault tolerance of batch
process jobs. It seems that when one of task execution fails, the whole job
will be restarted, is it true? If so, isn't it impractical to deploy large
flink batch jobs?
--
Liu, Renjie
Software Engineer, MVAD
If your environment is not kerberized (or if you can offord to restart the
job every 7 days), a checkpoint enabled, flink job with windowing and the
count trigger, would be ideal for your requirement.
Check the api's on flink windows.
I had something like this that worked
stream.keyBy(0).countW
Hi,
Flink works very well with Kafka if you wish to stream data. Following is how
I am streaming data with Kafka and Flink.
FlinkKafkaConsumer08 kafkaConsumer = new
FlinkKafkaConsumer08<>(KAFKA_AVRO_TOPIC, avroSchema, properties);
DataStream messageStream = env.addSource(kafkaConsumer);
Is th
14 matches
Mail list logo