Okay, so on checkpointing window's data would also be persisted.
From: Arvid Heise
Sent: 20 May 2020 01:05
To: Jaswin Shah
Cc: Yun Tang ; isha.sing...@paytm.com
; ankit.sing...@paytm.com ;
user@flink.apache.org
Subject: Re: Rocksdb implementation
I
t; *Cc:* Yun Tang ; isha.sing...@paytm.com <
> isha.sing...@paytm.com>; ankit.sing...@paytm.com ;
> user@flink.apache.org
> *Subject:* Re: Rocksdb implementation
>
> Hi Jaswin,
>
> you cannot run a DataSet program inside a DataStream. However, you can
> perform the same query
10
To: Jaswin Shah
Cc: Yun Tang ; isha.sing...@paytm.com
; ankit.sing...@paytm.com ;
user@flink.apache.org
Subject: Re: Rocksdb implementation
Hi Jaswin,
you cannot run a DataSet program inside a DataStream. However, you can perform
the same query on a windowed stream. So if you would execut
> *From:* Jaswin Shah
> *Sent:* 19 May 2020 13:29
> *To:* Yun Tang ; Arvid Heise ;
> isha.sing...@paytm.com ; ankit.sing...@paytm.com <
> ankit.sing...@paytm.com>
> *Cc:* user@flink.apache.org
> *Subject:* Re: Rocksdb implementation
>
> ++
> ---
implementation
++
From: Yun Tang
Sent: 18 May 2020 23:47
To: Arvid Heise ; Jaswin Shah
Cc: user@flink.apache.org
Subject: Re: Rocksdb implementation
Hi Jaswin
As Arvid suggested, it's not encouraged to query the internal RocksDB directly.
Apart from Arvid'
> *Sent:* 18 May 2020 23:47
> *To:* Arvid Heise ; Jaswin Shah <
> jaswin.s...@outlook.com>
> *Cc:* user@flink.apache.org
> *Subject:* Re: Rocksdb implementation
>
> Hi Jaswin
>
> As Arvid suggested, it's not encouraged to query the internal RocksDB
> direct
++
From: Yun Tang
Sent: 18 May 2020 23:47
To: Arvid Heise ; Jaswin Shah
Cc: user@flink.apache.org
Subject: Re: Rocksdb implementation
Hi Jaswin
As Arvid suggested, it's not encouraged to query the internal RocksDB directly.
Apart from Arvid's s
ests/flink-queryable-state-test/src/main/java/org/apache/flink/streaming/tests/queryablestate/QsStateClient.java#L108-L122
Best
Yun Tang
From: Arvid Heise
Sent: Monday, May 18, 2020 23:40
To: Jaswin Shah
Cc: user@flink.apache.org
Subject: Re: Rocksdb implementation
Hi Ja
();
> try {
> //producer.beginTransaction();
> producer.send(new
> ProducerRecord<>(ConfigurationsManager.getResultTopicName(), message));
> //producer.commitTransaction();
> } catch (ProducerFencedException | OutOfOrderSeq
);
} catch (KafkaException e) {
producer.abortTransaction();
} catch (MissingConfigurationsException e) {
e.printStackTrace();
}
producer.close();
}
}
This is the snapshot of implementation I have done
From: Jas
Hi,
I have implemented the flink job with MapStates. The functionality is like,
1. I have two datastreams which I connect with connect operator and then
call coprocessfunction with every pair of objects.
2. For element of first datastream, processElement1 method is called and for
an elemen
11 matches
Mail list logo
