bb9495c6b7ba755ced576bb8a35d5/runners/flink/src/main/java/org/apache/beam/runners/flink/translation/wrappers/streaming/stableinput/BufferingDoFnRunner.java#L95
>
> Best
> Yun Tang
> --
> *From:* Stephen Patel
> *Sent:* Thursday, April 16, 2020 22:30
ly at least.
On Thu, Apr 16, 2020 at 9:03 AM Stephen Patel wrote:
> I can't say that I ever call that directly. The beam library that I'm
> using does call it in a couple places:
> https://github.com/apache/beam/blob/v2.14.0/runners/flink/src/main/java/org/apache/beam/runners/fl
ent operator state descriptor each time?
>
> Best
> Yun Tang
> ------
> *From:* Stephen Patel
> *Sent:* Thursday, April 16, 2020 2:09
> *To:* user@flink.apache.org
> *Subject:* Streaming Job eventually begins failing during checkpointing
>
> I&
I've got a flink (1.8.0, emr-5.26) streaming job running on yarn. It's
configured to use rocksdb, and checkpoint once a minute to hdfs. This job
operates just fine for around 20 days, and then begins failing with this
exception (it fails, restarts, and fails again, repeatedly):
2020-04-15 13:15:
pe but you
> will also need to look into the beam internals to see how it stores data in
> flink state, how it translates between beam serializers and flink
> serializers, etc.
>
> Seth
>
> On Mon, Apr 6, 2020 at 1:02 PM Stephen Patel wrote:
>
>> I've got an apach
I've got an apache beam pipeline running on flink (1.9.1).
I've been attempting to read a RocksDB savepoint taken from this
beam-on-flink pipeline, using the state processor api, however it seems to
have some incompatibilities around namespaces. Beam for instance uses a
String namespace, while th
