Thank you Stephan for the information!
On Mon, Dec 14, 2015 at 5:20 AM Stephan Ewen wrote:
> Hi Alex!
>
> Right now, Flink would not reuse Kafka's partitioning for joins, but
> shuffle/partition data by itself. Flink is very fast at shuffling and adds
> very little latency on shuffles, so that i
Hi Alex!
Right now, Flink would not reuse Kafka's partitioning for joins, but
shuffle/partition data by itself. Flink is very fast at shuffling and adds
very little latency on shuffles, so that is usually not an issue. The
reason that design is that we view streaming program as something dynamic:
Hello all,
I was wondering if someone would be kind enough to enlighten me on a few
topics. We are trying to join two streams of data on a key. We were
thinking of partitioning topics in Kafka by the key, however I also saw
that Flink is able to partition on its own and I was wondering whether
Fli
Hey Hilmi,
here is a great example of how to use the Checkpointed interface:
https://github.com/StephanEwen/flink-demos/blob/master/streaming-state-machine/src/main/scala/com/dataartisans/flink/example/eventpattern/StreamingDemo.scala#L82
On Wed, Jun 17, 2015 at 12:44 AM, Hilmi Yildirim
Hi Gyula,
thank you.
Best Regards,
Hilmi
Am 17.06.2015 um 09:44 schrieb Gyula Fóra:
Hey Hilmi,
Flink currently supports user defined state through the Checkpointed
interface. Using this interface the user can define what state should
the system be aware of when doing snapshots for fault tole
Hi Matthias,
great! Thank you.
Best Regards,
Hilmi
Am 17.06.2015 um 09:38 schrieb Matthias J. Sax:
Hi Hilmi,
currently, this is not supported. However, state management is already
work in progress and should be available soon. See
https://github.com/apache/flink/pull/747
-Matthias
On 06/17/2
Hey Hilmi,
Flink currently supports user defined state through the Checkpointed
interface. Using this interface the user can define what state should the
system be aware of when doing snapshots for fault tolerance. The state
returned in the snapshotState method will be checkpointed (and restored
u
Hi Hilmi,
currently, this is not supported. However, state management is already
work in progress and should be available soon. See
https://github.com/apache/flink/pull/747
-Matthias
On 06/17/2015 09:36 AM, Hilmi Yildirim wrote:
> Hi,
> does Flink Streaming support state management? For example,
Hi,
does Flink Streaming support state management? For example, I have a
state which will be used inside the streaming operations but the state
can be updated.
For example:
stream.map( use state for operation).updateState(update state).
Best Regards,
Hilmi
--
--
Hilmi Yildirim
Software D
