Re: Best way to access a Flink state entry from another Flink application

2019-08-06 Thread Mohammad Hosseinian
Aug 6, 2019 at 9:52 AM Mohammad Hosseinian mailto:mohammad.hossein...@id1.de>> wrote: Hi Alex, Thanks for your reply. The application is streaming. The issue with using messaging channels for such kind of communication is the 'race condition'. I mean, when you have parallel channels o

Re: Best way to access a Flink state entry from another Flink application

2019-08-06 Thread Mohammad Hosseinian
BR, Moe On 06/08/2019 13:25, Протченко Алексей wrote: Hi Mohammad, which types of applications do you mean? Streaming or batch ones? In terms of streaming ones queues like Kafka or RabbitMq between applications should be the best way I think. Best regards, Alex Вторник, 6 августа 2019, 12:21

Best way to access a Flink state entry from another Flink application

2019-08-06 Thread Mohammad Hosseinian
nk application? I am aware of 'Queryable states', but I am not sure if this feature has been designed and is suitable for our use-case or not? Thank you very much in advance. BR, Moe -- Mohammad Hosseinian Software Developer Information Design One AG Phone +49-69-244502-0 Fax

Re: Exactly-once semantics in Flink Kafka Producer

2019-08-02 Thread Mohammad Hosseinian
ializationSchemaWrapper(new SimpleStringSchema()), producerProperty, FlinkKafkaProducer.Semantic.EXACTLY_ONCE); producer1.ignoreFailuresAfterTransactionTimeout(); DataStreamSource s1 = env.addSource(consumer1); s1.addSink(producer1); env.execute("Test"); -

Checkpoints very slow with high backpressure

2019-07-30 Thread Mohammad Hosseinian
n and creates an even larger delay in our processing pipeline. Is there any way to force the checkpoint to complete even under backpressure situation? Thank you in advance. Regards, -- Mohammad Hosseinian Software Developer Information Design One AG Phone +49-69-244502-0 Fax +49-69-244502-10 Web ww