Re: Updating external service and then processing response

2018-04-29 Thread wazza
Hi Michael, Yeah, I feel the updating of state in an external system is a job for a sink. However, I don't really like the idea of combining both a web service call and DB write in the one sink class because it's breaking single responsibility - I feel there should be a nicer way to compose these

Re: Updating external service and then processing response

2018-04-29 Thread TechnoMage
If the external web service call does not modify the state of that external system all the approaches you list are probably ok. If there is external state modification then you want to ensure on restart the Flink job does not resend requests to that service or that it can handle duplicate reque