Re: How to deploy Flink in a geo-distributed environment

2018-06-29 Thread Stephen
Thanks! On Thu, Jun 28, 2018 at 7:32 PM Tzu-Li (Gordon) Tai wrote: > Hi, > > It should be possible to deploy a single Flink cluster across > geo-distributed nodes, but Flink currently offers no optimization for such > a specific use case. > AFAIK, the general pattern for dealing with geographica

Re: How to deploy Flink in a geo-distributed environment

2018-06-28 Thread Tzu-Li (Gordon) Tai
Hi, It should be possible to deploy a single Flink cluster across geo-distributed nodes, but Flink currently offers no optimization for such a specific use case. AFAIK, the general pattern for dealing with geographically distributed data sources right now, would be to replicate data across cluster

How to deploy Flink in a geo-distributed environment

2018-06-26 Thread Stephen
Hi, Can Flink be deployed in a geo-distributed environment instead of being in local clusters? As far as I know, raw data should be moved to local cloud environment or local clusters before Flink handle it. Consider this situation where data sources are on different areas which might be cross diffe