Re: Combining streams with static data and using REST API as a sink

2017-06-21 Thread Nancy Estrada
Hi Josh, I have a use-case similar to yours. I need to join a stream with data from a database to which I have access via a REST API. Since the Side inputs API continues begin and ongoing work. I am wondering how did you approached it, Did you use the rich function updating it periodically? Thank

Flink Docker Kubernetes Gitlab CI CDeployment

2017-05-29 Thread Nancy Estrada
Hi all, Has someone successfully run Flink jobs with this type of setup (Gitlab CI CD and Kubernetes)? Since Flink jobs can’t be dockerized and deployed in a natural way as part of the container (according to Flip-6) I am not very sure of how is the best way of doing this. We are thinking of hav

Re: flink-1.2 and unit testing / flinkspector

2017-03-23 Thread Nancy Estrada
Hi Tarandeep and Ted, I am in this route now. I am trying to use Flinkspector with Flink 1.2 using your instructions but failing miserably. After applying the changes, when I try to run "mvn clean install", some Tests fail and therefore I am not able to build successfully. I am wondering if ther

Re: Cassandra Sink version

2017-03-23 Thread Nancy Estrada
The documentation you mentioned says: "The Java client driver 3.0.7 (branch 3.0.x) is compatible with Apache Cassandra 1.2, 2.0, 2.1, 2.2 and 3.0". Thank you Kostas! -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Cassandra-Sink-version-tp12

Cassandra Sink version

2017-03-22 Thread Nancy Estrada
Hi all, Which Cassandra version is currently supported by the Flink 1.2 connector? and I am wondering which version Flink 1.3 will be supporting? Thank you! -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Cassandra-Sink-version-tp12329.html

readFile - Continuous file processing

2017-01-31 Thread Nancy Estrada
Hi guys, I have the following use case. Every day a new file is created and periodically some log records are appended to it. I am reading the file in the following way: executionEnvironment.readFile(format, directoryPath, PROCESS_CONTINUOUSLY, period.toMilliseconds(),filePathFilter); However, F

Flink configuration

2017-01-23 Thread Nancy Estrada
Hi all, I have been reading about how to configure Flink when we have a set up consisting on a couple of VMs with more than 1 vCore. I am a bit confused about how to set the degree of parallelism in the taskmanager.numberOfTaskSlots parameter: * According to the Flink documentation[1], this valu

Consistency guarantees on multiple sinks

2017-01-05 Thread Nancy Estrada
recommended to have more than one sink per job? Thank you! Nancy Estrada -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Consistency-guarantees-on-multiple-sinks-tp10877.html Sent from the Apache Flink User Mailing List archive. mailing list archive