Re: How to apply patterns from a source onto another datastream?

Hi Jayant, Could you elaborate a bit more what you mean? Flink’s windows are not used in Flink CEP. They are a different concept. > On 20 Dec 2017, at 09:23, Jayant Ameta wrote: > > Would it be possible to get the same result using windows? > > Jayant Ameta > > On Tue, Dec 19, 2017 at 3:23 P

Re: entrypoint for executing job in task manager

We use Guice for dependency injection. We need to install *additional* Guice modules (for bindings) when setting up this static context of Guice injector. Calling the static initializer from operator open method won't really help. Not all operators are implemented by app developer who want to inst

Re: state.checkpoints.dir not configured

I'm sorry but i already cleaned up the logs. If i encounter the same error again i will let you know On 21.12.2017 17:12, Ufuk Celebi wrote: Could you please share the complete logs of the initial failure? What you describe in your second email should not happen ;-) If the JobManager cannot bi

Re: state.checkpoints.dir not configured

Could you please share the complete logs of the initial failure? What you describe in your second email should not happen ;-) If the JobManager cannot bind to the port it should simply die and not complain about checkpoint configuration. – Ufuk On Thu, Dec 21, 2017 at 1:21 PM, Plamen Paskov wrot

Re: periodic trigger

Imagine a case where i want to run a computation every X seconds for 1 day window. I want the calculate average session length for current day every X seconds. Is there an easy way to achieve that? On 21.12.2017 16:06, Piotr Nowojski wrote: Hi, You defined a tumbling window (https://ci.apac

Re: Cassandra POJO sink flink 1.4.0 in scala

Yes but when CassandraScalaProductSinkBuilder called after identifying case class in CassandraSink class it will do sanityCheck and will throw the exception cause It won’t pass any query in that case. https://github.com/apache/flink/blob/master/flink-connectors/flink-connector-cassandra/src/main/j

Re: Cassandra POJO sink flink 1.4.0 in scala

Thanks for letting us know. The netty issue will be fixed in Flink 1.4.1. For case classes there is also a dedicated cassandra sink (every case class is a Product): https://github.com/apache/flink/blob/master/flink-connectors/flink-connector-cassandra/src/main/java/org/apache/flink/streaming/c

Re: periodic trigger

Hi, You defined a tumbling window (https://ci.apache.org/projects/flink/flink-docs-release-1.3/dev/windows.html#tumbling-windows ) of 60 seconds, triggered every 10 seconds. This means that each inpu

Re: Cassandra POJO sink flink 1.4.0 in scala

Hi, I have added netty-all 4.0 as dependency now it's working fine. Only thing I had to create POJO class ion scala like this. @SerialVersionUID(507L) @Table(keyspace = "twtt", name = "order") class OrderFinal( @BeanProperty var name: String, @BeanPro

Re: Can not resolve org.apache.hadoop.fs.Path in 1.4.0

For now, i have solved this issue by adding the following in filink config : classloader.resolve-order: parent-first So it will ignore the duplicate classes from uber jar. I will work on the dependencies. One quick question I am using SBT for the building. Do you have any example sbt file for dep

periodic trigger

Hi guys, I have the following code: SingleOutputStreamOperator lastUserSession = env .socketTextStream("localhost",9000,"\n") .map(new MapFunction() { @Override public Event map(String value)throws Exception { String[] row = value.split(",");

Re: state.checkpoints.dir not configured

I inspected the log as you suggest and found that 6123 port was used by another process. I free the port and restarted the job manager. Now everything looks fine. The error message is little misleading as the real cause is that 6123 is already bind but it says that state.checkpoints.dir is not

Re: Flink upgrade compatibility table

Hi Colin, thanks for pointing out this gap in the docs! I created FLINK-8303 [1] to extend the table and updated the release process documentation [2] to update the page for new releases. Thank you, Fabian [1] https://issues.apache.org/jira/browse/FLINK-8303 [2] https://cwiki.apache.org/confluen

Re: A question about Triggers

That's correct. Removal of timers is not supported in ProcessFunction. Not sure why this is supported for Triggers. The common workaround for ProcessFunctions is to register multiple timers and have a ValueState that stores the valid timestamp on which the onTimer method should be executed. When a

Re: Metric reporters with non-static ports

I am not sure (and because of holiday season you might not get an answer quickly), however I do not see a way to obtain this port other then by looking into the log files. On the other hand, I have an impression, that intention of this feature was that if you must execute N reporters on one sing

Re: entrypoint for executing job in task manager

Open method is called just before any elements are processed. You can hook in any initialisation logic there, including initialisation of a static context. However keep in mind, that since this context is static, it will be shared between multiple operators (if you are running parallelism > numb