ector(new
DimensionKeySelector(config));
trans.setStateKeyType(new GenericTypeInfo(String.class));
--
View this message in context:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Window-Function-on-AllWindowed-Stream-Combining-Kafka-Topics-tp12941p14373.html
Sent fro
ic long extractTimestamp(MetricSignalSet element) {
> return element.get(0).timestamp().getTime();
>}
> }
>
> Any thoughts?
>
>
>
>
> --
> View this message in context:
> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Window-Function-on-AllWindowed-Stream-Combining-Kafka-Topics-tp12941p13663.html
> Sent from the Apache Flink User Mailing List archive. mailing list archive at
> Nabble.com.
}
Any thoughts?
--
View this message in context:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Window-Function-on-AllWindowed-Stream-Combining-Kafka-Topics-tp12941p13663.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at
Nabble.com.
It seems that eventTime is a static field in TopicPojo and the key selector
also just gets the static field via TopicPojo.getEventTime(). Why is that?
Because with this the event time basically has nothing to do with the data.
> On 5. May 2017, at 10:32, G.S.Vijay Raajaa wrote:
>
> I tried the
I tried the timestamp field as a string datatype as well as a Date object.
Getting same error in both the cases;
Please find the POJO file:
import java.text.DateFormat;
import java.text.ParseException;
import java.text.SimpleDateFormat;
import java.util.Date;
import java.util.HashMap;
import
What’s the KeySelector you’re using? To me, this indicates that the timestamp
field is somehow changing after the original keying or in transit.
Best.
Aljoscha
> On 4. May 2017, at 22:01, G.S.Vijay Raajaa wrote:
>
> I tried to reorder and the window function works fine. but then after
> proces
I tried to reorder and the window function works fine. but then after
processing few stream of data from Topic A and Topic B, the window function
seem to throw the below error. The keyby is on eventTime field.
java.lang.RuntimeException: Unexpected key group index. This indicates a
bug.
at org.ap
Thanks for your input, will try to incorporate them in my implementation.
Regards,
Vijay Raajaa G S
On Wed, May 3, 2017 at 3:28 PM, Aljoscha Krettek
wrote:
> The approach could work, but if it can happen that an event from stream A
> is not matched by an event in stream B you will have lingerin
The approach could work, but if it can happen that an event from stream A is
not matched by an event in stream B you will have lingering state that never
goes away. For such cases it might be better to write a custom
CoProcessFunction as sketched here:
https://ci.apache.org/projects/flink/flink
Sure. Thanks for the pointer, let me reorder the same. Any comments about
the approach followed for merging topics and creating a single JSON?
Regards,
Vijay Raajaa G S
On Wed, May 3, 2017 at 2:41 PM, Aljoscha Krettek
wrote:
> Hi,
> An AllWindow operator requires an AllWindowFunction, instead o
Hi,
An AllWindow operator requires an AllWindowFunction, instead of a
WindowFunction. In your case, the keyBy() seems to be in the wrong place, to
get a keyed window you have to write something akin to:
inputStream
.keyBy(…)
.window(…)
.apply(…) // or reduce()
In your case, you key the st
Hi,
I am trying to combine two kafka topics using the a single kafka consumer
on a list of topics, further convert the json string in the stream to POJO.
Then, join them via keyBy ( On event time field ) and to merge them as a
single fat json, I was planning to use a window stream and apply a wind
12 matches
Mail list logo
