Hi, interesting use case, you are looking for sure bets, I guess ;)
Well, I think, what you want to then is probably to use a ConnectedStream, which you keyBy the "name" of both streams. The you can use CoFlatMap for comparison. You can use a KeyValueState zu save prices. In each map you can then check if you have a price for this name already saved from the other stream and if not save the price. The challenge will be to clean up state. Let me know, if this works out. Cheers, Konstantin On 26.05.2016 20:01, iñaki williams wrote: > Hi! > > I will explain it with more details: > > I am comparing real time sport odds from two different betting Webpages. > > Assuming that I get just one java object (in reality I should get a List > of in-play matches), for each DataStream and assuming that the name is > the same of course, what I want to do is compare both price attributes > in "real time", I am only interested on the currently price, not the > previous one. Example: > > What is the price for the Event 1 from website "X" RIGHT NOW? > > JavaObjectX.price > > What is the price for the Event 1 from website "Y" RIGHT NOW? > > JavaObjectY.price > > > Compare both attributes > Get a result depending on that comparison > > My java object doesn't have a timestamp, but I think I should use it right? > > > Thanks! > > > > > > > > 2016-05-26 19:48 GMT+02:00 Konstantin Knauf > <konstantin.kn...@tngtech.com <mailto:konstantin.kn...@tngtech.com>>: > > Hi, > > let me first check, if I understand your requirements correctly. I > assume you want to compare attribute price for objects with the same > name only, right? > > Further, I assume the objects are some kind of offer/bid with a > timestamp? > > I think the solution heavily depends on how the records, which should be > compared relate in time. So basically, if an object arrives from one > source, which time window of objects from the other stream should be > considered for comparison? > > Cheers, > > Konstantin > > On 26.05.2016 18 <tel:26.05.2016%2018>:55, iñaki williams wrote: > > Hi! > > > > I am working on something quite similar to the stockPrice example that > > is posted on the webpage > > (https://flink.apache.org/news/2015/02/09/streaming-example.html) > > > > I am extracting some data from 2 different webpages and I > represent the > > result using a java object. The diagram could be something like this: > > > > DataStream1--------JavaObject(name, price) --\ > > \ > > [ > > how to compare result?] > > / > > DataStream2--------JavaObject(name, price) --/ > > > > > > What I want to do is to get the attribute price from both data objects > > and compare it between each other / make some math operations. For > > example, if the first JavaObject.price is bigger than the second > > JavaObject.price, then show a message. > > > > > > Which is the (best) way of doing this? I am new using Flink and I am > > quite lost :) > > > > > > Thanks! > > -- > Konstantin Knauf * konstantin.kn...@tngtech.com > <mailto:konstantin.kn...@tngtech.com> * +49-174-3413182 > <tel:%2B49-174-3413182> > TNG Technology Consulting GmbH, Betastr. 13a, 85774 Unterföhring > Geschäftsführer: Henrik Klagges, Christoph Stock, Dr. Robert Dahlke > Sitz: Unterföhring * Amtsgericht München * HRB 135082 > > -- Konstantin Knauf * konstantin.kn...@tngtech.com * +49-174-3413182 TNG Technology Consulting GmbH, Betastr. 13a, 85774 Unterföhring Geschäftsführer: Henrik Klagges, Christoph Stock, Dr. Robert Dahlke Sitz: Unterföhring * Amtsgericht München * HRB 135082
