This is a very common problem in my experience. Late-arriving and
semi-ordered data make a lot of stream processing problems more difficult.
Are you able to perform analysis with part of the data? For instance
buffering some number of events and then analyze?
How exactly do you know definitively
I think this points out the need for a single canonical cross-platform C
client lib with support for Zookeeper that could easily wrapped for use in
other languages.
It would make it much easier for people using Python, Ruby, Node, Lua,
Haskell, Go, OCaml, etc to have such a library that matches th