Hello Beam! Kaskada has created a query language for expressing temporal queries, making it easy to work with multiple streams and perform temporally correct joins. We’re looking at taking our native, columnar execution engine and making it available as a PTransform and FnHarness for use with Apache Beam.
We’ve drafted a [short document][proposal] outlining our planned approach and the potential benefits to Kaskada and Beam users. It would be super helpful to get some feedback on this approach and any ways that it could be improved / better integrated with Beam to provide more value! Could you see yourself using (or contributing) to this work? Let us know! Thanks! Ben [proposal]: https://docs.google.com/document/d/1w6DYpYCi1c521AOh83JN3CB3C9pZwBPruUbawqH-NsA/edit