Re: Join to external table

2017-04-14 Thread Eugene Kirpichov
Hi, Note that there's a JIRA about this - https://issues.apache.org/jira/browse/BEAM-1197 - but no solution yet :) On Fri, Apr 14, 2017 at 10:58 AM Dan Halperin wrote: > Hi Jingsong, > > This seems like a fantastic, reusable pattern to add, and indeed it's a > fairly common one. There are proba

Re: Join to external table

2017-04-14 Thread Dan Halperin
Hi Jingsong, This seems like a fantastic, reusable pattern to add, and indeed it's a fairly common one. There are probably some interesting API issues too -- such as how you make a nice clean interface that works for many backends (Bigtable? HBase? Redis? Memcache? etc.), and how you let users sup

Join to external table

2017-04-13 Thread JingsongLee
Hi all, I've seen repeatedly the following pattern: Consider a sql (Joining stream to table, from Calcite): SELECT STREAM o.rowtime, o.productId, o.orderId, o.units,   p.name, p.unitPrice FROM Orders AS o JOIN Products AS p   ON o.productId = p.productId; A stream-to-table join is straightforward