Re: Blink Planner Retracting Streams

2020-06-18 Thread John Mathews
throw new UnsupportedOperationException(); } } private static final class TupleMapper implements FlatMapFunction, Row> { @Override public void flatMap(Tuple2 value, Collector out) { if (value.f0) { out.collect(value.f1); } } } On Thu, Jun 18, 2020 a

Re: Blink Planner Retracting Streams

2020-06-18 Thread John Mathews
flag and the Row. > > Best, > Jark > > > > On Thu, 18 Jun 2020 at 06:39, John Mathews wrote: > >> Hello Godfrey, >> >> Thanks for the response! >> >> I think the problem with Tuple2, is that if my understanding is correct >> of how CRow wo

Re: Blink Planner Retracting Streams

2020-06-17 Thread John Mathews
> StreamTableEnvironment#toRetractStream method return DataStream[(Boolean, > T)]. > > the code looks like: > > tEnv.toRetractStream[Row](table).map(new MapFunction[(Boolean, Row), R] { > override def map(value: (Boolean, Row)): R = ... > }) > > Bests, > Godfrey > >

Blink Planner Retracting Streams

2020-06-16 Thread John Mathews
Hello, I am working on migrating from the flink table-planner to the new blink one, and one problem I am running into is that it doesn't seem like Blink has a concept of a CRow, unlike the original table-planner. I am therefore struggling to figure out how to properly convert a retracting stream

Re: Shipping Filesystem Plugins with YarnClusterDescriptor

2020-06-11 Thread John Mathews
t; meet any problem with this approach? > > [1] > https://github.com/apache/flink/blob/216f65fff10fb0957e324570662d075be66bacdf/flink-yarn/src/main/java/org/apache/flink/yarn/YarnClusterDescriptor.java#L770 > > Best, > Yangze Guo > > On Wed, Jun 10, 2020 at 11:29 PM

Shipping Filesystem Plugins with YarnClusterDescriptor

2020-06-10 Thread John Mathews
Hello, I have a custom filesystem that I am trying to migrate to the plugins model described here: https://ci.apache.org/projects/flink/flink-docs-stable/ops/filesystems/#adding-a-new-pluggable-file-system-implementation, but it is unclear to me how to dynamically get the plugins directory to be a