Re: Re: Duplicate operators generated by plan

2020-12-07 Thread Rex Fenley
t; System.out.println(ret.explain()); > > DataStream> row = bsTableEnv.toRetractStream(ret, > Row.class); > row.addSink(new SinkFunction>() { >@Override > public void invoke(Tuple2 value, Context context) throws > Exception { > >} > }); > > System.out.println(bsEnv.getStreamGraph().getStreamingPlanAsJSON()); >

Re: Re: Duplicate operators generated by plan

2020-12-06 Thread Yun Gao
row = bsTableEnv.toRetractStream(ret, Row.class); row.addSink(new SinkFunction>() { @Override public void invoke(Tuple2 value, Context context) throws Exception { } }); System.out.println(bsEnv.getStreamGraph().getStreamingPlanAsJSON()); ---------- Sen

Re: Duplicate operators generated by plan

2020-12-03 Thread Rex Fenley
etResultType(signature: Array[Class[_]]): > TypeInformation[_] = > Types.ROW( > Types.LONG, > Types.BOOLEAN, > Types.BOOLEAN, > Types.BOOLEAN, > Types.BOOLEAN > ) > } > > > On Thu, Dec 3, 2020 at 7:49 PM Yun Gao wrote: > >> Hi Rex, >> >>

Re: Duplicate operators generated by plan

2020-12-03 Thread Rex Fenley
OOLEAN, Types.BOOLEAN, Types.BOOLEAN ) } On Thu, Dec 3, 2020 at 7:49 PM Yun Gao wrote: > Hi Rex, > > Could you also attach one example for these sql / table ? And one > possible issue to confirm is that does the operators with the same names > also have the same inputs ? > &g

Re: Duplicate operators generated by plan

2020-12-03 Thread Yun Gao
Hi Rex, Could you also attach one example for these sql / table ? And one possible issue to confirm is that does the operators with the same names also have the same inputs ? Best, Yun --Original Mail -- Sender:Rex Fenley Send Date:Fri Dec 4 02:55:41 2020

Duplicate operators generated by plan

2020-12-03 Thread Rex Fenley
Hello, I'm running into an issue where my execution plan is creating the same exact join operator multiple times simply because the subsequent operator filters on a different boolean value. This is a massive duplication of storage and work. The filtered operators which follow result in only a smal