Thanks, Stephan.
So the follow-up question -
Is it possible to cast an operator from optimizers/common API to Java
API? ( as Java to Common is possible via translateToDataFlow())
For eg -
org.apache.flink.api.common.operators.base.JoinOperatorBase;
to
org.apache.flink.api.java.operators.JoinOperat
Hi!
It seems you are actually working on the Optimizer's representation of the
program. The optimizer (and the runtime as well) think about Flink programs
in terms of data flows, not data sets any more (that is only in the
Java/Scala API).
The Java API operations get translated to the data flow o
Hi
For a given Operator, it is easily possible to find the input and output
TypeInformation,which gives the datatype and other information of the
dataset. For e.g.
if(operator instanceof SingleInputOperator){
inputTypes.add(((SingleInputOperator)operator).getOperatorInfo().getInputType());
}
For
Okay, nice to hear!
Ping us if you run into other trouble...
On Thu, Apr 23, 2015 at 2:28 PM, Amit Pawar wrote:
> Thanks Stephan.
> Using flink-dist jar solves the issue.
>
>
> Thanks and Regards
> Amit Pawar
>
>
> On Thu, Apr 23, 2015 at 2:02 PM, Stephan Ewen wrote:
>
> > Hi!
> >
> > What you
Thanks Stephan.
Using flink-dist jar solves the issue.
Thanks and Regards
Amit Pawar
On Thu, Apr 23, 2015 at 2:02 PM, Stephan Ewen wrote:
> Hi!
>
> What you describe sounds pretty much like a version mixup - NoSuchMethod
> indicates one part of the code is out of sync with the other. Can you
Hi!
What you describe sounds pretty much like a version mixup - NoSuchMethod
indicates one part of the code is out of sync with the other. Can you make
sure that you have all jars from the same Flink version in the classpath?
For the Optimizer Exception: The cause may be a similar issue (version
Many thanks Stephan.
I followed your instructions and it was working fine when I had the
required flink projects in the build path,
later when I substituted it by adding respective dependencies with the
snapshots in pom, I am getting the below exception at
OptimizedPlan opPlan = op.compile(env.cre
Hi Amit!
The DataSet API is basically a fluent builder for the internal DAG of
operations, the "Plan". This plan is build when you call "env.execute()".
You can directly get the Plan by calling
ExecutionEnvironment#createProgramPlan()
The JSON plan has in addition the information inserted by the
Hi
I am trying to extract/retrieve the Flink execution plan. I managed to get
it as JSON string in following ways:
1. Using JAR - via PackagedProgram using getPreviewPlan() ; or
2. Directly in program - via ExecutionEnvironment's getExecutionPlan()
My question is - Is it possible to retrieve dire
