What is the compile error? Or could you already resolve it? there should
not be a difference from 1.0 to 1.1-SNAPSHOT for both classes...
And yes, prefix _2.11 is only available for released but not for current
development branch. But it is the same code (no need to worry about it).
-Matthias
On
Hi Matthias,
I change the version as per your requirement but when I do that I have a
compilation error at the level of the classes
org.apache.flink.storm.util.BoltFileSink and
org.apache.flink.storm.util.OutputFormatter
Btw, the dependency
org.apache.flink
flink-storm-examples_2.11
1.1-SNA
change the version to 1.1-SNAPSHOT
On 04/14/2016 11:52 AM, star jlong wrote:
> One question which dependency of flink are you using because I'm using
> org.apache.flink
> flink-storm-examples_2.11
> 1.0.0
> And once I change the version to SNAPSHOT version, the pom.xml complains that
> it cou
One question which dependency of flink are you using because I'm using
org.apache.flink
flink-storm-examples_2.11
1.0.0
And once I change the version to SNAPSHOT version, the pom.xml complains that
it could not satisfy the given dependency.
Le Jeudi 14 avril 2016 10h45, star jlong a
écr
Yes it is.
Le Jeudi 14 avril 2016 10h39, Matthias J. Sax a écrit :
For the fix, you need to use the current development version of Flink,
ie, change your maven dependency from 1.0 to
1.1-SNAPSHOT
One question: what is FlinkGitService.class? It does only show up when
you get the ClassLoa
For the fix, you need to use the current development version of Flink,
ie, change your maven dependency from 1.0 to
1.1-SNAPSHOT
One question: what is FlinkGitService.class? It does only show up when
you get the ClassLoader:
> ClassLoader loader = URLClassLoader.newInstance(new URL[] { new URL(pa
What I'm trying to say is that to get submit the flink topology to flink, I
had to do an invocation of the mainMethod(which contain the actaul topology) of
my topology with the class java.lang.reflect.Method.That is if you a take look
at the following the topology the mainMethod is buildTopolog
I cannot follow completely in your last step when you fail. What do you
mean by "I'm stuck at the level when I want to copy that from the jar to
submit it to flink"?
Btw: I copied the code from the SO question and it works for me on the
current master (which includes Till's hotfix).
-Matthias
O
@Stephan,
I have try using RemoteStreamEnvironment but I have another exception which is
java.lang.IllegalStateException: No operators defined in streaming topology.
Cannot execute.
Le Mercredi 13 avril 2016 20h40, star jlong a
écrit :
Thanks Matthias for the reply.
Maybe I shou
Thanks Matthias for the reply.
Maybe I should explain what I want to do better.My objective is to deploy a
flink topology on flink using java but in the production mode. For that here
are the step that I have taken.
1-Convert a sample wordcount storm topology to a flink topology as indicated
he
Hi!
For a Storm program, you would need a "RemoteStreamEnvironment" - the
"RemoteEnvironment" is for batch programs.
Stephan
On Wed, Apr 13, 2016 at 6:23 PM, star jlong
wrote:
> Thanks for the reply.
> @Stephen, I try using RemoteEnvironment to submit my topology to flink.
> Here is the try th
Hi jstar,
I need to have a close look. But I am wondering why you use reflection
in the first place? Is there any specific reason for that?
Furthermore, the example provided in project maven-example also covers
the case to submit a topology to Flink via Java. Have a look at
org.apache.flink.storm
Thanks for the reply.
@Stephen, I try using RemoteEnvironment to submit my topology to flink.
Here is the try that I did RemoteEnvironment remote = new
RemoteEnvironment(ipJobManager, 6123, jarPath); remote.execute();
While running the program, this is the exception that I got.
java.lang.RuntimeE
I think this is not the problem here since the problem is still happening
on the client side when the FlinkTopology tries to copy the registered
spouts. This happens before the job is submitted to the cluster. Maybe
Mathias could chime in here.
Cheers,
Till
On Wed, Apr 13, 2016 at 5:39 PM, Stepha
Hi!
For flink standalone programs, you would use a "RemoteEnvironment"
For Storm, I would use the "FlinkClient" in "org.apache.flink.storm.api".
That one should deal with jars, classloaders, etc for you.
Stephan
On Wed, Apr 13, 2016 at 3:43 PM, star jlong
wrote:
> Thanks for the suggestion.
Thanks for the suggestion. Sure those examples are interesting and I have
deploy them successfully on flink. The deployment is done the command line that
is doing something like
bin/flink run example.jarBut what I want is to submit the topology to flink
using a java program.
Thanks.
Le Me
you can find examples here:
https://github.com/apache/flink/tree/master/flink-contrib/flink-storm-examples
we haven't established yet that it is an API issue; it could very well
be caused by the reflection magic you're using...
On 13.04.2016 14:57, star jlong wrote:
Ok, it seems like there a
Ok, it seems like there an issue with the api. So please does anybody has a
working example for deploying a topology using the flink dependency
flink-storm_2.11 or any other will be welcoming.
Thanks,
jstar
Le Mercredi 13 avril 2016 13h44, star jlong a
écrit :
Hi Schepler,
Thanks fo
I've updated the master. Could you check it out and run your program with
the latest master? I would expect to see a ClassNotFoundException.
On Wed, Apr 13, 2016 at 2:54 PM, Till Rohrmann wrote:
> Yes that is true. I'll commit a hotfix for that.
>
> My suspicion is that we use the wrong class lo
Yes that is true. I'll commit a hotfix for that.
My suspicion is that we use the wrong class loader in the
FlinkTopology.copyObject method to load the RandomSentenceSpout class. We
can see that once I removed the exception swallowing in the current master.
On Wed, Apr 13, 2016 at 2:40 PM, star jl
Hi Schepler,
Thanks for the concerned. Yes I'm actaully having the same issue as indicated
on that post because I'm the one that posted that issue.
Le Mercredi 13 avril 2016 13h35, Chesnay Schepler a
écrit :
http://stackoverflow.com/questions/36584784/issues-while-submitting-a-topolo
I think the following is the interesting part of the stack-trace:
|Causedby:java.lang.RuntimeException:Failedto copy object.at
org.apache.flink.storm.api.FlinkTopology.copyObject(FlinkTopology.java:145)at
org.apache.flink.storm.api.FlinkTopology.getPrivateField(FlinkTopology.java:132)at
org.ap
http://stackoverflow.com/questions/36584784/issues-while-submitting-a-topology-to-apache-flink-using-the-flink-api
On 13.04.2016 14:28, Till Rohrmann wrote:
Hi jstar,
what's exactly the problem you're observing?
Cheers,
Till
On Wed, Apr 13, 2016 at 2:23 PM, star jlong
wrote:
Hi there,
I'm
Hi Till,
Thank for the quick reply. I'm unable to copy the mainMethod of my topology
using the instruction
(FlinkTopology) method.invoke(null, new Object[] {});
where method is variable of type java.lang.reflect.Method
Le Mercredi 13 avril 2016 13h28, Till Rohrmann a
écrit :
Hi jstar,
Hi jstar,
what's exactly the problem you're observing?
Cheers,
Till
On Wed, Apr 13, 2016 at 2:23 PM, star jlong
wrote:
> Hi there,
>
> I'm jstar. I have been playing around with flink. I'm very much interested
> in submitting a topoloy to flink using its api. As indicated
> on stackoverflow,
25 matches
Mail list logo
