Re: Loss of TaskManager Error

2016-08-01 Thread Debaditya Roy
t the log of the presumably failed task manager says? > It might contain hints to what actually went wrong. > > Cheers, > Till > > On Mon, Aug 1, 2016 at 9:49 PM, Debaditya Roy wrote: > >> Hello users, >> >> I was running an experiment on a very simple clust

Loss of TaskManager Error

2016-08-01 Thread Debaditya Roy
Hello users, I was running an experiment on a very simple cluster with two nodes (one jobmanager and another taskmanager). However after starting the execution, in a few seconds the program is aborted with the error. The program finished with the following exception: org.apache.flink.client.prog

Re: .so linkage error in Cluster

2016-07-27 Thread Debaditya Roy
Do I need to do some more tweak to run in the cluster? Regards, Debaditya On Tue, Jul 26, 2016 at 8:56 PM, Debaditya Roy wrote: > Hi, > > For the error I get this when I run the .jar made by mvn clean package > > java.lang.NoClassDefFoundError: org/bytedeco/javacpp/ope

Re: .so linkage error in Cluster

2016-07-26 Thread Debaditya Roy
7:09 PM, Ufuk Celebi wrote: > > What error message to you get from Maven? > > > > On Tue, Jul 26, 2016 at 4:39 PM, Debaditya Roy > wrote: > >> Hello, > >> > >> I am using the jar builder from IntelliJ IDE (the mvn one was causing > >> proble

Re: .so linkage error in Cluster

2016-07-26 Thread Debaditya Roy
ode should fetch it from the > JobManager. How are you packaging your JAR? > > On Tue, Jul 26, 2016 at 4:32 PM, Debaditya Roy > wrote: > > Hello users, > > > > I am having a problem while running my flink program in a cluster. It > gives > > me an error that

.so linkage error in Cluster

2016-07-26 Thread Debaditya Roy
Hello users, I am having a problem while running my flink program in a cluster. It gives me an error that it is unable to find an .so file in a tmp directory. Caused by: java.lang.UnsatisfiedLinkError: no jniopencv_core in java.library.path at java.lang.ClassLoader.loadLibrary(ClassLoader.jav

Re: Parallelizing openCV libraries in Flink

2016-07-19 Thread Debaditya Roy
; > On Tue, Jul 19, 2016 at 10:33 AM, Debaditya Roy > wrote: > >> Hello users, >> >> I am currently doing a project in image processing with Open CV library. >> Have anyone here faced any issue with parallelizing the library in flink? I >> have written a code

Parallelizing openCV libraries in Flink

2016-07-19 Thread Debaditya Roy
Hello users, I am currently doing a project in image processing with Open CV library. Have anyone here faced any issue with parallelizing the library in flink? I have written a code which is running fine on local environment, however when I try to run it in distributed environment it writes (it wa

Re: Writing in flink clusters

2016-07-13 Thread Debaditya Roy
your output is certainly somewhere. > By the way, when using distributed mode it is easier to use an output like > HDFS. This way you'll find the result on the same path no matter where sink > tasks had been ran. > > Regards, > > Alexis. > > 2016-07-13 15:20 GMT+02:00

Writing in flink clusters

2016-07-13 Thread Debaditya Roy
Hello users, I have written and executed a flink program in a cluster. The program was supposed to write to some text file as a sink, however I cannot find the text files in the target directory of the cluster nodes, but when I reexecute the program second time, it gives me the predictable error:

Localhost terminated

2016-06-23 Thread Debaditya Roy
Hello users, I have a problem with flink execution from cli. Each time I deploy from the CLI, the job starts but then it terminates the localhost. *06/23/2016 16:42:18Source: Custom Source -> Flat Map -> Sink: Unnamed(1/1) switched to SCHEDULED 06/23/2016 16:42:19Source: Custom Source -

Re: Caused by: java.lang.Exception: Serialized representation of java.lang.StackOverflowError: null

2016-06-21 Thread Debaditya Roy
gt; On Tue, Jun 21, 2016 at 5:22 PM, Debaditya Roy > wrote: > >> Hello users, >> >> I am getting an error from the flat map function while running my >> program. My program is sending an object of type Mat(OpenCV) from the >> custom source function and passing

Caused by: java.lang.Exception: Serialized representation of java.lang.StackOverflowError: null

2016-06-21 Thread Debaditya Roy
Hello users, I am getting an error from the flat map function while running my program. My program is sending an object of type Mat(OpenCV) from the custom source function and passing it to the flat map function for processing. However while executing I am getting this error:

Caused by: java.lang.IllegalArgumentException: LoggerFactory is not a Logback LoggerContext

2016-06-20 Thread Debaditya Roy
Hello users, I am getting a error while running my flink jar from command line or web frontend, the error does not arises when I run the program from Intellij IDE. I am posting the error below. *org.apache.flink.client.program.ProgramInvocationException: The main meth

Re: Exception in thread main: No such exception errpr

2016-06-03 Thread Debaditya Roy
premature abort in the web interface). Sorry for long mail and thanks in advance. Warm Regards, Debaditya On Thu, Jun 2, 2016 at 5:53 PM, Debaditya Roy wrote: > Yeah i will do that as a last resort. But the strange fact is in IDE it is > working fine. Although I am not entirely aware

Re: Exception in thread main: No such exception errpr

2016-06-02 Thread Debaditya Roy
got to clean some directory or forgot to rebuild > after updating versions. > What you could do is delete and clean everything and > reinstall/re-download/rebuild them. > > I hope this is not too much of a hassle. > > Kostas > > On Jun 2, 2016, at 4:36 PM, Debaditya Ro

Re: Exception in thread main: No such exception errpr

2016-06-02 Thread Debaditya Roy
/Downloads/flink-1.0.3/log/flink-royd1990-jobmanager-0-royd1990-HP-ENVY-Notebook.log On Thu, Jun 2, 2016 at 4:32 PM, Kostas Kloudas wrote: > Form the Flink logs you see that the version is the correct right (1.0.3)? > > On Jun 2, 2016, at 4:19 PM, Debaditya Roy wrote: > > Hello

Re: Exception in thread main: No such exception errpr

2016-06-02 Thread Debaditya Roy
arn-tests_2.10. > > On Thu, Jun 2, 2016 at 3:54 PM, Debaditya Roy wrote: > >> Hi Kostas, >> >> Doing this throws an error in the pom. >> >> >>org.apache.flink >>flink-yarn-tests >>${flink.version} >> >> &g

Re: Exception in thread main: No such exception errpr

2016-06-02 Thread Debaditya Roy
SNAPSHOT with ${flink.version} in the pom? > > Thanks, > Kostas > > On Jun 2, 2016, at 3:13 PM, Debaditya Roy wrote: > > 0.10-SNAPSHOT > > >

Re: Exception in thread main: No such exception errpr

2016-06-02 Thread Debaditya Roy
ds, Debaditya On Thu, Jun 2, 2016 at 3:07 PM, Kostas Kloudas wrote: > Could you please post your pom file and which version of Flink you > downloaded? > The latter you can find it in the beginning of the log files. > > Kostas > > On Jun 2, 2016, at 2:55 PM, Debaditya Roy wr

Re: Exception in thread main: No such exception errpr

2016-06-02 Thread Debaditya Roy
re currently using) ? > > Kostas > > On Jun 2, 2016, at 2:01 PM, Debaditya Roy wrote: > > Hello Kostas, > > Thanks for you reply. > > I don't think that is the case because I am running the application on the > jvm of my local machine, not on a distributed cluster. Any o

Re: Exception in thread main: No such exception errpr

2016-06-02 Thread Debaditya Roy
local machine? > In this case, Flink version Y may have a method that is no longer there in > version X, and this causes the > exception. > > Kostas > > On Jun 2, 2016, at 12:02 PM, Debaditya Roy wrote: > > Hi, > > I am trying to run a simple flink program, which

Exception in thread main: No such exception errpr

2016-06-02 Thread Debaditya Roy
Hi, I am trying to run a simple flink program, which reads an image from disk and does some image processing and stores it back to the disk. For the purpose I have a custom defined class, which I am using in dataset and passing it onwards to flatmap function. However the experiment encountered an

Re: Unsatisfied Link Error

2016-05-31 Thread Debaditya Roy
ngs, > Stephan > > > On Tue, May 31, 2016 at 10:55 AM, Debaditya Roy > wrote: > >> Actually I have worked on IntelliJ only. As you said I also suspect the >> fat jar (created from intelliJ) is unable to have the link to the native >> library when I generate it and

Re: Unsatisfied Link Error

2016-05-31 Thread Debaditya Roy
anager. > > When you run it through intellij it takes care of including the libraries. > > To create fat jar use maven-shade-plugin. > > Let me know if it works. > > Thanks, > Arpit > > On Mon, May 30, 2016 at 2:41 PM, Debaditya Roy > wrote: > >> I was t

Unsatisfied Link Error

2016-05-30 Thread Debaditya Roy
I was trying to run a basic program in java by submitting to the job manager in Flink. I have a native library from open CV. When I try to submit the job I get "java.lang.UnsatisfiedLinkError: no opencv_java310 in java.library.path", however when I run it on Intellij by setting up the flink executi