Re: REST api: how to upload jar?

Hey Cliff You can upload a jar file using http post with the file data sent under a form field 'jarfile'. Can you also please open a jira for fixing the documentation? - Sachin On Jan 25, 2017 06:55, "Cliff Resnick" wrote: > The 1.2 release documentation (https://ci.apache.org/project > s/fli

Running into memory issues while running on Yarn

Hey! I'm running locally under this configuration(copied from nodemanager logs): physical-memory=8192 virtual-memory=17204 virtual-cores=8 Before starting a flink deployment, memory usage stats show 3.7 GB used on system, indicating lots of free memory for flink containers. However, after I submi

Re: Running continuously on yarn with kerberos

Usually, if all the dependencies are being downloaded, i.e., on the first build, it'll likely take 30-40 minutes. Subsequent builds might take 10 minutes approx. [I have the same PC configuration.] -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Sun, Nov 8, 2015 at 2:05 AM,

Re: Bug in Hybrid Hash Join

Okay. Great! Please re-open the jira in case the issue hasn't been resolved. Cheers! Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Tue, Oct 13, 2015 at 4:00 PM, Flavio Pompermaier wrote: > I ensured that I was using the latest version and I showed to pr

Re: Bug in Hybrid Hash Join

Hi Flavio This was addressed in Flink-2763. Can you check if you're using the latest version? Cheers! Sachin On Oct 13, 2015 5:04 AM, "Flavio Pompermaier" wrote: > Hi guys, > my job fails on Flink 0.10-snapshot with the following message: Bug in > Hybrid Hash Join: Request to spill a partition w

Re: Stuck builds on travis

Found another one: https://travis-ci.org/apache/flink/jobs/84473635 -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Fri, Oct 9, 2015 at 7:06 PM, Sachin Goel wrote: > These two builds are stuck on travis. It seems to a travis issue and is > limiting the number of conc

Stuck builds on travis

These two builds are stuck on travis. It seems to a travis issue and is limiting the number of concurrent builds to 3. https://travis-ci.org/apache/flink/jobs/84317317 https://travis-ci.org/apache/flink/jobs/84405887 Perhaps someone from infra should cancel them. -- Sachin Goel Computer Science

Re: Distribute DataSet to subset of nodes

Of course, someone else might have better ideas in re the partitioner. :) On Sep 14, 2015 1:12 AM, "Sachin Goel" wrote: > Hi Stefan > Just a clarification : The output corresponding to an element based on the > whole data will be a union of the outputs based on the two hal

Re: "Not enough free slots available to run the job" for word count example

Hi Daniel Your problem did get solved, I assume. As for the -p flag, it determines the default parallelism of operators at runtime. If you end up specifying a value more than the slots available, that's an issue. Hope that helped. Cheers Sachin On Sep 13, 2015 9:13 PM, "Daniel Blazevski" wrote:

Re: Distribute DataSet to subset of nodes

Hi Stefan Just a clarification : The output corresponding to an element based on the whole data will be a union of the outputs based on the two halves. Is this what you're trying to achieve? [It appears like that since every flatMap task will independently produce outputs.] In that case, one solu

Re: Convergence Criterion in IterativeDataSet

Hi Andres Does something like this solve what you're trying to achieve? https://github.com/apache/flink/pull/918/files Regards Sachin On Sep 4, 2015 6:24 PM, "Stephan Ewen" wrote: > I think you can do this with the current interface. The convergence > criterion object stays around, so you should

Re: Multiple restarts of Local Cluster

I'm not sure what you mean by "Crucial cleanup is in shutdown hooks". Could you elaborate? -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Wed, Sep 2, 2015 at 10:25 PM, Stephan Ewen wrote: > You can always shut down a cluster manually (via shutdown()) and i

Re: Multiple restarts of Local Cluster

If I'm right, all Tests use either the MultipleProgramTestBase or JavaProgramTestBase​. Those shut down the cluster explicitly anyway. I will make sure if this is the case. Regards Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Wed, Sep 2, 2015 at 9:40 PM, Till Roh

Re: Multiple restarts of Local Cluster

to start up the cluster only once. Regards Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Wed, Sep 2, 2015 at 9:33 PM, Till Rohrmann wrote: > Oh sorry, then I got the wrong context. I somehow thought it was about > test cases because I read `MultipleProgramTestBase` etc.

Re: Multiple restarts of Local Cluster

user to terminate the cluster after execution, while in local mode. -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Wed, Sep 2, 2015 at 9:19 PM, Till Rohrmann wrote: > Why is it not possible to shut down the local cluster? Can’t you shut it > down in the @AfterClass

Re: Multiple restarts of Local Cluster

Yes. That will work too. However, then it isn't possible to shut down the local cluster. [Is it necessary to do so or does it shut down automatically when the program exists? I'm not entirely sure.] -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Wed, Sep 2, 2015

Multiple restarts of Local Cluster

ed on persisted results. One potential solution could be to follow the methodology in `MultipleProgramsTestBase`. The user code then would have to reside in a fixed function name, instead of the main method. Or is that too cumbersome? Regards Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685

Travis updates on Github

Hi all Is there some issue with travis integration? The last three pull requests do not have their build status on Github page. The builds are getting triggered though. Regards Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685

Re: filter as termination condition

n [or the other way around] and have some tolerance value instead of an exact equality check. Cheers! Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Jul 22, 2015 5:46 PM, "Stephan Ewen" wrote: > Termination happens if the "termination criterion" data

Re: loop break operation

Gah. Sorry. In the closeWith call, give a second argument which determines if the iteration should be stopped. -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Jul 20, 2015 3:21 PM, "Pa Rö" wrote: > i not found the "iterateWithTermination" funct

Re: loop break operation

/pull/918. Take a look. -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Mon, Jul 20, 2015 at 2:55 PM, Pa Rö wrote: > hello community, > > i have write a k-means app in flink, now i want change my terminate > condition from max iteration to checking the changing of

Re: Run Time Exception

call env.execute. Cheers! Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Sun, Jul 19, 2015 at 8:06 PM, Madabhattula Rajesh Kumar < mrajaf...@gmail.com> wrote: > Hi, > > I have written simple wordcount program in scala. When I execute the > program,

Re: Choosing random element

ering/KMeansRandomInit.scala Note that numCluster is the number of points you need in the sample. Regards Sachin Goel On Tue, Jun 16, 2015 at 2:45 PM, Maximilian Alber < alber.maximil...@gmail.com> wrote: > Thanks! > Cheers, > Max > > On Tue, Jun 16, 2015 at 11:01 AM, Till Rohrmann