Kryo StackOverflowError

2016-04-09 Thread Andrew Palumbo
Hi all, I am working on a matrix multiplication operation for Mahout Flink Bindings that uses quite a few chained Flink Dataset operations, When testing, I am getting the following error: {...} 04/09/2016 22:30:35CHAIN Reduce (Reduce at org.apache.mahout.flinkbindings.blas.FlinkOpABt$.

Re: Intellij code style

2016-04-09 Thread Naveen Madhire
Apache Phoenix has one code template which contributors use. Do you think onc can use the same for Flink or may be with some more modifications? https://github.com/apache/phoenix/blob/master/dev/PhoenixCodeTemplate.xml On Sat, Apr 9, 2016 at 11:00 AM, Stephan Ewen wrote: > Actually, It would b

Re: Intellij code style

2016-04-09 Thread Stephan Ewen
Actually, It would be amazing to create a code style profile for download, so that all contributors would use that. Same thing actually for IntelliJ inspections: A set of inspections we want to have active and where we strive for zero warnings. On Sat, Apr 9, 2016 at 10:00 AM, Robert Metzger wro

Re: [DISCUSS] Macro-benchmarking for performance tuning and regression detection

2016-04-09 Thread Gábor Gévay
Hello, I think that creating a macro-benchmarking module would be a very good idea. It would make doing performance-related changes much easier and safer. I have also used Peel, and can confirm that it would be a good fit for this task. > I've also been looking recently at some of the hot code a

[jira] [Created] (FLINK-3722) The divisions in the InMemorySorters' swap/compare methods hurt performance

2016-04-09 Thread Gabor Gevay (JIRA)
Gabor Gevay created FLINK-3722: -- Summary: The divisions in the InMemorySorters' swap/compare methods hurt performance Key: FLINK-3722 URL: https://issues.apache.org/jira/browse/FLINK-3722 Project: Flink

Re: Multi-Layer Perceptron

2016-04-09 Thread Robert Metzger
Hi Trevor, I'm sorry that nobody responded to your message. As you've probably noticed there are a lot of things going on in the community so this one slipped through the cracks. I don't think its intentional. I hope my response brings your email to the attention of the ML folks in the Flink comm

Re: Intellij code style

2016-04-09 Thread Robert Metzger
Hi Dawid, we don't have an automated formatter for intelliJ. However, you can use the "Checkstyle" plugin of IntelliJ to mark checkstyle violations in the IDE. On Fri, Apr 8, 2016 at 12:30 PM, Dawid Wysakowicz < wysakowicz.da...@gmail.com> wrote: > Hi all, > > I am currently working on some issu

Re: Unique ID of an operator

2016-04-09 Thread Robert Metzger
Hi, the runtime context has the following method: int subtask = getRuntimeContext().getIndexOfThisSubtask(); The RuntimeContext is available in each Rich* function. On Fri, Apr 8, 2016 at 11:46 PM, Deepak Jha wrote: > Hi, > I have a use case where I need to get UniqueId of an operator inside