[jira] [Created] (FLINK-2713) Custom StateCheckpointers should be included in the snapshots

2015-09-19 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-2713: - Summary: Custom StateCheckpointers should be included in the snapshots Key: FLINK-2713 URL: https://issues.apache.org/jira/browse/FLINK-2713 Project: Flink Issue

Re: Tests in the streaming API

2015-09-19 Thread Aljoscha Krettek
Hi, this is absolutely true. Also, a lot of tests that have several @Test methods used to (and some still are) create a new local cluster for every @Test method. At some point I moved a lot of tests to use the StreamingMultipleProgramsBase which reuses the cluster. We need to ensure that every test

Re: Tests - Unit Tests versus Integration Tests

2015-09-19 Thread Chiwan Park
I just created a JIRA issue [1]. Regards, Chiwan Park [1] https://issues.apache.org/jira/browse/FLINK-2712 > On Sep 20, 2015, at 1:33 AM, Chiwan Park wrote: > > Okay, I’ll create a JIRA issue and send a pull request for it. :) > > Regards, > Chiwan Park > >> On Sep 19, 2015, at 7:35 PM, Ufuk

[jira] [Created] (FLINK-2712) Add some description about tests to "How to Contribute" documentation

2015-09-19 Thread Chiwan Park (JIRA)
Chiwan Park created FLINK-2712: -- Summary: Add some description about tests to "How to Contribute" documentation Key: FLINK-2712 URL: https://issues.apache.org/jira/browse/FLINK-2712 Project: Flink

Re: Tests - Unit Tests versus Integration Tests

2015-09-19 Thread Chiwan Park
Okay, I’ll create a JIRA issue and send a pull request for it. :) Regards, Chiwan Park > On Sep 19, 2015, at 7:35 PM, Ufuk Celebi wrote: > > Thanks Stephan for pointing this out. I agree with you. +1 > > @Chiwan: Good idea with the Wiki. Actually maybe even better to add it to the > contribut

Tests in the streaming API

2015-09-19 Thread Stephan Ewen
Hi! I just saw that all tests in the streaming API are declared as Unit tests, even though the vast majority are integration tests (spawn mini clusters). That leads to problems, because the streaming test mini clusters do not properly clean up after themselves and unit tests reuse JVMs (for speed

[jira] [Created] (FLINK-2711) TaskManagerTest failure

2015-09-19 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2711: -- Summary: TaskManagerTest failure Key: FLINK-2711 URL: https://issues.apache.org/jira/browse/FLINK-2711 Project: Flink Issue Type: Bug Reporter: Sachi

[jira] [Created] (FLINK-2710) SocketTextStreamFunctionTest failure

2015-09-19 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2710: -- Summary: SocketTextStreamFunctionTest failure Key: FLINK-2710 URL: https://issues.apache.org/jira/browse/FLINK-2710 Project: Flink Issue Type: Bug Re

Re: On integrating Flink with Apache NiFi

2015-09-19 Thread Flavio Pompermaier
As a user that would be very helpful! On 19 Sep 2015 12:34, "Slim Baltagi" wrote: > Hi Flink experts! > > I came across Apache Nifi https://nifi.apache.org > https://www.youtube.com/watch?v=sQCgtCoZyFQ > In the Nifi project, there is an open JIRA > issue:https://issues.apache.org/jira/browse/NIFI

Re: Tests - Unit Tests versus Integration Tests

2015-09-19 Thread Ufuk Celebi
Thanks Stephan for pointing this out. I agree with you. +1 @Chiwan: Good idea with the Wiki. Actually maybe even better to add it to the contribution guide? Do you have time to open a PR with Stephan’s suggestions? @Martin: I agree that it does not suffice to just point this out as a new guidel

On integrating Flink with Apache NiFi

2015-09-19 Thread Slim Baltagi
Hi Flink experts! I came across Apache Nifi https://nifi.apache.org https://www.youtube.com/watch?v=sQCgtCoZyFQ In the Nifi project, there is an open JIRA issue:https://issues.apache.org/jira/browse/NIFI-823 to evaluate / provide integration with Apache Flink. Is the integration of Flink with Ni

Re: Tests - Unit Tests versus Integration Tests

2015-09-19 Thread Martin Liesenberg
Should there be a concerted effort to reduce the amount of unnecessary integration tests and cover those cases by unit tests? We could collect the cases in a ticket and work through the list one by one, no? Best regards, Martin Chiwan Park schrieb am Fr., 18. Sep. 2015 um 12:33 Uhr: > Hi Steph

Re: Some questions about storm metrics

2015-09-19 Thread huangwei (G)
Hi Matthias, Very sorry for the email in weekend. I try to add a wrapper(FlinkCountMetric) for the Storm-CountMetric and it's also easy to do it. But I get a trouble in `FlinkTopologyContext.registerMetric` method that I don't know how to use the `getRuntimeContext` in this class since I want to