[jira] [Created] (FLINK-2633) OptionTypeInfo does not have proper equals and hashCode method

2015-09-07 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-2633: Summary: OptionTypeInfo does not have proper equals and hashCode method Key: FLINK-2633 URL: https://issues.apache.org/jira/browse/FLINK-2633 Project: Flink

Volunteers needed for Flink Forward 2015 (and they get a free ticket)

2015-09-07 Thread Kostas Tzoumas
Hi folks, The Flink Forward 2015 organizers are looking for volunteers (and they are offering free tickets in exchange). Sign up here if you are interested (or send me an email): http://flink-forward.org/?page_id=495 Best, Kostas

[jira] [Created] (FLINK-2632) Web Client does not respect the class loader of submitted jobs

2015-09-07 Thread Maximilian Michels (JIRA)
Maximilian Michels created FLINK-2632: - Summary: Web Client does not respect the class loader of submitted jobs Key: FLINK-2632 URL: https://issues.apache.org/jira/browse/FLINK-2632 Project: Flink

[jira] [Created] (FLINK-2631) StreamFold operator does not respect returns type and stores non serializable values

2015-09-07 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-2631: Summary: StreamFold operator does not respect returns type and stores non serializable values Key: FLINK-2631 URL: https://issues.apache.org/jira/browse/FLINK-2631 Pr

[jira] [Created] (FLINK-2630) Scala DataStream API does not have a project method

2015-09-07 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-2630: Summary: Scala DataStream API does not have a project method Key: FLINK-2630 URL: https://issues.apache.org/jira/browse/FLINK-2630 Project: Flink Issue Type:

[jira] [Created] (FLINK-2629) Refactor YARN ApplicationMasterActor to use the async AM<-->RM client

2015-09-07 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-2629: - Summary: Refactor YARN ApplicationMasterActor to use the async AM<-->RM client Key: FLINK-2629 URL: https://issues.apache.org/jira/browse/FLINK-2629 Project: Flink

Re: Some questions about storm metrics

2015-09-07 Thread Matthias J. Sax
I personally never used Metrics in Storm. It would be best, if you design an own example. I guess you are familiar with https://storm.apache.org/documentation/Metrics.html As a first step, I would try to include the predefined Storm metric and work on custom metrics later. As the Storm documentat

Re: Failing Test: KafkaITCase and KafkaProducerITCase

2015-09-07 Thread Stephan Ewen
I have a patch pending that should help with these timeout issues (and null checks)... On Mon, Sep 7, 2015 at 2:41 PM, Matthias J. Sax wrote: > Please lock here: > > https://travis-ci.org/apache/flink/jobs/79086396 > > > Failed tests: > > KafkaITCase>KafkaTestBase.prepare:155 Test setup failed:

Re: Configuring UDFs with user defined parameters

2015-09-07 Thread Stephan Ewen
The JobConfig is a system level config. Would be nice to not expose them to the user-level unless necessary. What about using the ExecutionConfig, where you can add shared user-level parameters? On Mon, Sep 7, 2015 at 1:39 PM, Matthias J. Sax wrote: > Thanks for the input. > > However, I doubt

Re: Some questions about storm metrics

2015-09-07 Thread huangwei (G)
Hi Kostas, Thanks for your support! I created the JIRA and pushed a PR for it. @Matthias Could you give me a storm example in using the cust metrics? Since it is needed for follow-up development. Many thanks! Greetings, Huang Wei = Sounds great. It is easy t

Failing Test: KafkaITCase and KafkaProducerITCase

2015-09-07 Thread Matthias J. Sax
Please lock here: https://travis-ci.org/apache/flink/jobs/79086396 > Failed tests: > KafkaITCase>KafkaTestBase.prepare:155 Test setup failed: Unable to connect to > zookeeper server within timeout: 6000 > KafkaProducerITCase>KafkaTestBase.prepare:155 Test setup failed: Unable to > connect to zo

Re: Configuring UDFs with user defined parameters

2015-09-07 Thread Matthias J. Sax
Thanks for the input. However, I doubt that a member variable approach is feasible, because when the Storm topology is translated into a Flink program (in `FlinkBuilder.createTopology()`) the Storm configuration is not available yet. And adding the configuration later to each operator would be cum

Re: Need help with CI problem

2015-09-07 Thread huangwei (G)
Hi Robert, Thank you for the information! Maybe I can try some circumvention tools at home. = From this comment it seems that the Travis CDN is blocked from China: https://github.com/apache/flink/pull/1046#issuecomment-134198533 On

Re: ClassNotFoundException : org.apache.flink.api.common.operators.util.UserCodeObjectWrapper, while trying to run locally

2015-09-07 Thread Stephan Ewen
Effectively, the method with the blob-classloader / parent classloader is exactly intended to do that: Start with the app class path and add some jars in addition, if you need to. On Mon, Sep 7, 2015 at 1:05 PM, Stephan Ewen wrote: > The BlobClassloader uses the App classloader as the parent. Th

Re: ClassNotFoundException : org.apache.flink.api.common.operators.util.UserCodeObjectWrapper, while trying to run locally

2015-09-07 Thread Stephan Ewen
The BlobClassloader uses the App classloader as the parent. That should make the classloading go first to the app classpath (TaskManager's classpath) and then to the user-defined code. Is that broken somehow? On Sun, Sep 6, 2015 at 1:40 PM, gkrastev wrote: > Hi,I'm facing the exact same issue

Re: 答复: Need help with CI problem

2015-09-07 Thread Robert Metzger
>From this comment it seems that the Travis CDN is blocked from China: https://github.com/apache/flink/pull/1046#issuecomment-134198533 On Wed, Aug 5, 2015 at 12:14 PM, Stephan Ewen wrote: > That is interesting, never seen that before. > > Travis support would be best, I guess. > > On Wed, Aug 5

[jira] [Created] (FLINK-2628) Failing Test: StreamFaultToleranceTestBase.runCheckpointedProgram

2015-09-07 Thread Martin Liesenberg (JIRA)
Martin Liesenberg created FLINK-2628: Summary: Failing Test: StreamFaultToleranceTestBase.runCheckpointedProgram Key: FLINK-2628 URL: https://issues.apache.org/jira/browse/FLINK-2628 Project: Flin

Re: Interested in implementing Machine learning Libraries as my undergraduate final project

2015-09-07 Thread Till Rohrmann
Hi Devang, great to hear that you want to contribute to Flink. The best thing to do first is to familiarise yourself with the system. Thus, going through the documentation [1] and trying to implement a first Flink job would be a good start. Next, you should read the contribution guide [2] and pick

[jira] [Created] (FLINK-2627) Make Scala Data Set utils easier to access

2015-09-07 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2627: -- Summary: Make Scala Data Set utils easier to access Key: FLINK-2627 URL: https://issues.apache.org/jira/browse/FLINK-2627 Project: Flink Issue Type: Bug

Re: Scala Utils

2015-09-07 Thread Sachin Goel
Olrite. I will file a JIRA for this. Cheers! Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Sat, Sep 5, 2015 at 10:14 PM, Aljoscha Krettek wrote: > I think the utils are a perfect case of for this pattern so I would suggest > to go ahead with this change. It is only abo