Re: Flink 1.0.0 Release Candidate 0: Please help testing

2016-02-18 Thread Robert Metzger
So far, I found the following issues: - https://issues.apache.org/jira/browse/FLINK-3400 - https://issues.apache.org/jira/browse/FLINK-3446 - https://issues.apache.org/jira/browse/FLINK-3439 - https://issues.apache.org/jira/browse/FLINK-3439 - https://issues.apache.org/jira/browse/FLINK-3418 - htt

[jira] [Created] (FLINK-3447) Package Gelly algorithms by framework

2016-02-18 Thread Greg Hogan (JIRA)
Greg Hogan created FLINK-3447: - Summary: Package Gelly algorithms by framework Key: FLINK-3447 URL: https://issues.apache.org/jira/browse/FLINK-3447 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-3446) Back pressure tracker throws NPE for archived jobs

2016-02-18 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-3446: -- Summary: Back pressure tracker throws NPE for archived jobs Key: FLINK-3446 URL: https://issues.apache.org/jira/browse/FLINK-3446 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-3445) make JDBCInputFormat implement ResultTypeQueryable

2016-02-18 Thread Ken Geis (JIRA)
Ken Geis created FLINK-3445: --- Summary: make JDBCInputFormat implement ResultTypeQueryable Key: FLINK-3445 URL: https://issues.apache.org/jira/browse/FLINK-3445 Project: Flink Issue Type: Improvemen

[jira] [Created] (FLINK-3444) env.fromElements relies on the first input element for determining the DataSet/DataStream type

2016-02-18 Thread Vasia Kalavri (JIRA)
Vasia Kalavri created FLINK-3444: Summary: env.fromElements relies on the first input element for determining the DataSet/DataStream type Key: FLINK-3444 URL: https://issues.apache.org/jira/browse/FLINK-3444

Re: Dense matricies in FlinkML

2016-02-18 Thread Márton Balassi
Hi guys, They are at least already registered for serialization [1], so there should be no intentional conflict as Theo has suggested. [1] https://github.com/apache/flink/blob/master/flink-libraries/flink-ml/src/main/scala/org/apache/flink/ml/common/FlinkMLTools.scala#L67-L73 Best, Marton On T

Re: Dense matricies in FlinkML

2016-02-18 Thread Theodore Vasiloudis
Hello Trevor, IIRC it was mostly that they weren't needed at the time. Feel free to add, along with BLAS ops. Cheers, Theo On Thu, Feb 18, 2016 at 5:14 PM, Trevor Grant wrote: > Is there a specific reason vectors are imported from Breeze and matrices > aren't? > > Specifically I need to take t

Re: Guarantees for object reuse modes and documentation

2016-02-18 Thread Greg Hogan
Hi Fabian, I would only add to your citations Stephan's comment [1] concerning the design, implementation, and use of object reuse. I see two separate concerns addressed in code. First, as Stephan noted, for certain classes deserialization is sufficiently expensive relative to object creation and

[jira] [Created] (FLINK-3443) JobManager cancel and clear everything fails jobs instead of cancelling

2016-02-18 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-3443: -- Summary: JobManager cancel and clear everything fails jobs instead of cancelling Key: FLINK-3443 URL: https://issues.apache.org/jira/browse/FLINK-3443 Project: Flink

[jira] [Created] (FLINK-3442) Expose savepoint button on web ui

2016-02-18 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-3442: - Summary: Expose savepoint button on web ui Key: FLINK-3442 URL: https://issues.apache.org/jira/browse/FLINK-3442 Project: Flink Issue Type: Improvement C

Re: Extending and improving our "How to contribute" page

2016-02-18 Thread Maximilian Michels
Hi Martin, Sounds like a good idea to me to create a checklist like this. It would be a nice reminder for people who didn't read the how-to-contribute section of the README :) Cheers, Max On Thu, Feb 18, 2016 at 9:31 AM, Martin Liesenberg wrote: > Hi, > > GitHub just introduced a way to supply

Dense matricies in FlinkML

2016-02-18 Thread Trevor Grant
Is there a specific reason vectors are imported from Breeze and matrices aren't? Specifically I need to take the dot product of a matrix and a vector and a matrix and a matrix. Was wondering if there is a theoretical reason or it just wasn't needed at the time. Looks like some of this got lifted

[jira] [Created] (FLINK-3441) Revisit quickstarts exclusion policy

2016-02-18 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-3441: Summary: Revisit quickstarts exclusion policy Key: FLINK-3441 URL: https://issues.apache.org/jira/browse/FLINK-3441 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-3440) Kafka should also checkpoint partitions where no initial offset was retrieved

2016-02-18 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-3440: --- Summary: Kafka should also checkpoint partitions where no initial offset was retrieved Key: FLINK-3440 URL: https://issues.apache.org/jira/browse/FLINK-3440 Project: Fl

[jira] [Created] (FLINK-3439) Remove final Long.MAX_VALUE Watermark in StreamSource

2016-02-18 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-3439: --- Summary: Remove final Long.MAX_VALUE Watermark in StreamSource Key: FLINK-3439 URL: https://issues.apache.org/jira/browse/FLINK-3439 Project: Flink Iss

Re: Guarantees for object reuse modes and documentation

2016-02-18 Thread Till Rohrmann
Judging from our chaining condition ds.getPushChainDriverClass() != null && !(pred instanceof NAryUnionPlanNode) &&// first op after union is stand-alone, because union is merged !(pred instanceof BulkPartialSolutionPlanNode) &&// partial solution merges anyways !(pred instanceof WorksetPl

Re: Guarantees for object reuse modes and documentation

2016-02-18 Thread Fabian Hueske
Thanks Matthias. Maybe I should clarify, that I do not want to change the guarantees for the enableObjectReuse mode, but for the disableObjectReuse mode. The rules for the enableObjectReuse mode should remain the same. 2016-02-18 9:37 GMT+01:00 Matthias J. Sax : > Hi, > > I like Fabian's proposa

Re: Guarantees for object reuse modes and documentation

2016-02-18 Thread Matthias J. Sax
Hi, I like Fabian's proposal. The idea of object reuse is performance gain, and we should not sacrifice this. Even more important is that the rules are easy to understand! -Matthias On 02/17/2016 06:17 PM, Fabian Hueske wrote: > Hi, > > > > Flink's DataSet API features a configuration parame

Re: Extending and improving our "How to contribute" page

2016-02-18 Thread Martin Liesenberg
Hi, GitHub just introduced a way to supply PR templates. [1] To support the changes discussed here, we could add a simple template with check boxes like: [ ] did you add tests [ ] did you check against the coding guidelines [ ] is there a jira supporting the PR Let me know what you think. The la

Re: Hi all

2016-02-18 Thread Maximilian Michels
Welcome to the Flink community, Josep! While reading the documentation, if anything catches your eye, feel free to correct or make an addition via a pull request. That's a great way to contribute. Cheers, Max On Wed, Feb 17, 2016 at 8:29 PM, Jamie Grier wrote: > Welcome, Josep! > > On Wed, Feb