[jira] [Created] (FLINK-3211) Add AWS Kinesis streaming connector

2016-01-08 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-3211: -- Summary: Add AWS Kinesis streaming connector Key: FLINK-3211 URL: https://issues.apache.org/jira/browse/FLINK-3211 Project: Flink Issue Type: New

[jira] [Commented] (FLINK-1994) Add different gain calculation schemes to SGD

2016-01-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090429#comment-15090429 ] ASF GitHub Bot commented on FLINK-1994: --- Github user chiwanpark commented on the pul

[GitHub] flink pull request: [FLINK-1994] [ml] Add different gain calculati...

2016-01-08 Thread chiwanpark
Github user chiwanpark commented on the pull request: https://github.com/apache/flink/pull/1397#issuecomment-170200015 Hi @rawkintrevo, you can convert scala Enum to Int like following: ```scala object Parameter extends Enumeration { type Parameter = Value val P

[jira] [Commented] (FLINK-1994) Add different gain calculation schemes to SGD

2016-01-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090246#comment-15090246 ] ASF GitHub Bot commented on FLINK-1994: --- Github user rawkintrevo commented on the pu

[GitHub] flink pull request: [FLINK-1994] [ml] Add different gain calculati...

2016-01-08 Thread rawkintrevo
Github user rawkintrevo commented on the pull request: https://github.com/apache/flink/pull/1397#issuecomment-170162685 on your second point- I agree that Enum would be better for human readable variable setting, but if one was doing a grid parameter search it would be easier to searc

[jira] [Updated] (FLINK-2765) Upgrade hbase version for hadoop-2 to 1.1 release

2016-01-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated FLINK-2765: -- Description: Currently 0.98.11 is used: {code} 0.98.11-hadoop2 {code} Stable release for hadoop-

[jira] [Commented] (FLINK-3058) Add Kafka consumer for new 0.9.0.0 Kafka API

2016-01-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089798#comment-15089798 ] ASF GitHub Bot commented on FLINK-3058: --- Github user rmetzger commented on the pull

[GitHub] flink pull request: [FLINK-3058] Add support for Kafka 0.9.0.0

2016-01-08 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1489#issuecomment-170103132 There are some build instabilities with the new Kafka 0.9 code. I'll look into it soon. --- If your project is set up for it, you can reply to this email and have your

[jira] [Commented] (FLINK-1870) Reintroduce Indexed reader functionality to streaming

2016-01-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089649#comment-15089649 ] ASF GitHub Bot commented on FLINK-1870: --- Github user StephanEwen commented on the pu

[GitHub] flink pull request: [FLINK-1870] Reintroduce indexed reader functi...

2016-01-08 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/1483#issuecomment-170083592 I am big time skeptic when it comes to putting this into the `RuntimeContext`. If we really need to expose that beyond the `StreamInputProcessor`, it would

[jira] [Commented] (FLINK-1870) Reintroduce Indexed reader functionality to streaming

2016-01-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089600#comment-15089600 ] ASF GitHub Bot commented on FLINK-1870: --- Github user mjsax commented on the pull req

[GitHub] flink pull request: [FLINK-1870] Reintroduce indexed reader functi...

2016-01-08 Thread mjsax
Github user mjsax commented on the pull request: https://github.com/apache/flink/pull/1483#issuecomment-170073172 If you implement a Bolt you can retrieve this information from Storm. Thus, the compatibility layer should provide this information, too. --- If your project is set up fo

[jira] [Commented] (FLINK-3210) Unnecessary call to deserializer#deserialize() in LegacyFetcher#SimpleConsumerThread#run()

2016-01-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089572#comment-15089572 ] Ted Yu commented on FLINK-3210: --- bq. The key can still contain something I agree. But why d

[jira] [Commented] (FLINK-3210) Unnecessary call to deserializer#deserialize() in LegacyFetcher#SimpleConsumerThread#run()

2016-01-08 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089566#comment-15089566 ] Robert Metzger commented on FLINK-3210: --- I think this issue is invalid. A null value

[jira] [Created] (FLINK-3210) Unnecessary call to deserializer#deserialize() in LegacyFetcher#SimpleConsumerThread#run()

2016-01-08 Thread Ted Yu (JIRA)
Ted Yu created FLINK-3210: - Summary: Unnecessary call to deserializer#deserialize() in LegacyFetcher#SimpleConsumerThread#run() Key: FLINK-3210 URL: https://issues.apache.org/jira/browse/FLINK-3210 Project: F

[jira] [Commented] (FLINK-1994) Add different gain calculation schemes to SGD

2016-01-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089529#comment-15089529 ] ASF GitHub Bot commented on FLINK-1994: --- Github user tillrohrmann commented on a dif

[GitHub] flink pull request: [FLINK-1994] [ml] Add different gain calculati...

2016-01-08 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1397#discussion_r49211433 --- Diff: flink-staging/flink-ml/src/main/scala/org/apache/flink/ml/optimization/GradientDescent.scala --- @@ -54,14 +54,15 @@ abstract class GradientDe

[jira] [Commented] (FLINK-1737) Add statistical whitening transformation to machine learning library

2016-01-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089525#comment-15089525 ] ASF GitHub Bot commented on FLINK-1737: --- Github user asfgit closed the pull request

[GitHub] flink pull request: FLINK-1737: Kronecker product

2016-01-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/1078 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (FLINK-1737) Add statistical whitening transformation to machine learning library

2016-01-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089481#comment-15089481 ] ASF GitHub Bot commented on FLINK-1737: --- Github user tillrohrmann commented on the p

[GitHub] flink pull request: FLINK-1737: Kronecker product

2016-01-08 Thread tillrohrmann
Github user tillrohrmann commented on the pull request: https://github.com/apache/flink/pull/1078#issuecomment-170050950 Looks really good :-) Thanks for your contribution @daniel-pape. Will merge it. --- If your project is set up for it, you can reply to this email and have your rep

[jira] [Commented] (FLINK-3058) Add Kafka consumer for new 0.9.0.0 Kafka API

2016-01-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089436#comment-15089436 ] ASF GitHub Bot commented on FLINK-3058: --- Github user tillrohrmann commented on the p

[GitHub] flink pull request: [FLINK-3058] Add support for Kafka 0.9.0.0

2016-01-08 Thread tillrohrmann
Github user tillrohrmann commented on the pull request: https://github.com/apache/flink/pull/1489#issuecomment-170044651 Test cases `Kafka09ITCase.testMultipleSourcesOnePartition` and `Kafka08ITCase.testOffsetInZookeeper` are failing in Travis build. --- If your project is set up for

[jira] [Commented] (FLINK-1870) Reintroduce Indexed reader functionality to streaming

2016-01-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089432#comment-15089432 ] ASF GitHub Bot commented on FLINK-1870: --- Github user StephanEwen commented on the pu

[GitHub] flink pull request: [FLINK-1870] Reintroduce indexed reader functi...

2016-01-08 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/1483#issuecomment-170044112 The user code should not deal with what channel an element came from. It wires assumptions about the parallelism of the predecessor into the user code. Adjustments o

[jira] [Commented] (FLINK-3197) InputStream not closed in BinaryInputFormat#createStatistics

2016-01-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089430#comment-15089430 ] ASF GitHub Bot commented on FLINK-3197: --- Github user tillrohrmann commented on a dif

[GitHub] flink pull request: FLINK-3197: InputStream not closed in BinaryIn...

2016-01-08 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1494#discussion_r49205022 --- Diff: flink-core/src/main/java/org/apache/flink/api/common/io/BinaryInputFormat.java --- @@ -213,9 +213,10 @@ protected SequentialStatistics create

[jira] [Commented] (FLINK-2125) String delimiter for SocketTextStream

2016-01-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089428#comment-15089428 ] ASF GitHub Bot commented on FLINK-2125: --- Github user tillrohrmann commented on the p

[GitHub] flink pull request: [FLINK-2125][streaming] Delimiter change from ...

2016-01-08 Thread tillrohrmann
Github user tillrohrmann commented on the pull request: https://github.com/apache/flink/pull/1491#issuecomment-170043300 Thanks for your contribution @ajaybhat. The PR contains many whitespace changes. Would be good to avoid them. I had a question concerning the implem

[jira] [Commented] (FLINK-2125) String delimiter for SocketTextStream

2016-01-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089426#comment-15089426 ] ASF GitHub Bot commented on FLINK-2125: --- Github user tillrohrmann commented on a dif

[GitHub] flink pull request: [FLINK-2125][streaming] Delimiter change from ...

2016-01-08 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1491#discussion_r49204456 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/source/SocketTextStreamFunction.java --- @@ -84,25 +84,25 @@ publi

[jira] [Commented] (FLINK-3189) Error while parsing job arguments passed by CLI

2016-01-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089368#comment-15089368 ] ASF GitHub Bot commented on FLINK-3189: --- Github user mjsax commented on the pull req

[GitHub] flink pull request: [FLINK-3189] Error while parsing job arguments...

2016-01-08 Thread mjsax
Github user mjsax commented on the pull request: https://github.com/apache/flink/pull/1493#issuecomment-170035218 Sure. Will do that. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[jira] [Commented] (FLINK-1712) Restructure Maven Projects

2016-01-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089354#comment-15089354 ] ASF GitHub Bot commented on FLINK-1712: --- Github user StephanEwen commented on the pu

[GitHub] flink pull request: [FLINK-1712] Remove "flink-staging" module

2016-01-08 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/1492#issuecomment-170033507 Can you summarize what the changes from this pull request are? The set of changes is too large for github to display. --- If your project is set up for it, you can

[GitHub] flink pull request: [FLINK-3189] Error while parsing job arguments...

2016-01-08 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/1493#issuecomment-170032469 Can you add a test case that guards this change? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If y

[jira] [Commented] (FLINK-3189) Error while parsing job arguments passed by CLI

2016-01-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089344#comment-15089344 ] ASF GitHub Bot commented on FLINK-3189: --- Github user StephanEwen commented on the pu

[GitHub] flink pull request: FLINK-3197: InputStream not closed in BinaryIn...

2016-01-08 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/1494#discussion_r49199370 --- Diff: flink-core/src/main/java/org/apache/flink/api/common/io/BinaryInputFormat.java --- @@ -213,9 +213,10 @@ protected SequentialStatistics createS

[jira] [Commented] (FLINK-3197) InputStream not closed in BinaryInputFormat#createStatistics

2016-01-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089343#comment-15089343 ] ASF GitHub Bot commented on FLINK-3197: --- Github user StephanEwen commented on a diff

[jira] [Commented] (FLINK-3192) Add explain support to print ast and sql physical execution plan.

2016-01-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089155#comment-15089155 ] ASF GitHub Bot commented on FLINK-3192: --- Github user fhueske commented on the pull r

[GitHub] flink pull request: [FLINK-3192] Add explain support to print ast ...

2016-01-08 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/pull/1477#issuecomment-169987537 I added two small comments in-line. But there is another thing that came to my mind. A `Table` can be constructed from any type of `DataSet` not just a `DataSource`.

[jira] [Commented] (FLINK-3192) Add explain support to print ast and sql physical execution plan.

2016-01-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089138#comment-15089138 ] ASF GitHub Bot commented on FLINK-3192: --- Github user fhueske commented on a diff in

[GitHub] flink pull request: [FLINK-3192] Add explain support to print ast ...

2016-01-08 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/1477#discussion_r49183864 --- Diff: flink-staging/flink-table/src/main/scala/org/apache/flink/api/table/explain/PlanJsonParser.java --- @@ -0,0 +1,148 @@ +/* + * Licensed to t

[GitHub] flink pull request: [FLINK-3192] Add explain support to print ast ...

2016-01-08 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/1477#discussion_r49183832 --- Diff: flink-staging/flink-table/src/main/scala/org/apache/flink/api/table/explain/PlanJsonParser.java --- @@ -0,0 +1,148 @@ +/* + * Licensed to t

[jira] [Commented] (FLINK-3192) Add explain support to print ast and sql physical execution plan.

2016-01-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089141#comment-15089141 ] ASF GitHub Bot commented on FLINK-3192: --- Github user fhueske commented on a diff in

[jira] [Commented] (FLINK-3192) Add explain support to print ast and sql physical execution plan.

2016-01-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089075#comment-15089075 ] ASF GitHub Bot commented on FLINK-3192: --- Github user gallenvara commented on the pul

[GitHub] flink pull request: [FLINK-3192] Add explain support to print ast ...

2016-01-08 Thread gallenvara
Github user gallenvara commented on the pull request: https://github.com/apache/flink/pull/1477#issuecomment-169967055 @ChengXiangLi @fhueske @rmetzger , thanks a lot for your suggestions. The codes have been modified. --- If your project is set up for it, you can reply to this emai

[jira] [Commented] (FLINK-3197) InputStream not closed in BinaryInputFormat#createStatistics

2016-01-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15088905#comment-15088905 ] ASF GitHub Bot commented on FLINK-3197: --- Github user ramkrish86 commented on a diff

[GitHub] flink pull request: FLINK-3197: InputStream not closed in BinaryIn...

2016-01-08 Thread ramkrish86
Github user ramkrish86 commented on a diff in the pull request: https://github.com/apache/flink/pull/1494#discussion_r49168115 --- Diff: flink-core/src/main/java/org/apache/flink/api/common/io/BinaryInputFormat.java --- @@ -213,9 +213,10 @@ protected SequentialStatistics createSt