[GitHub] flink pull request #2877: [FLINK-5141] Implement Flip6LocalStreamEnvironment...

2016-12-19 Thread ifndef-SleePy
Github user ifndef-SleePy closed the pull request at: https://github.com/apache/flink/pull/2877 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Commented] (FLINK-5141) Implement Flip6LocalStreamEnvironment to run new mini cluster in flip-6 branch

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15760609#comment-15760609 ] ASF GitHub Bot commented on FLINK-5141: --- Github user ifndef-SleePy closed the pull r

[jira] [Commented] (FLINK-5358) Support Row in TypeExtractor

2016-12-19 Thread Anton Solovev (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15760719#comment-15760719 ] Anton Solovev commented on FLINK-5358: -- Any ExecutionEnvironment exctracts type from

[jira] [Comment Edited] (FLINK-5358) Support Row in TypeExtractor

2016-12-19 Thread Anton Solovev (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15760719#comment-15760719 ] Anton Solovev edited comment on FLINK-5358 at 12/19/16 9:49 AM:

[jira] [Updated] (FLINK-5293) Make the Kafka consumer backwards compatible.

2016-12-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-5293: Issue Type: Sub-task (was: Bug) Parent: FLINK-5292 > Make the Kafka consumer backwa

[jira] [Comment Edited] (FLINK-5358) Support Row in TypeExtractor

2016-12-19 Thread Anton Solovev (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15760719#comment-15760719 ] Anton Solovev edited comment on FLINK-5358 at 12/19/16 10:39 AM: ---

[jira] [Comment Edited] (FLINK-5358) Support Row in TypeExtractor

2016-12-19 Thread Anton Solovev (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15760719#comment-15760719 ] Anton Solovev edited comment on FLINK-5358 at 12/19/16 10:39 AM: ---

[jira] [Comment Edited] (FLINK-5358) Support Row in TypeExtractor

2016-12-19 Thread Anton Solovev (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15760719#comment-15760719 ] Anton Solovev edited comment on FLINK-5358 at 12/19/16 10:40 AM: ---

[jira] [Comment Edited] (FLINK-5358) Support Row in TypeExtractor

2016-12-19 Thread Anton Solovev (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15760719#comment-15760719 ] Anton Solovev edited comment on FLINK-5358 at 12/19/16 10:41 AM: ---

[jira] [Comment Edited] (FLINK-5358) Support Row in TypeExtractor

2016-12-19 Thread Anton Solovev (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15760719#comment-15760719 ] Anton Solovev edited comment on FLINK-5358 at 12/19/16 10:41 AM: ---

[jira] [Created] (FLINK-5366) Add end-to-end tests for Savepoint Backwards Compatibility

2016-12-19 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-5366: --- Summary: Add end-to-end tests for Savepoint Backwards Compatibility Key: FLINK-5366 URL: https://issues.apache.org/jira/browse/FLINK-5366 Project: Flink

[jira] [Commented] (FLINK-2980) Add CUBE/ROLLUP/GROUPING SETS operator in Table API.

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15760838#comment-15760838 ] ASF GitHub Bot commented on FLINK-2980: --- GitHub user chermenin opened a pull request

[GitHub] flink issue #2940: [FLINK-5258] [docs] reorganize the docs to improve naviga...

2016-12-19 Thread fhueske
Github user fhueske commented on the issue: https://github.com/apache/flink/pull/2940 Hi @mindprince, thanks a lot for pointing out this issue. I had a look at the diffs and found that the following changes got lost or refactored: - c024b0b : `./docs//setup/fault-toleranc

[GitHub] flink pull request #3026: [FLINK-2980] [table] Support for GROUPING SETS cla...

2016-12-19 Thread chermenin
GitHub user chermenin opened a pull request: https://github.com/apache/flink/pull/3026 [FLINK-2980] [table] Support for GROUPING SETS clause in Table API. Support for operators GROUPING SETS / ROLLUP / CUBE in Table AP was added in this PR. Also added some tests for check execut

[jira] [Commented] (FLINK-5258) reorganize the docs to improve navigation and reduce duplication

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15760843#comment-15760843 ] ASF GitHub Bot commented on FLINK-5258: --- Github user fhueske commented on the issue:

[jira] [Comment Edited] (FLINK-5280) Extend TableSource to support nested data

2016-12-19 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15744952#comment-15744952 ] Fabian Hueske edited comment on FLINK-5280 at 12/19/16 11:05 AM: ---

[jira] [Comment Edited] (FLINK-5280) Extend TableSource to support nested data

2016-12-19 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15760985#comment-15760985 ] Fabian Hueske edited comment on FLINK-5280 at 12/19/16 11:58 AM: ---

[jira] [Commented] (FLINK-5280) Extend TableSource to support nested data

2016-12-19 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15760985#comment-15760985 ] Fabian Hueske commented on FLINK-5280: -- Sorry for my late response. I'll try to answe

[jira] [Commented] (FLINK-5358) Support Row in TypeExtractor

2016-12-19 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761003#comment-15761003 ] Fabian Hueske commented on FLINK-5358: -- Hi [~tonycox], I think we need to make the

[jira] [Updated] (FLINK-5358) Support RowTypeInfo extraction in TypeExtractor by Row instance

2016-12-19 Thread Anton Solovev (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Solovev updated FLINK-5358: - Summary: Support RowTypeInfo extraction in TypeExtractor by Row instance (was: Support Row in Typ

[jira] [Commented] (FLINK-5358) Support RowTypeInfo extraction in TypeExtractor by Row instance

2016-12-19 Thread Jark Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761026#comment-15761026 ] Jark Wu commented on FLINK-5358: If one of the fields is null, what is the {{TypeInformati

[jira] [Created] (FLINK-5367) restore updates lost when merging recent doc refactoring

2016-12-19 Thread David Anderson (JIRA)
David Anderson created FLINK-5367: - Summary: restore updates lost when merging recent doc refactoring Key: FLINK-5367 URL: https://issues.apache.org/jira/browse/FLINK-5367 Project: Flink Issu

[jira] [Commented] (FLINK-5358) Support RowTypeInfo extraction in TypeExtractor by Row instance

2016-12-19 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761069#comment-15761069 ] Fabian Hueske commented on FLINK-5358: -- Very good point [~jark], in that case the typ

[jira] [Commented] (FLINK-3150) Make YARN container invocation configurable

2016-12-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761074#comment-15761074 ] Robert Metzger commented on FLINK-3150: --- I ran into this issue again. I'll try to op

[jira] [Updated] (FLINK-3150) Make YARN container invocation configurable

2016-12-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-3150: -- Labels: qa (was: ) > Make YARN container invocation configurable >

[jira] [Commented] (FLINK-5342) Setting the parallelism automatically for operators base on cost model

2016-12-19 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761106#comment-15761106 ] Fabian Hueske commented on FLINK-5342: -- Yes, I think the {{TableConfig}} would be a g

[jira] [Commented] (FLINK-5258) reorganize the docs to improve navigation and reduce duplication

2016-12-19 Thread David Anderson (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761105#comment-15761105 ] David Anderson commented on FLINK-5258: --- Thanks for tracking down what got lost. I'l

[jira] [Commented] (FLINK-2821) Change Akka configuration to allow accessing actors from different URLs

2016-12-19 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761149#comment-15761149 ] Stephan Ewen commented on FLINK-2821: - I think most other endpoints are not affected b

[GitHub] flink pull request #3027: [FLINK-5358] add RowTypeInfo exctraction in TypeEx...

2016-12-19 Thread tonycox
GitHub user tonycox opened a pull request: https://github.com/apache/flink/pull/3027 [FLINK-5358] add RowTypeInfo exctraction in TypeExtractor Thanks for contributing to Apache Flink. Before you open your pull request, please take the following check list into consideration. If

[jira] [Commented] (FLINK-5358) Support RowTypeInfo extraction in TypeExtractor by Row instance

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761162#comment-15761162 ] ASF GitHub Bot commented on FLINK-5358: --- GitHub user tonycox opened a pull request:

[GitHub] flink issue #3014: [FLINK-4861] [build] Package optional project artifacts

2016-12-19 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/3014 Checking this out now... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wis

[jira] [Commented] (FLINK-4861) Package optional project artifacts

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761207#comment-15761207 ] ASF GitHub Bot commented on FLINK-4861: --- Github user StephanEwen commented on the is

[GitHub] flink issue #2767: [FLINK-4988] Elasticsearch 5.x support

2016-12-19 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/2767 @mikedias @rmetzger How do we proceed with this pull request? Should it become part of Flink, Bahir, or should hosted in the contributor's repository? --- If your project is set up for it, y

[jira] [Commented] (FLINK-4988) Elasticsearch 5.x support

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761242#comment-15761242 ] ASF GitHub Bot commented on FLINK-4988: --- Github user StephanEwen commented on the is

[jira] [Commented] (FLINK-5122) Elasticsearch Sink loses documents when cluster has high load

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761291#comment-15761291 ] ASF GitHub Bot commented on FLINK-5122: --- Github user rmetzger commented on the issue

[jira] [Commented] (FLINK-4861) Package optional project artifacts

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761294#comment-15761294 ] ASF GitHub Bot commented on FLINK-4861: --- Github user StephanEwen commented on the is

[jira] [Commented] (FLINK-4861) Package optional project artifacts

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761292#comment-15761292 ] ASF GitHub Bot commented on FLINK-4861: --- Github user StephanEwen commented on the is

[GitHub] flink issue #2861: [FLINK-5122] Index requests will be retried if the error ...

2016-12-19 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2861 I checked the elasticsearch documentation and some user forum from ES, and indeed it seems that they do not include any retry logic into their clients. --- If your project is set up for it, you can

[GitHub] flink issue #3014: [FLINK-4861] [build] Package optional project artifacts

2016-12-19 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/3014 I'll try to address that, then merge this pull request... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] flink issue #3014: [FLINK-4861] [build] Package optional project artifacts

2016-12-19 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/3014 Okay, the approach of this pull request looks good, but there are two things we need to adjust: - The fat jar from the `flink-ml` project contains all dependencies. I think that is bec

[jira] [Commented] (FLINK-5122) Elasticsearch Sink loses documents when cluster has high load

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761324#comment-15761324 ] ASF GitHub Bot commented on FLINK-5122: --- Github user rmetzger commented on a diff in

[GitHub] flink pull request #2861: [FLINK-5122] Index requests will be retried if the...

2016-12-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2861#discussion_r93043759 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch2/src/main/java/org/apache/flink/streaming/connectors/elasticsearch2/ElasticsearchSink.java --

[GitHub] flink pull request #2861: [FLINK-5122] Index requests will be retried if the...

2016-12-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2861#discussion_r93045771 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch2/src/main/java/org/apache/flink/streaming/connectors/elasticsearch2/ElasticsearchSink.java --

[jira] [Commented] (FLINK-5122) Elasticsearch Sink loses documents when cluster has high load

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761341#comment-15761341 ] ASF GitHub Bot commented on FLINK-5122: --- Github user rmetzger commented on a diff in

[GitHub] flink issue #2861: [FLINK-5122] Index requests will be retried if the error ...

2016-12-19 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2861 @fpompermaier Why is throwing exceptions in close causing document losses? As far as I can see ES is flushing all outstanding batches on close(). --- If your project is set up for it, you can reply

[jira] [Commented] (FLINK-5122) Elasticsearch Sink loses documents when cluster has high load

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761400#comment-15761400 ] ASF GitHub Bot commented on FLINK-5122: --- Github user rmetzger commented on the issue

[jira] [Created] (FLINK-5368) Let Kafka consumer show something when it fails to read one topic out of topic list

2016-12-19 Thread Sendoh (JIRA)
Sendoh created FLINK-5368: - Summary: Let Kafka consumer show something when it fails to read one topic out of topic list Key: FLINK-5368 URL: https://issues.apache.org/jira/browse/FLINK-5368 Project: Flink

[jira] [Updated] (FLINK-5368) Let Kafka consumer show something when it fails to read one topic out of topic list

2016-12-19 Thread Sendoh (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sendoh updated FLINK-5368: -- Description: As a developer when reading data from many topics, I want Kafka consumer to throw Exception or LOG

[jira] [Updated] (FLINK-5368) Let Kafka consumer show something when it fails to read one topic out of topic list

2016-12-19 Thread Sendoh (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sendoh updated FLINK-5368: -- Description: As a developer when reading data from many topics, I want Kafka consumer show something if any top

[jira] [Updated] (FLINK-5368) Let Kafka consumer show something when it fails to read one topic out of topic list

2016-12-19 Thread Sendoh (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sendoh updated FLINK-5368: -- Description: As a developer when reading data from many topics, I want Kafka consumer to show something if any

[jira] [Updated] (FLINK-5368) Let Kafka consumer show something when it fails to read one topic out of topic list

2016-12-19 Thread Sendoh (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sendoh updated FLINK-5368: -- Priority: Critical (was: Minor) > Let Kafka consumer show something when it fails to read one topic out of > t

[jira] [Updated] (FLINK-5368) Let Kafka consumer show something when it fails to read one topic out of topic list

2016-12-19 Thread Sendoh (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sendoh updated FLINK-5368: -- Description: As a developer when reading data from many topics, I want Kafka consumer to throw Exception or LOG

[GitHub] flink issue #3014: [FLINK-4861] [build] Package optional project artifacts

2016-12-19 Thread greghogan
Github user greghogan commented on the issue: https://github.com/apache/flink/pull/3014 Thanks @StephanEwen. FLINK-4782 may be related in the handling of provided dependencies (external, in that case). --- If your project is set up for it, you can reply to this email and have your re

[GitHub] flink issue #2861: [FLINK-5122] Index requests will be retried if the error ...

2016-12-19 Thread fpompermaier
Github user fpompermaier commented on the issue: https://github.com/apache/flink/pull/2861 @rmetzger Are you sure that Logstash doesn't perform any retry logic..? For example https://logstash.jira.com/browse/LOGSTASH-720 seems to implement that.. You can test document loss in the c

[jira] [Commented] (FLINK-5122) Elasticsearch Sink loses documents when cluster has high load

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761427#comment-15761427 ] ASF GitHub Bot commented on FLINK-5122: --- Github user fpompermaier commented on the i

[GitHub] flink pull request #2861: [FLINK-5122] Index requests will be retried if the...

2016-12-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2861#discussion_r93048695 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch2/src/main/java/org/apache/flink/streaming/connectors/elasticsearch2/ElasticsearchSink.java --

[GitHub] flink pull request #2861: [FLINK-5122] Index requests will be retried if the...

2016-12-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2861#discussion_r93049169 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch2/src/main/java/org/apache/flink/streaming/connectors/elasticsearch2/ElasticsearchSink.java --

[jira] [Commented] (FLINK-4861) Package optional project artifacts

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761425#comment-15761425 ] ASF GitHub Bot commented on FLINK-4861: --- Github user greghogan commented on the issu

[jira] [Commented] (FLINK-5122) Elasticsearch Sink loses documents when cluster has high load

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761430#comment-15761430 ] ASF GitHub Bot commented on FLINK-5122: --- Github user rmetzger commented on a diff in

[jira] [Commented] (FLINK-5122) Elasticsearch Sink loses documents when cluster has high load

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761429#comment-15761429 ] ASF GitHub Bot commented on FLINK-5122: --- Github user rmetzger commented on a diff in

[GitHub] flink issue #2861: [FLINK-5122] Index requests will be retried if the error ...

2016-12-19 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2861 @fpompermaier I guess logstash is just a client to ES that implement its own retry logic (similar to Flink). I'll check out the JIRA. --- If your project is set up for it, you can reply to this

[jira] [Commented] (FLINK-5353) Elasticsearch Sink loses well-formed documents when there are malformed documents

2016-12-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761442#comment-15761442 ] Robert Metzger commented on FLINK-5353: --- Do you have any information why ES is loosi

[jira] [Commented] (FLINK-5122) Elasticsearch Sink loses documents when cluster has high load

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761439#comment-15761439 ] ASF GitHub Bot commented on FLINK-5122: --- Github user rmetzger commented on the issue

[GitHub] flink pull request #2767: [FLINK-4988] Elasticsearch 5.x support

2016-12-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2767#discussion_r93052912 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch5/pom.xml --- @@ -0,0 +1,93 @@ + + +http://maven.apache.org/POM/4.0.0"; +

[GitHub] flink pull request #2767: [FLINK-4988] Elasticsearch 5.x support

2016-12-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2767#discussion_r93053073 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch5/pom.xml --- @@ -0,0 +1,93 @@ + + +http://maven.apache.org/POM/4.0.0"; +

[jira] [Commented] (FLINK-4988) Elasticsearch 5.x support

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761458#comment-15761458 ] ASF GitHub Bot commented on FLINK-4988: --- Github user rmetzger commented on a diff in

[GitHub] flink issue #2767: [FLINK-4988] Elasticsearch 5.x support

2016-12-19 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2767 @StephanEwen I'll start a discussion on the mailing list to decide how we want to proceed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[jira] [Commented] (FLINK-5367) restore updates lost when merging recent doc refactoring

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761466#comment-15761466 ] ASF GitHub Bot commented on FLINK-5367: --- GitHub user alpinegizmo opened a pull reque

[GitHub] flink pull request #3028: [FLINK-5367] Restore doc changes that were lost wh...

2016-12-19 Thread alpinegizmo
GitHub user alpinegizmo opened a pull request: https://github.com/apache/flink/pull/3028 [FLINK-5367] Restore doc changes that were lost when merging ... These doc updates were unfortunately lost when merging the recent documentation refactoring. This PR puts those missing edits whe

[jira] [Commented] (FLINK-5353) Elasticsearch Sink loses well-formed documents when there are malformed documents

2016-12-19 Thread Flavio Pompermaier (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761472#comment-15761472 ] Flavio Pompermaier commented on FLINK-5353: --- I just remember that in the afterBu

[jira] [Commented] (FLINK-4988) Elasticsearch 5.x support

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761459#comment-15761459 ] ASF GitHub Bot commented on FLINK-4988: --- Github user rmetzger commented on the issue

[jira] [Commented] (FLINK-5122) Elasticsearch Sink loses documents when cluster has high load

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761480#comment-15761480 ] ASF GitHub Bot commented on FLINK-5122: --- Github user fpompermaier commented on the i

[GitHub] flink issue #2861: [FLINK-5122] Index requests will be retried if the error ...

2016-12-19 Thread fpompermaier
Github user fpompermaier commented on the issue: https://github.com/apache/flink/pull/2861 Indeed my goal is to replace completely Logstash with Flink becuase Flink is much faster (Logstash is the official Elasticsearch indexer). On a 10 M docs Flink takes 10 min while Logstash 30 min

[jira] [Commented] (FLINK-4988) Elasticsearch 5.x support

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761456#comment-15761456 ] ASF GitHub Bot commented on FLINK-4988: --- Github user rmetzger commented on a diff in

[jira] [Commented] (FLINK-5353) Elasticsearch Sink loses well-formed documents when there are malformed documents

2016-12-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761537#comment-15761537 ] Robert Metzger commented on FLINK-5353: --- Okay, I will do some experiments to see wha

[jira] [Created] (FLINK-5369) jsr305 and logging dependencies should be 'provided' by default

2016-12-19 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-5369: --- Summary: jsr305 and logging dependencies should be 'provided' by default Key: FLINK-5369 URL: https://issues.apache.org/jira/browse/FLINK-5369 Project: Flink

[jira] [Commented] (FLINK-5256) Extend DataSetSingleRowJoin to support Left and Right joins

2016-12-19 Thread Anton Mushin (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761698#comment-15761698 ] Anton Mushin commented on FLINK-5256: - Hi [~fhueske], Where did you get the plan? i tr

[jira] [Commented] (FLINK-5256) Extend DataSetSingleRowJoin to support Left and Right joins

2016-12-19 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761740#comment-15761740 ] Fabian Hueske commented on FLINK-5256: -- Sure, the plan I got was the logical plan bef

[jira] [Comment Edited] (FLINK-5256) Extend DataSetSingleRowJoin to support Left and Right joins

2016-12-19 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761740#comment-15761740 ] Fabian Hueske edited comment on FLINK-5256 at 12/19/16 5:21 PM:

[GitHub] flink pull request #3029: [FLINK-5369] [build] Set jsr305 and logging depend...

2016-12-19 Thread StephanEwen
GitHub user StephanEwen opened a pull request: https://github.com/apache/flink/pull/3029 [FLINK-5369] [build] Set jsr305 and logging dependencies to 'provided' by default. Currently, every project in Flink has a hard (compile scope) dependency on the `jsr305`, `slf4j`, `log4j`, and

[jira] [Commented] (FLINK-5369) jsr305 and logging dependencies should be 'provided' by default

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761749#comment-15761749 ] ASF GitHub Bot commented on FLINK-5369: --- GitHub user StephanEwen opened a pull reque

[GitHub] flink issue #3014: [FLINK-4861] [build] Package optional project artifacts

2016-12-19 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/3014 Pull request #3029 is the prerequisite for this pull request to work nicely. Once that is merged, we can merge this one here as is. --- If your project is set up for it, you can reply to this em

[jira] [Commented] (FLINK-4861) Package optional project artifacts

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761753#comment-15761753 ] ASF GitHub Bot commented on FLINK-4861: --- Github user StephanEwen commented on the is

[jira] [Commented] (FLINK-4782) log4j & slf4j-log4j are present in jar-with-dependencies artifacts

2016-12-19 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761758#comment-15761758 ] Stephan Ewen commented on FLINK-4782: - This is subsumed by FLINK-5369 > log4j & slf4j

[GitHub] flink issue #2767: [FLINK-4988] Elasticsearch 5.x support

2016-12-19 Thread mikedias
Github user mikedias commented on the issue: https://github.com/apache/flink/pull/2767 I have no problem in hosting the connector in my github account. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[jira] [Commented] (FLINK-4988) Elasticsearch 5.x support

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761814#comment-15761814 ] ASF GitHub Bot commented on FLINK-4988: --- Github user mikedias commented on the issue

[jira] [Updated] (FLINK-5364) Rework JAAS configuration to support user-supplied entries

2016-12-19 Thread Eron Wright (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eron Wright updated FLINK-5364: Description: Recent issues (see linked) have brought to light a critical deficiency in the handling

[jira] [Updated] (FLINK-5364) Rework JAAS configuration to support user-supplied entries

2016-12-19 Thread Eron Wright (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eron Wright updated FLINK-5364: Description: Recent issues (see linked) have brought to light a critical deficiency in the handling

[jira] [Commented] (FLINK-5364) Rework JAAS configuration to support user-supplied entries

2016-12-19 Thread Eron Wright (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761960#comment-15761960 ] Eron Wright commented on FLINK-5364: - [~trohrm...@apache.org] [~mxm] Bringing this to

[jira] [Updated] (FLINK-5369) jsr305 and logging dependencies should be 'provided' by default

2016-12-19 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-5369: Description: Currently, every project in Flink has a hard (compile scope) dependency on the {{jsr30

[jira] [Closed] (FLINK-4782) log4j & slf4j-log4j are present in jar-with-dependencies artifacts

2016-12-19 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-4782. --- Resolution: Duplicate > log4j & slf4j-log4j are present in jar-with-dependencies artifacts > -

[jira] [Updated] (FLINK-5369) Rework jsr305 and logging dependencies

2016-12-19 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-5369: Summary: Rework jsr305 and logging dependencies (was: jsr305 and logging dependencies should be 'pr

[GitHub] flink issue #3014: [FLINK-4861] [build] Package optional project artifacts

2016-12-19 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/3014 Actually, just saw that `flink-gelly-scala` does not build a "jar-with-dependencies". Also, gelly and gelly-scala still have the ASM dependency (which seems not necessary any more). We s

[jira] [Commented] (FLINK-4861) Package optional project artifacts

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15762168#comment-15762168 ] ASF GitHub Bot commented on FLINK-4861: --- Github user StephanEwen commented on the is

[GitHub] flink issue #3014: [FLINK-4861] [build] Package optional project artifacts

2016-12-19 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/3014 I have an update with the mentioned changes. Will push that once #3029 gets approval. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as we

[jira] [Commented] (FLINK-4861) Package optional project artifacts

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15762227#comment-15762227 ] ASF GitHub Bot commented on FLINK-4861: --- Github user StephanEwen commented on the is

[GitHub] flink issue #3029: [FLINK-5369] [build] Rework jsr305 and logging dependenci...

2016-12-19 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/3029 I think this is a quite crucial change for 1.2, because dependency structure cannot be changed in minor releases. @rmetzger to your attention --- If your project is set up for it, you c

[jira] [Commented] (FLINK-5369) Rework jsr305 and logging dependencies

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15762228#comment-15762228 ] ASF GitHub Bot commented on FLINK-5369: --- Github user StephanEwen commented on the is

[GitHub] flink pull request #3030: Updated version of #3014

2016-12-19 Thread StephanEwen
GitHub user StephanEwen opened a pull request: https://github.com/apache/flink/pull/3030 Updated version of #3014 Updated version of #3014 You can merge this pull request into a Git repository by running: $ git pull https://github.com/StephanEwen/incubator-flink greg Alternati

[GitHub] flink pull request #3027: [FLINK-5358] add RowTypeInfo exctraction in TypeEx...

2016-12-19 Thread wuchong
Github user wuchong commented on a diff in the pull request: https://github.com/apache/flink/pull/3027#discussion_r93159264 --- Diff: flink-core/src/test/java/org/apache/flink/api/java/typeutils/TypeExtractorTest.java --- @@ -345,8 +346,22 @@ public CustomType cross(CustomType fir

  1   2   >