[jira] [Commented] (FLINK-9676) Deadlock during canceling task and recycling exclusive buffer

2018-07-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533317#comment-16533317 ] ASF GitHub Bot commented on FLINK-9676: --- Github user zhijiangW commented on a diff

[jira] [Commented] (FLINK-9676) Deadlock during canceling task and recycling exclusive buffer

2018-07-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533316#comment-16533316 ] ASF GitHub Bot commented on FLINK-9676: --- Github user zhijiangW commented on a diff

[GitHub] flink pull request #6254: [FLINK-9676][network] clarify contracts of BufferL...

2018-07-04 Thread zhijiangW
Github user zhijiangW commented on a diff in the pull request: https://github.com/apache/flink/pull/6254#discussion_r200245464 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/consumer/RemoteInputChannel.java --- @@ -594,22 +626,22 @@ public Stri

[GitHub] flink pull request #6254: [FLINK-9676][network] clarify contracts of BufferL...

2018-07-04 Thread zhijiangW
Github user zhijiangW commented on a diff in the pull request: https://github.com/apache/flink/pull/6254#discussion_r200247127 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/consumer/RemoteInputChannel.java --- @@ -479,6 +508,9 @@ void onSender

[jira] [Updated] (FLINK-9757) Typos found in docs after hunspell run

2018-07-04 Thread Sergey Nuyanzin (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin updated FLINK-9757: --- Description: After [hunspell|http://hunspell.github.io/] run the next typos found ||File|| De

[jira] [Updated] (FLINK-9757) Typos found in docs after hunspell run

2018-07-04 Thread Sergey Nuyanzin (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin updated FLINK-9757: --- Affects Version/s: 1.6.0 1.5.0 1.4.2 > Typos fo

[jira] [Assigned] (FLINK-9743) PackagedProgram.extractContainedLibraries fails on Windows

2018-07-04 Thread Sergey Nuyanzin (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin reassigned FLINK-9743: -- Assignee: Sergey Nuyanzin > PackagedProgram.extractContainedLibraries fails on Windows

[jira] [Assigned] (FLINK-4582) Allow FlinkKinesisConsumer to adapt for AWS DynamoDB Streams

2018-07-04 Thread Mingdao Yang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingdao Yang reassigned FLINK-4582: --- Assignee: (was: Mingdao Yang) > Allow FlinkKinesisConsumer to adapt for AWS DynamoDB Str

[jira] [Updated] (FLINK-9758) ContinuousFileProcessingTest failed due to not setting runtimeContext

2018-07-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-9758: -- Labels: pull-request-available (was: ) > ContinuousFileProcessingTest failed due to not settin

[jira] [Commented] (FLINK-9758) ContinuousFileProcessingTest failed due to not setting runtimeContext

2018-07-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533255#comment-16533255 ] ASF GitHub Bot commented on FLINK-9758: --- GitHub user Myasuka opened a pull request:

[GitHub] flink pull request #6260: [FLINK-9758] Fix ContinuousFileProcessingTest fail...

2018-07-04 Thread Myasuka
GitHub user Myasuka opened a pull request: https://github.com/apache/flink/pull/6260 [FLINK-9758] Fix ContinuousFileProcessingTest failure due to not setting runtimeContext ## What is the purpose of the change Fix ContinuousFileProcessingTest failue due to not setting runti

[jira] [Created] (FLINK-9758) ContinuousFileProcessingTest failed due to not setting runtimeContext

2018-07-04 Thread Yun Tang (JIRA)
Yun Tang created FLINK-9758: --- Summary: ContinuousFileProcessingTest failed due to not setting runtimeContext Key: FLINK-9758 URL: https://issues.apache.org/jira/browse/FLINK-9758 Project: Flink Is

[jira] [Commented] (FLINK-9543) Expose JobMaster IDs to metric system

2018-07-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533215#comment-16533215 ] ASF GitHub Bot commented on FLINK-9543: --- Github user lamber-ken commented on the is

[GitHub] flink issue #6195: [FLINK-9543][METRICS] Expose JobMaster ID to metric syste...

2018-07-04 Thread lamber-ken
Github user lamber-ken commented on the issue: https://github.com/apache/flink/pull/6195 @zentol, ok ---

[jira] [Updated] (FLINK-9675) Avoid FileInputStream/FileOutputStream

2018-07-04 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated FLINK-9675: -- Labels: filesystem (was: ) > Avoid FileInputStream/FileOutputStream > -- >

[jira] [Commented] (FLINK-9187) add prometheus pushgateway reporter

2018-07-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533155#comment-16533155 ] ASF GitHub Bot commented on FLINK-9187: --- Github user lamber-ken commented on the is

[GitHub] flink issue #6184: [FLINK-9187][METRICS] add prometheus pushgateway reporter

2018-07-04 Thread lamber-ken
Github user lamber-ken commented on the issue: https://github.com/apache/flink/pull/6184 @zentol, well done. If there is anything I can do for you, please let me know. ---

[jira] [Commented] (FLINK-6239) Sharing of State Across Operators

2018-07-04 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533142#comment-16533142 ] Elias Levy commented on FLINK-6239: --- For our particular use case having a single operat

[jira] [Commented] (FLINK-9757) Typos found in docs after hunspell run

2018-07-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533105#comment-16533105 ] ASF GitHub Bot commented on FLINK-9757: --- Github user snuyanzin commented on a diff

[jira] [Commented] (FLINK-9679) Implement AvroSerializationSchema

2018-07-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533104#comment-16533104 ] ASF GitHub Bot commented on FLINK-9679: --- Github user medcv commented on the issue:

[jira] [Commented] (FLINK-9736) Potential null reference in KeyGroupPartitionedPriorityQueue#poll()

2018-07-04 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533106#comment-16533106 ] Ted Yu commented on FLINK-9736: --- bq. we never call `poll()` on it. What happens to the {{p

[GitHub] flink pull request #6258: [hotfix][docs][FLINK-9757] fix typos

2018-07-04 Thread snuyanzin
Github user snuyanzin commented on a diff in the pull request: https://github.com/apache/flink/pull/6258#discussion_r200209274 --- Diff: docs/dev/table/sql.md --- @@ -2656,7 +2656,7 @@ Although not every SQL feature is implemented yet, some string combinations are {% hig

[jira] [Comment Edited] (FLINK-9735) Potential resource leak in RocksDBStateBackend#getDbOptions

2018-07-04 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533101#comment-16533101 ] Ted Yu edited comment on FLINK-9735 at 7/4/18 11:15 PM: One impro

[jira] [Updated] (FLINK-9757) Typos found in docs after hunspell run

2018-07-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-9757: -- Labels: pull-request-available (was: ) > Typos found in docs after hunspell run >

[jira] [Commented] (FLINK-9679) Implement AvroSerializationSchema

2018-07-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533102#comment-16533102 ] ASF GitHub Bot commented on FLINK-9679: --- GitHub user medcv opened a pull request:

[GitHub] flink issue #6259: [FLINK-9679] Implement AvroSerializationSchema

2018-07-04 Thread medcv
Github user medcv commented on the issue: https://github.com/apache/flink/pull/6259 @tillrohrmann I implemented `ConfluentRegistryAvroSerializationSchema` in this PR. I would appreciate if you review. ---

[jira] [Updated] (FLINK-9679) Implement AvroSerializationSchema

2018-07-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-9679: -- Labels: pull-request-available (was: ) > Implement AvroSerializationSchema > -

[jira] [Commented] (FLINK-9757) Typos found in docs after hunspell run

2018-07-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533100#comment-16533100 ] ASF GitHub Bot commented on FLINK-9757: --- GitHub user snuyanzin opened a pull reques

[jira] [Commented] (FLINK-9735) Potential resource leak in RocksDBStateBackend#getDbOptions

2018-07-04 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533101#comment-16533101 ] Ted Yu commented on FLINK-9735: --- One improvement is to differentiate the return type from t

[GitHub] flink pull request #6259: [FLINK-9679] Implement AvroSerializationSchema

2018-07-04 Thread medcv
GitHub user medcv opened a pull request: https://github.com/apache/flink/pull/6259 [FLINK-9679] Implement AvroSerializationSchema ## What is the purpose of the change Provides implementation of AvroSerializationSchema that write records serialized as avro and also provides

[GitHub] flink pull request #6258: [hotfix][docs][FLINK-9757] fix typos

2018-07-04 Thread snuyanzin
GitHub user snuyanzin opened a pull request: https://github.com/apache/flink/pull/6258 [hotfix][docs][FLINK-9757] fix typos ## What is the purpose of the change *This PR corrects typos found while hunspell run* ## Brief change log typos from [FLINK-9757] descrip

[jira] [Created] (FLINK-9757) Typos found in docs after hunspell run

2018-07-04 Thread Sergey Nuyanzin (JIRA)
Sergey Nuyanzin created FLINK-9757: -- Summary: Typos found in docs after hunspell run Key: FLINK-9757 URL: https://issues.apache.org/jira/browse/FLINK-9757 Project: Flink Issue Type: Improvem

[jira] [Created] (FLINK-9756) Exceptions in BufferListener#notifyBufferAvailable do not trigger further listeners in LocalBufferPool#recycle()

2018-07-04 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-9756: -- Summary: Exceptions in BufferListener#notifyBufferAvailable do not trigger further listeners in LocalBufferPool#recycle() Key: FLINK-9756 URL: https://issues.apache.org/jira/browse/FL

[jira] [Updated] (FLINK-9755) Exceptions in RemoteInputChannel#notifyBufferAvailable() are not propagated to the responsible thread

2018-07-04 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-9755: --- Priority: Critical (was: Major) > Exceptions in RemoteInputChannel#notifyBufferAvailable() are not p

[jira] [Created] (FLINK-9755) Exceptions in RemoteInputChannel#notifyBufferAvailable() are not propagated to the responsible thread

2018-07-04 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-9755: -- Summary: Exceptions in RemoteInputChannel#notifyBufferAvailable() are not propagated to the responsible thread Key: FLINK-9755 URL: https://issues.apache.org/jira/browse/FLINK-9755

[jira] [Commented] (FLINK-9676) Deadlock during canceling task and recycling exclusive buffer

2018-07-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533081#comment-16533081 ] ASF GitHub Bot commented on FLINK-9676: --- Github user NicoK closed the pull request

[jira] [Commented] (FLINK-9676) Deadlock during canceling task and recycling exclusive buffer

2018-07-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533080#comment-16533080 ] ASF GitHub Bot commented on FLINK-9676: --- Github user NicoK commented on the issue:

[GitHub] flink pull request #6254: [FLINK-9676][network] clarify contracts of BufferL...

2018-07-04 Thread NicoK
Github user NicoK closed the pull request at: https://github.com/apache/flink/pull/6254 ---

[GitHub] flink issue #6254: [FLINK-9676][network] clarify contracts of BufferListener...

2018-07-04 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/6254 I updated the commit with a fixed unit test and added a big TODO on what else would need to be adapted in order to go with this solution (no updated commit message yet). Since this is even mor

[jira] [Commented] (FLINK-9676) Deadlock during canceling task and recycling exclusive buffer

2018-07-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533075#comment-16533075 ] ASF GitHub Bot commented on FLINK-9676: --- GitHub user NicoK opened a pull request:

[GitHub] flink pull request #6257: [FLINK-9676][network] clarify contracts of BufferL...

2018-07-04 Thread NicoK
GitHub user NicoK opened a pull request: https://github.com/apache/flink/pull/6257 [FLINK-9676][network] clarify contracts of BufferListener#notifyBufferAvailable() and fix a deadlock ## What is the purpose of the change When recycling exclusive buffers of a `RemoteInputCha

[jira] [Reopened] (FLINK-9679) Implement AvroSerializationSchema

2018-07-04 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen reopened FLINK-9679: - An, my bad, it is a SerializationSchema, not a DEserializationSchema. Reopened, sorry for the confus

[jira] [Commented] (FLINK-8094) Support other types for ExistingField rowtime extractor

2018-07-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533066#comment-16533066 ] ASF GitHub Bot commented on FLINK-8094: --- Github user HeartSaVioR commented on the i

[GitHub] flink issue #6253: [WIP][FLINK-8094][Table API & SQL] Support other types fo...

2018-07-04 Thread HeartSaVioR
Github user HeartSaVioR commented on the issue: https://github.com/apache/flink/pull/6253 If we would like to answer 1 as "Yes, apply the change to ExistingField.", we can rebase this PR with below branch. https://github.com/HeartSaVioR/flink/commits/FLINK-8094-fixing-ExistingFiel

[jira] [Commented] (FLINK-9407) Support orc rolling sink writer

2018-07-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533065#comment-16533065 ] ASF GitHub Bot commented on FLINK-9407: --- Github user StephanEwen commented on the i

[GitHub] flink issue #6075: [FLINK-9407] [hdfs connector] Support orc rolling sink wr...

2018-07-04 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/6075 If it is not a problem that this can lead to poor compression when checkpoint intervals are short, we could think about merging this as a temporary solution until [FLINK-9749](https://issues.apa

[jira] [Commented] (FLINK-6239) Sharing of State Across Operators

2018-07-04 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533055#comment-16533055 ] Stephan Ewen commented on FLINK-6239: - Can you explain more how you expect this to wo

[GitHub] flink issue #6256: [MINOR] Add generated avro java codes to RAT exclusion li...

2018-07-04 Thread HeartSaVioR
Github user HeartSaVioR commented on the issue: https://github.com/apache/flink/pull/6256 @zentol Addressed review comment. ---

[jira] [Commented] (FLINK-9748) create_source_release pollutes flink root directory

2018-07-04 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533047#comment-16533047 ] Chesnay Schepler commented on FLINK-9748: - If you follow the release guide by the

[GitHub] flink issue #6256: [MINOR] Add generated avro java codes to .ignore to avoid...

2018-07-04 Thread HeartSaVioR
Github user HeartSaVioR commented on the issue: https://github.com/apache/flink/pull/6256 @zentol First of all, thanks for the reviewing! The RAT plugin `reads and parses` the .gitignore file like below so adding it to .gitignore file in root directory is effective. The issue

[jira] [Commented] (FLINK-9004) Cluster test: Run general purpose job with failures with Yarn session

2018-07-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533042#comment-16533042 ] ASF GitHub Bot commented on FLINK-9004: --- Github user GJL commented on the issue:

[GitHub] flink issue #6240: [FLINK-9004][tests] Implement Jepsen tests to test job av...

2018-07-04 Thread GJL
Github user GJL commented on the issue: https://github.com/apache/flink/pull/6240 `0.1.9.` was problematic. Currently testing `0.1.10`. ---

[jira] [Commented] (FLINK-9407) Support orc rolling sink writer

2018-07-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533041#comment-16533041 ] ASF GitHub Bot commented on FLINK-9407: --- Github user StephanEwen commented on the i

[jira] [Updated] (FLINK-9407) Support orc rolling sink writer

2018-07-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-9407: -- Labels: patch-available pull-request-available (was: patch-available) > Support orc rolling si

[GitHub] flink issue #6075: [FLINK-9407] [hdfs connector] Support orc rolling sink wr...

2018-07-04 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/6075 Hi @zhangminglei Sorry for the late response - I thought about this solution quite a bit and came to the conclusion that we may need to do a bit more for efficient results: Please ta

[jira] [Commented] (FLINK-9407) Support orc rolling sink writer

2018-07-04 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533040#comment-16533040 ] Stephan Ewen commented on FLINK-9407: - We have started an effort to completely redesi

[jira] [Commented] (FLINK-9411) Support parquet rolling sink writer

2018-07-04 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533039#comment-16533039 ] Stephan Ewen commented on FLINK-9411: - We have started an effort to completely redesi

[jira] [Created] (FLINK-9754) deploy_staging_jars.sh refers to non-existing profile

2018-07-04 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-9754: --- Summary: deploy_staging_jars.sh refers to non-existing profile Key: FLINK-9754 URL: https://issues.apache.org/jira/browse/FLINK-9754 Project: Flink Iss

[jira] [Created] (FLINK-9753) Support ORC/Parquet for StreamingFileSink

2018-07-04 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-9753: --- Summary: Support ORC/Parquet for StreamingFileSink Key: FLINK-9753 URL: https://issues.apache.org/jira/browse/FLINK-9753 Project: Flink Issue Type: Sub-task

[jira] [Updated] (FLINK-9751) Add a RecoverableWriter to the FileSystem abstraction

2018-07-04 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-9751: Affects Version/s: (was: 1.6.0) > Add a RecoverableWriter to the FileSystem abstraction > -

[jira] [Updated] (FLINK-9751) Add a RecoverableWriter to the FileSystem abstraction

2018-07-04 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-9751: Fix Version/s: 1.6.0 > Add a RecoverableWriter to the FileSystem abstraction >

[jira] [Created] (FLINK-9752) Add an S3 RecoverableWriter

2018-07-04 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-9752: --- Summary: Add an S3 RecoverableWriter Key: FLINK-9752 URL: https://issues.apache.org/jira/browse/FLINK-9752 Project: Flink Issue Type: Sub-task Compon

[jira] [Updated] (FLINK-9751) Add a RecoverableWriter to the FileSystem abstraction

2018-07-04 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-9751: Component/s: Streaming Connectors > Add a RecoverableWriter to the FileSystem abstraction > ---

[jira] [Created] (FLINK-9751) Add a RecoverableWriter to the FileSystem abstraction

2018-07-04 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-9751: --- Summary: Add a RecoverableWriter to the FileSystem abstraction Key: FLINK-9751 URL: https://issues.apache.org/jira/browse/FLINK-9751 Project: Flink Issue Type:

[jira] [Updated] (FLINK-9749) Rework Bucketing Sink

2018-07-04 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-9749: Description: The BucketingSink has a series of deficits at the moment. Due to the long list of iss

[jira] [Commented] (FLINK-9004) Cluster test: Run general purpose job with failures with Yarn session

2018-07-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533037#comment-16533037 ] ASF GitHub Bot commented on FLINK-9004: --- Github user tillrohrmann commented on the

[GitHub] flink issue #6240: [FLINK-9004][tests] Implement Jepsen tests to test job av...

2018-07-04 Thread tillrohrmann
Github user tillrohrmann commented on the issue: https://github.com/apache/flink/pull/6240 Gary is reaching out to Apache legal to ask for advice how to handle the SOLIPSISTIC license. Apparently, we cannot easily upgrade to `0.1.10` because it contains a bug. ---

[jira] [Created] (FLINK-9750) Create new StreamingFileSink that works on Flink's FileSystem abstraction

2018-07-04 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-9750: --- Summary: Create new StreamingFileSink that works on Flink's FileSystem abstraction Key: FLINK-9750 URL: https://issues.apache.org/jira/browse/FLINK-9750 Project: Flink

[jira] [Commented] (FLINK-9679) Implement AvroSerializationSchema

2018-07-04 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533034#comment-16533034 ] Till Rohrmann commented on FLINK-9679: -- I think [~yazdanjs] intends to implement the

[jira] [Created] (FLINK-9749) Rework Bucketing Sink

2018-07-04 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-9749: --- Summary: Rework Bucketing Sink Key: FLINK-9749 URL: https://issues.apache.org/jira/browse/FLINK-9749 Project: Flink Issue Type: New Feature Component

[jira] [Commented] (FLINK-9748) create_source_release pollutes flink root directory

2018-07-04 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533031#comment-16533031 ] Chesnay Schepler commented on FLINK-9748: - This would allow us to automatically c

[jira] [Created] (FLINK-9748) create_source_release pollutes flink root directory

2018-07-04 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-9748: --- Summary: create_source_release pollutes flink root directory Key: FLINK-9748 URL: https://issues.apache.org/jira/browse/FLINK-9748 Project: Flink Issue

[jira] [Created] (FLINK-9747) Release guide ambigous regarding release branches

2018-07-04 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-9747: --- Summary: Release guide ambigous regarding release branches Key: FLINK-9747 URL: https://issues.apache.org/jira/browse/FLINK-9747 Project: Flink Issue T

[jira] [Commented] (FLINK-9352) In Standalone checkpoint recover mode many jobs with same checkpoint interval cause IO pressure

2018-07-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533026#comment-16533026 ] ASF GitHub Bot commented on FLINK-9352: --- Github user tillrohrmann commented on the

[GitHub] flink issue #6092: [FLINK-9352] In Standalone checkpoint recover mode many j...

2018-07-04 Thread tillrohrmann
Github user tillrohrmann commented on the issue: https://github.com/apache/flink/pull/6092 Can we do `ThreadLocalRandom.current().nextLong(minPauseBetweenCheckpoints, baseInterval + 1L)`? ---

[jira] [Created] (FLINK-9746) Release guide says to check docs/_config.yml, which is later modified

2018-07-04 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-9746: --- Summary: Release guide says to check docs/_config.yml, which is later modified Key: FLINK-9746 URL: https://issues.apache.org/jira/browse/FLINK-9746 Project: Fl

[jira] [Closed] (FLINK-9744) update_branch_version script produces incorrect output for non-shapshot versions

2018-07-04 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-9744. --- Resolution: Invalid Handled in create_release_branch scripts. > update_branch_version script

[jira] [Created] (FLINK-9745) Release guide misses information for updating version for releases

2018-07-04 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-9745: --- Summary: Release guide misses information for updating version for releases Key: FLINK-9745 URL: https://issues.apache.org/jira/browse/FLINK-9745 Project: Flink

[jira] [Created] (FLINK-9744) update_branch_version script produces incorrect output for non-shapshot versions

2018-07-04 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-9744: --- Summary: update_branch_version script produces incorrect output for non-shapshot versions Key: FLINK-9744 URL: https://issues.apache.org/jira/browse/FLINK-9744

[jira] [Commented] (FLINK-9643) Flink allowing TLS 1.1 in spite of configuring TLS 1.2

2018-07-04 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533019#comment-16533019 ] Stephan Ewen commented on FLINK-9643: - Thanks for reporting this. The port you checke

[jira] [Closed] (FLINK-9679) Implement AvroSerializationSchema

2018-07-04 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-9679. --- Resolution: Duplicate This already exists, implemented in FLINK-9338 > Implement AvroSerializationSc

[jira] [Closed] (FLINK-9338) Implement RegistryAvroDeserializationSchema

2018-07-04 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-9338. --- > Implement RegistryAvroDeserializationSchema > --- > >

[jira] [Commented] (FLINK-9004) Cluster test: Run general purpose job with failures with Yarn session

2018-07-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533007#comment-16533007 ] ASF GitHub Bot commented on FLINK-9004: --- Github user zentol commented on the issue:

[GitHub] flink issue #6240: [FLINK-9004][tests] Implement Jepsen tests to test job av...

2018-07-04 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/6240 Note that this may also imply that the files that we add cannot be apache licensed, but I'm not completely sure about that. ---

[GitHub] flink issue #6256: [MINOR] Add generated avro java codes to .ignore to avoid...

2018-07-04 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/6256 The RAT plugin ignores the `.gitignore` fail AFAIK, so I don't understand why this would change anything. RAT exclusions must be set in the plugin configuration in the root `pom.xml`. ---

[jira] [Commented] (FLINK-9735) Potential resource leak in RocksDBStateBackend#getDbOptions

2018-07-04 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16532982#comment-16532982 ] Sihua Zhou commented on FLINK-9735: --- I think this might be a trade-off of the design,

[jira] [Commented] (FLINK-9543) Expose JobMaster IDs to metric system

2018-07-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16532976#comment-16532976 ] ASF GitHub Bot commented on FLINK-9543: --- Github user zentol commented on the issue:

[GitHub] flink issue #6195: [FLINK-9543][METRICS] Expose JobMaster ID to metric syste...

2018-07-04 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/6195 This PR isn't complete. As noted in the JIRA I would like to delay work on this JIRA until 1.7, once the legacy code is dropped this will be significantly easier to implement properly. ---

[jira] [Commented] (FLINK-9735) Potential resource leak in RocksDBStateBackend#getDbOptions

2018-07-04 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16532961#comment-16532961 ] Ted Yu commented on FLINK-9735: --- I currently don't see what is wrong with the code in {{Roc

[jira] [Commented] (FLINK-9735) Potential resource leak in RocksDBStateBackend#getDbOptions

2018-07-04 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16532956#comment-16532956 ] Sihua Zhou commented on FLINK-9735: --- Oh [~yuzhih...@gmail.com] you are right! The case

[jira] [Commented] (FLINK-9735) Potential resource leak in RocksDBStateBackend#getDbOptions

2018-07-04 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16532941#comment-16532941 ] Ted Yu commented on FLINK-9735: --- Please take a look at RocksDBResource.java : {code} th

[jira] [Commented] (FLINK-9352) In Standalone checkpoint recover mode many jobs with same checkpoint interval cause IO pressure

2018-07-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16532925#comment-16532925 ] ASF GitHub Bot commented on FLINK-9352: --- Github user yanghua commented on the issue

[GitHub] flink issue #6092: [FLINK-9352] In Standalone checkpoint recover mode many j...

2018-07-04 Thread yanghua
Github user yanghua commented on the issue: https://github.com/apache/flink/pull/6092 hi @tillrohrmann there is a little difference between `RandomUtils.nextLong ` and `ThreadLocalRandom.current().nextLong` , that is the former allows **startInclusive = endExclusive** but the latter d

[jira] [Commented] (FLINK-9543) Expose JobMaster IDs to metric system

2018-07-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16532918#comment-16532918 ] ASF GitHub Bot commented on FLINK-9543: --- Github user bowenli86 commented on the iss

[GitHub] flink issue #6195: [FLINK-9543][METRICS] Expose JobMaster ID to metric syste...

2018-07-04 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/6195 Can you also add documentation to the Metrics page? ---

[jira] [Commented] (FLINK-9676) Deadlock during canceling task and recycling exclusive buffer

2018-07-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16532896#comment-16532896 ] ASF GitHub Bot commented on FLINK-9676: --- Github user pnowojski commented on the iss

[GitHub] flink issue #6254: [FLINK-9676][network] clarify contracts of BufferListener...

2018-07-04 Thread pnowojski
Github user pnowojski commented on the issue: https://github.com/apache/flink/pull/6254 Please document in java doc AND in the commit message the contract of lock hierarchy that you are implementing here. ---

[GitHub] flink issue #6256: [MINOR] Add generated avro java codes to .ignore to avoid...

2018-07-04 Thread HeartSaVioR
Github user HeartSaVioR commented on the issue: https://github.com/apache/flink/pull/6256 There's already .gitignore file in flink-confluent-schema-registry module directory, but it doesn't look like effective while running `mvn clean verify` in flink root directory. ---

[GitHub] flink pull request #6256: [MINOR] Add generated avro java codes to .ignore t...

2018-07-04 Thread HeartSaVioR
GitHub user HeartSaVioR opened a pull request: https://github.com/apache/flink/pull/6256 [MINOR] Add generated avro java codes to .ignore to avoid RAT error ## What is the purpose of the change This patch adds generated avro java codes to .ignore to avoid RAT error when run

[jira] [Closed] (FLINK-9734) Typo 'field-deleimiter' in SQL client docs

2018-07-04 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-9734. --- Resolution: Fixed > Typo 'field-deleimiter' in SQL client docs >

  1   2   3   4   >