[jira] [Commented] (FLINK-7293) Support custom order by in PatternStream

2017-07-30 Thread Dian Fu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106877#comment-16106877 ] Dian Fu commented on FLINK-7293: As the {{event-time}}/{{process-time}} has higher priorit

[jira] [Commented] (FLINK-7293) Support custom order by in PatternStream

2017-07-30 Thread Dawid Wysakowicz (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106872#comment-16106872 ] Dawid Wysakowicz commented on FLINK-7293: - My personal feeling is that it is not n

[jira] [Updated] (FLINK-7292) Fix EMPTY MATCH bug in CEP.

2017-07-30 Thread Dawid Wysakowicz (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dawid Wysakowicz updated FLINK-7292: Issue Type: Sub-task (was: New Feature) Parent: FLINK-6935 > Fix EMPTY MATCH bug in

[jira] [Commented] (FLINK-7294) mesos.resourcemanager.framework.role not working

2017-07-30 Thread Bhumika Bayani (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106860#comment-16106860 ] Bhumika Bayani commented on FLINK-7294: --- My Mesos version is 1.0.0 Also, i am using

[jira] [Created] (FLINK-7300) End-to-end tests are instable on Travis

2017-07-30 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-7300: -- Summary: End-to-end tests are instable on Travis Key: FLINK-7300 URL: https://issues.apache.org/jira/browse/FLINK-7300 Project: Flink Issue Type:

[jira] [Commented] (FLINK-6588) Rename NumberOfFullRestarts metric

2017-07-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106833#comment-16106833 ] ASF GitHub Bot commented on FLINK-6588: --- Github user zjureel closed the pull request

[GitHub] flink pull request #4292: [FLINK-6588] Rename NumberOfFullRestarts metric

2017-07-30 Thread zjureel
Github user zjureel closed the pull request at: https://github.com/apache/flink/pull/4292 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[jira] [Assigned] (FLINK-7270) Add support for dynamic properties to cluster entry point

2017-07-30 Thread Fang Yong (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fang Yong reassigned FLINK-7270: Assignee: Fang Yong > Add support for dynamic properties to cluster entry point > -

[jira] [Commented] (FLINK-7299) Write GenericRecord using AvroOutputFormat

2017-07-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106809#comment-16106809 ] ASF GitHub Bot commented on FLINK-7299: --- GitHub user soniclavier opened a pull reque

[GitHub] flink pull request #4422: [FLINK-7299][AVRO] Write GenericRecord using AvroO...

2017-07-30 Thread soniclavier
GitHub user soniclavier opened a pull request: https://github.com/apache/flink/pull/4422 [FLINK-7299][AVRO] Write GenericRecord using AvroOutputFormat ## What is the purpose of the change Allow writing Avro GenericRecord using AvroOutputFormat. ## Brief change log

[jira] [Created] (FLINK-7299) Write GenericRecord using AvroOutputFormat

2017-07-30 Thread Vishnu Viswanath (JIRA)
Vishnu Viswanath created FLINK-7299: --- Summary: Write GenericRecord using AvroOutputFormat Key: FLINK-7299 URL: https://issues.apache.org/jira/browse/FLINK-7299 Project: Flink Issue Type: Im

[jira] [Commented] (FLINK-7298) Records can be cleared when all data in state is invalid

2017-07-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106797#comment-16106797 ] ASF GitHub Bot commented on FLINK-7298: --- Github user hequn8128 commented on the issu

[GitHub] flink issue #4421: [FLINK-7298] [table] Records can be cleared all at once w...

2017-07-30 Thread hequn8128
Github user hequn8128 commented on the issue: https://github.com/apache/flink/pull/4421 Also, I think we need to remove `!validTimestamp` from `while (keyIter.hasNext && !validTimestamp) {` . Because, new records may be inserted at the head of rowMapState, in this case expired data wi

[jira] [Commented] (FLINK-7298) Records can be cleared when all data in state is invalid

2017-07-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106794#comment-16106794 ] ASF GitHub Bot commented on FLINK-7298: --- GitHub user hequn8128 opened a pull request

[GitHub] flink pull request #4421: [FLINK-7298] [table] Records can be cleared all at...

2017-07-30 Thread hequn8128
GitHub user hequn8128 opened a pull request: https://github.com/apache/flink/pull/4421 [FLINK-7298] [table] Records can be cleared all at once when all data in state is invalid In `ProcTimeWindowInnerJoin`.`expireOutTimeRow`, we need not to remove records one by one from state when

[GitHub] flink issue #4415: [FLINK-7269] Refactor passing of dynamic properties

2017-07-30 Thread zjureel
Github user zjureel commented on the issue: https://github.com/apache/flink/pull/4415 @tillrohrmann Thank you for your suggestion, I have update the PR template and add test case, thanks --- If your project is set up for it, you can reply to this email and have your reply appear on

[jira] [Commented] (FLINK-7269) Refactor passing of dynamic properties

2017-07-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106783#comment-16106783 ] ASF GitHub Bot commented on FLINK-7269: --- Github user zjureel commented on the issue:

[jira] [Commented] (FLINK-7169) Support AFTER MATCH SKIP function in CEP library API

2017-07-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106770#comment-16106770 ] ASF GitHub Bot commented on FLINK-7169: --- Github user dianfu commented on a diff in t

[jira] [Commented] (FLINK-7169) Support AFTER MATCH SKIP function in CEP library API

2017-07-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106772#comment-16106772 ] ASF GitHub Bot commented on FLINK-7169: --- Github user dianfu commented on a diff in t

[jira] [Commented] (FLINK-7169) Support AFTER MATCH SKIP function in CEP library API

2017-07-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106769#comment-16106769 ] ASF GitHub Bot commented on FLINK-7169: --- Github user dianfu commented on a diff in t

[jira] [Commented] (FLINK-7169) Support AFTER MATCH SKIP function in CEP library API

2017-07-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106771#comment-16106771 ] ASF GitHub Bot commented on FLINK-7169: --- Github user dianfu commented on a diff in t

[GitHub] flink pull request #4331: [FLINK-7169][CEP] Support AFTER MATCH SKIP functio...

2017-07-30 Thread dianfu
Github user dianfu commented on a diff in the pull request: https://github.com/apache/flink/pull/4331#discussion_r130264164 --- Diff: flink-libraries/flink-cep/src/main/java/org/apache/flink/cep/nfa/NFA.java --- @@ -551,18 +579,47 @@ private boolean isSelfIgnore(final StateTransiti

[GitHub] flink pull request #4331: [FLINK-7169][CEP] Support AFTER MATCH SKIP functio...

2017-07-30 Thread dianfu
Github user dianfu commented on a diff in the pull request: https://github.com/apache/flink/pull/4331#discussion_r130266394 --- Diff: flink-libraries/flink-cep/src/main/java/org/apache/flink/cep/nfa/NFA.java --- @@ -551,18 +579,47 @@ private boolean isSelfIgnore(final StateTransiti

[GitHub] flink pull request #4331: [FLINK-7169][CEP] Support AFTER MATCH SKIP functio...

2017-07-30 Thread dianfu
Github user dianfu commented on a diff in the pull request: https://github.com/apache/flink/pull/4331#discussion_r130264936 --- Diff: flink-libraries/flink-cep/src/main/java/org/apache/flink/cep/nfa/NFA.java --- @@ -551,18 +579,47 @@ private boolean isSelfIgnore(final StateTransiti

[GitHub] flink pull request #4331: [FLINK-7169][CEP] Support AFTER MATCH SKIP functio...

2017-07-30 Thread dianfu
Github user dianfu commented on a diff in the pull request: https://github.com/apache/flink/pull/4331#discussion_r130265354 --- Diff: flink-libraries/flink-cep/src/main/java/org/apache/flink/cep/nfa/NFA.java --- @@ -551,18 +579,47 @@ private boolean isSelfIgnore(final StateTransiti

[jira] [Updated] (FLINK-7298) Records can be cleared when all data in state is invalid

2017-07-30 Thread Hequn Cheng (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hequn Cheng updated FLINK-7298: --- Description: In {{ProcTimeWindowInnerJoin}}.{{expireOutTimeRow}}, we need not to remove records from s

[jira] [Assigned] (FLINK-7298) Records can be cleared when all data in state is invalid

2017-07-30 Thread Hequn Cheng (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hequn Cheng reassigned FLINK-7298: -- Assignee: Hequn Cheng > Records can be cleared when all data in state is invalid >

[jira] [Created] (FLINK-7298) Records can be cleared when all data in state is invalid

2017-07-30 Thread Hequn Cheng (JIRA)
Hequn Cheng created FLINK-7298: -- Summary: Records can be cleared when all data in state is invalid Key: FLINK-7298 URL: https://issues.apache.org/jira/browse/FLINK-7298 Project: Flink Issue Type

[jira] [Commented] (FLINK-6493) Ineffective null check in RegisteredOperatorBackendStateMetaInfo#equals()

2017-07-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106728#comment-16106728 ] ASF GitHub Bot commented on FLINK-6493: --- Github user zhangminglei commented on the i

[GitHub] flink issue #4328: [FLINK-6493] Fix ineffective null check in RegisteredOper...

2017-07-30 Thread zhangminglei
Github user zhangminglei commented on the issue: https://github.com/apache/flink/pull/4328 Thanks to @tedyu . It is a good idea and code have been updated based on your suggestion. Please check it out again ~ --- If your project is set up for it, you can reply to this email and have

[jira] [Commented] (FLINK-7239) GroupWindow and OverWindow aggregates do not check correctly for updating input

2017-07-30 Thread Hequn Cheng (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106724#comment-16106724 ] Hequn Cheng commented on FLINK-7239: hi, [~fhueske] RetractionRules will make sure tha

[jira] [Commented] (FLINK-7213) Introduce state management by OperatorID in TaskManager

2017-07-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106672#comment-16106672 ] ASF GitHub Bot commented on FLINK-7213: --- Github user StefanRRichter commented on the

[GitHub] flink issue #4353: [FLINK-7213] Introduce state management by OperatorID in ...

2017-07-30 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/4353 BTW, one alternative I was once considering for the scale down case is merging state handles that are backed by different physical files in one logical state handle, using something based on `

[jira] [Commented] (FLINK-7213) Introduce state management by OperatorID in TaskManager

2017-07-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106669#comment-16106669 ] ASF GitHub Bot commented on FLINK-7213: --- Github user StefanRRichter commented on the

[GitHub] flink issue #4353: [FLINK-7213] Introduce state management by OperatorID in ...

2017-07-30 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/4353 I think that idea is problematic because in the rescaling case, all the collections can have different sizes. For example there can be 5 managed keyed state handles and 7 managed operator stat

[jira] [Updated] (FLINK-4534) Lack of synchronization in BucketingSink#restoreState()

2017-07-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated FLINK-4534: -- Description: Iteration over state.bucketStates is protected by synchronization in other methods, except for the

[jira] [Updated] (FLINK-5486) Lack of synchronization in BucketingSink#handleRestoredBucketState()

2017-07-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated FLINK-5486: -- Description: Here is related code: {code} handlePendingFilesForPreviousCheckpoints(bucketState.pendingFil

[jira] [Resolved] (FLINK-7115) test instability in MiniClusterITCase.runJobWithMultipleJobManagers

2017-07-30 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann resolved FLINK-7115. -- Resolution: Fixed Fix Version/s: 1.4.0 Closing this issue for the moment because it shoul

[GitHub] flink pull request #4416: [FLINK-7279][minicluster] fix a deadlock between T...

2017-07-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/4416 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Resolved] (FLINK-7279) MiniCluster can deadlock at shut down

2017-07-30 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann resolved FLINK-7279. -- Resolution: Fixed Fix Version/s: 1.4.0 Fixed via 49acd09ec19b5da3f6e9861d658728ec1306e3d5

[jira] [Commented] (FLINK-7279) MiniCluster can deadlock at shut down

2017-07-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106586#comment-16106586 ] ASF GitHub Bot commented on FLINK-7279: --- Github user asfgit closed the pull request

[jira] [Commented] (FLINK-7080) Deploy Yarn cluster with job

2017-07-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106581#comment-16106581 ] ASF GitHub Bot commented on FLINK-7080: --- Github user asfgit closed the pull request

[jira] [Closed] (FLINK-7080) Deploy Yarn cluster with job

2017-07-30 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann closed FLINK-7080. Resolution: Done Fix Version/s: 1.4.0 Added via a954ea113bc29a4480af579387c6e9b81bd76f85 > D

[GitHub] flink pull request #4284: [FLINK-7080] [yarn] Add Yarn per job mode deployme...

2017-07-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/4284 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (FLINK-7080) Deploy Yarn cluster with job

2017-07-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106578#comment-16106578 ] ASF GitHub Bot commented on FLINK-7080: --- Github user tillrohrmann commented on the i

[GitHub] flink issue #4284: [FLINK-7080] [yarn] Add Yarn per job mode deployment

2017-07-30 Thread tillrohrmann
Github user tillrohrmann commented on the issue: https://github.com/apache/flink/pull/4284 Travis passed. Merging this PR. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] flink issue #4380: Time sort with offset/fetch without retraction

2017-07-30 Thread fhueske
Github user fhueske commented on the issue: https://github.com/apache/flink/pull/4380 Hi @rtudoran, I had the impression that your main motivation was to fill the syntactic gaps of SQL on streams and not so much to support certain kinds of use cases. The semantics o

[jira] [Commented] (FLINK-7245) Enhance the operators to support holding back watermarks

2017-07-30 Thread Xingcan Cui (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106399#comment-16106399 ] Xingcan Cui commented on FLINK-7245: Thanks for the answer and the suggestion, [~fhues

[jira] [Commented] (FLINK-7245) Enhance the operators to support holding back watermarks

2017-07-30 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106397#comment-16106397 ] Fabian Hueske commented on FLINK-7245: -- Hi [~xccui], thanks for the questions. I thin

[jira] [Commented] (FLINK-7179) ProjectableTableSource interface doesn't compatible with BoundedOutOfOrdernessTimestampExtractor

2017-07-30 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106389#comment-16106389 ] Fabian Hueske commented on FLINK-7179: -- I think a {{ProjectableTableSource}} knows th

[jira] [Commented] (FLINK-7291) Incorrect return value of getArity() in ListTypeInfo and MapTypeInfo

2017-07-30 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106367#comment-16106367 ] Fabian Hueske commented on FLINK-7291: -- I think you are right that {{getArity()}} was

[jira] [Comment Edited] (FLINK-6333) Utilize Bloomfilters in RocksDb

2017-07-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16095490#comment-16095490 ] Ted Yu edited comment on FLINK-6333 at 7/30/17 7:33 AM: Looks like

[jira] [Commented] (FLINK-6493) Ineffective null check in RegisteredOperatorBackendStateMetaInfo#equals()

2017-07-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106355#comment-16106355 ] ASF GitHub Bot commented on FLINK-6493: --- Github user tedyu commented on a diff in th

[GitHub] flink pull request #4328: [FLINK-6493] Fix ineffective null check in Registe...

2017-07-30 Thread tedyu
Github user tedyu commented on a diff in the pull request: https://github.com/apache/flink/pull/4328#discussion_r130235370 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/RegisteredOperatorBackendStateMetaInfo.java --- @@ -175,14 +175,21 @@ public boolean equa

[jira] [Updated] (FLINK-6838) RescalingITCase fails in master branch

2017-07-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated FLINK-6838: -- Description: {code} Tests in error: RescalingITCase.testSavepointRescalingInKeyedState[1] » JobExecution Job