[GitHub] [flink-connector-pulsar] syhily commented on a diff in pull request #10: [FLINK-30413][Connector/Pulsar] Drop subscription support, remove unordered consuming, change related tests.

2023-01-03 Thread GitBox
syhily commented on code in PR #10: URL: https://github.com/apache/flink-connector-pulsar/pull/10#discussion_r1060346224 ## flink-connector-pulsar/src/main/java/org/apache/flink/connector/pulsar/source/PulsarSourceBuilder.java: ## @@ -177,9 +171,11 @@ public PulsarSourceBuilder

[GitHub] [flink-connector-pulsar] tisonkun commented on a diff in pull request #10: [FLINK-30413][Connector/Pulsar] Drop subscription support, remove unordered consuming, change related tests.

2023-01-03 Thread GitBox
tisonkun commented on code in PR #10: URL: https://github.com/apache/flink-connector-pulsar/pull/10#discussion_r1060346981 ## flink-connector-pulsar/src/main/java/org/apache/flink/connector/pulsar/source/PulsarSourceBuilder.java: ## @@ -177,9 +171,11 @@ public PulsarSourceBuild

[GitHub] [flink-connector-pulsar] syhily commented on a diff in pull request #10: [FLINK-30413][Connector/Pulsar] Drop subscription support, remove unordered consuming, change related tests.

2023-01-03 Thread GitBox
syhily commented on code in PR #10: URL: https://github.com/apache/flink-connector-pulsar/pull/10#discussion_r1060347329 ## flink-connector-pulsar/src/main/java/org/apache/flink/connector/pulsar/source/PulsarSourceOptions.java: ## @@ -236,6 +230,8 @@ private PulsarSourceOptions

[GitHub] [flink-connector-pulsar] syhily commented on a diff in pull request #10: [FLINK-30413][Connector/Pulsar] Drop subscription support, remove unordered consuming, change related tests.

2023-01-03 Thread GitBox
syhily commented on code in PR #10: URL: https://github.com/apache/flink-connector-pulsar/pull/10#discussion_r1060346224 ## flink-connector-pulsar/src/main/java/org/apache/flink/connector/pulsar/source/PulsarSourceBuilder.java: ## @@ -177,9 +171,11 @@ public PulsarSourceBuilder

[GitHub] [flink-connector-pulsar] tisonkun commented on a diff in pull request #10: [FLINK-30413][Connector/Pulsar] Drop subscription support, remove unordered consuming, change related tests.

2023-01-03 Thread GitBox
tisonkun commented on code in PR #10: URL: https://github.com/apache/flink-connector-pulsar/pull/10#discussion_r1060350503 ## flink-connector-pulsar/src/main/java/org/apache/flink/connector/pulsar/source/PulsarSourceOptions.java: ## @@ -236,6 +230,8 @@ private PulsarSourceOptio

[GitHub] [flink-connector-pulsar] syhily commented on a diff in pull request #10: [FLINK-30413][Connector/Pulsar] Drop subscription support, remove unordered consuming, change related tests.

2023-01-03 Thread GitBox
syhily commented on code in PR #10: URL: https://github.com/apache/flink-connector-pulsar/pull/10#discussion_r1060351426 ## flink-connector-pulsar/src/main/java/org/apache/flink/connector/pulsar/source/PulsarSourceOptions.java: ## @@ -236,6 +230,8 @@ private PulsarSourceOptions

[GitHub] [flink-table-store] JingsongLi merged pull request #449: [FLINK-30545] Add check of 'NOT NULL' for 'ADD COLUMN' schema change

2023-01-03 Thread GitBox
JingsongLi merged PR #449: URL: https://github.com/apache/flink-table-store/pull/449 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@

[jira] [Updated] (FLINK-30545) The SchemaManager doesn't check 'NOT NULL' specification when committing AddColumn change

2023-01-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-30545: --- Labels: pull-request-available (was: ) > The SchemaManager doesn't check 'NOT NULL' specifi

[jira] [Updated] (FLINK-30544) Speed up finding minimum watermark across all channels by introducing heap-based algorithm

2023-01-03 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang updated FLINK-30544: --- Description: Currently, every time a task receives a watermark, it tries to update the minimum wate

[GitHub] [flink] wanglijie95 opened a new pull request, #21588: [FLINK-30544][runtime] Speed up finding minimum watermark across channels by introducing heap-based algorithm

2023-01-03 Thread GitBox
wanglijie95 opened a new pull request, #21588: URL: https://github.com/apache/flink/pull/21588 ## What is the purpose of the change Currently, every time a task receives a watermark, it tries to update the minimum watermark. In current implementation, we use the traversal algorithm to

[jira] [Updated] (FLINK-30544) Speed up finding minimum watermark across all channels by introducing heap-based algorithm

2023-01-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-30544: --- Labels: pull-request-available (was: ) > Speed up finding minimum watermark across all chan

[jira] [Closed] (FLINK-30545) The SchemaManager doesn't check 'NOT NULL' specification when committing AddColumn change

2023-01-03 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-30545. Assignee: yuzelin Resolution: Fixed master: a47dc2b483692df2a61d2a567f1c58323e6a4fdb 3b9ce35

[GitHub] [flink-table-store] JingsongLi commented on pull request #447: Speed up FTS build

2023-01-03 Thread GitBox
JingsongLi commented on PR #447: URL: https://github.com/apache/flink-table-store/pull/447#issuecomment-1369495707 > In addition, I would like to add a recommendation on the [Build from source page](https://nightlies.apache.org/flink/flink-table-store-docs-master/docs/engines/build/) to u

[GitHub] [flink-table-store] JingsongLi merged pull request #447: Speed up FTS build

2023-01-03 Thread GitBox
JingsongLi merged PR #447: URL: https://github.com/apache/flink-table-store/pull/447 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@

[GitHub] [flink-table-store] dependabot[bot] opened a new pull request, #450: Bump json-smart from 2.3 to 2.3.1

2023-01-03 Thread GitBox
dependabot[bot] opened a new pull request, #450: URL: https://github.com/apache/flink-table-store/pull/450 Bumps [json-smart](https://github.com/netplex/json-smart-v2) from 2.3 to 2.3.1. Commits See full diff in https://github.com/netplex/json-smart-v2/commits";>compare view

[GitHub] [flink] flinkbot commented on pull request #21588: [FLINK-30544][runtime] Speed up finding minimum watermark across channels by introducing heap-based algorithm

2023-01-03 Thread GitBox
flinkbot commented on PR #21588: URL: https://github.com/apache/flink/pull/21588#issuecomment-1369498047 ## CI report: * 11eeb48f8fe801f1be41baca07e82d8f9360583e UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Created] (FLINK-30546) WindowDeduplicate didn't write result to sink timely

2023-01-03 Thread kevinshin (Jira)
kevinshin created FLINK-30546: - Summary: WindowDeduplicate didn't write result to sink timely Key: FLINK-30546 URL: https://issues.apache.org/jira/browse/FLINK-30546 Project: Flink Issue Type: Bu

[GitHub] [flink] ramkrish86 commented on pull request #21508: [FLINK-30128] Introduce Azure Data Lake Gen2 APIs in the Hadoop Recoverable path

2023-01-03 Thread GitBox
ramkrish86 commented on PR #21508: URL: https://github.com/apache/flink/pull/21508#issuecomment-1369511575 @xintongsong - We have almost completed the testing part also. I will update the PR in a day or two time frame. Am checking with other comments that Anoop had added over here. --

[GitHub] [flink] ramkrish86 commented on pull request #21508: [FLINK-30128] Introduce Azure Data Lake Gen2 APIs in the Hadoop Recoverable path

2023-01-03 Thread GitBox
ramkrish86 commented on PR #21508: URL: https://github.com/apache/flink/pull/21508#issuecomment-1369515475 > except for the one about deduplicating HadoopRecoverableFsDataOutputStream and AzureBlobFsRecoverableDataOutputStream What specifically you are talking about here? I went through

[jira] [Assigned] (FLINK-30497) Introduce TableChange to represent DROP change

2023-01-03 Thread Shengkai Fang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shengkai Fang reassigned FLINK-30497: - Assignee: Shengkai Fang > Introduce TableChange to represent DROP change >

[GitHub] [flink-connector-pulsar] tisonkun merged pull request #10: [FLINK-30413][Connector/Pulsar] Drop subscription support, remove unordered consuming, change related tests.

2023-01-03 Thread GitBox
tisonkun merged PR #10: URL: https://github.com/apache/flink-connector-pulsar/pull/10 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...

[jira] [Updated] (FLINK-30540) DataSinkTaskTest failed with a 143 exit code

2023-01-03 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-30540: -- Priority: Critical (was: Major) > DataSinkTaskTest failed with a 143 exit code >

[jira] [Updated] (FLINK-29594) RMQSourceITCase.testMessageDelivery timed out

2023-01-03 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-29594: -- Affects Version/s: rabbitmq-3.0.1 > RMQSourceITCase.testMessageDelivery timed out > --

[GitHub] [flink] zhuzhurk commented on a diff in pull request #21570: [FLINK-29666][runtime] Let adaptive batch scheduler divide subpartition range according to amount of data

2023-01-03 Thread GitBox
zhuzhurk commented on code in PR #21570: URL: https://github.com/apache/flink/pull/21570#discussion_r1060266079 ## flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/ExecutionVertexInputInfo.java: ## @@ -68,4 +68,9 @@ public boolean equals(Object obj) {

[jira] [Commented] (FLINK-29594) RMQSourceITCase.testMessageDelivery timed out

2023-01-03 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17653883#comment-17653883 ] Matthias Pohl commented on FLINK-29594: --- This issue will be resolved on {{master}}

[jira] [Commented] (FLINK-30485) Remove flink-connector-rabbitmq from master branch

2023-01-03 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17653885#comment-17653885 ] Matthias Pohl commented on FLINK-30485: --- [~martijnvisser] may you remove 1.17 as a

[GitHub] [flink] lindong28 commented on pull request #21558: [FLINK-29217][Runtime/Checkpointing] Remove OC's guarantee for OperatorEvent on concurrent checkpoints

2023-01-03 Thread GitBox
lindong28 commented on PR #21558: URL: https://github.com/apache/flink/pull/21558#issuecomment-1369537264 Thanks for the PR. LGTM. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

[GitHub] [flink] lindong28 merged pull request #21558: [FLINK-29217][Runtime/Checkpointing] Remove OC's guarantee for OperatorEvent on concurrent checkpoints

2023-01-03 Thread GitBox
lindong28 merged PR #21558: URL: https://github.com/apache/flink/pull/21558 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apa

[jira] [Closed] (FLINK-29217) CoordinatorEventsToStreamOperatorRecipientExactlyOnceITCase.testConcurrentCheckpoint failed with AssertionFailedError

2023-01-03 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin closed FLINK-29217. Resolution: Fixed > CoordinatorEventsToStreamOperatorRecipientExactlyOnceITCase.testConcurrentCheckpoint >

[GitHub] [flink] lindong28 commented on a diff in pull request #21576: [FLINK-30533][runtime] SourceOperator#emitNext() should push records to DataOutput in a while loop

2023-01-03 Thread GitBox
lindong28 commented on code in PR #21576: URL: https://github.com/apache/flink/pull/21576#discussion_r1060393161 ## flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/StreamTask.java: ## @@ -990,6 +991,10 @@ public MailboxExecutorFactory getMailboxExecut

[jira] [Closed] (FLINK-30512) Flink SQL state TTL has no effect when using Interval Join

2023-01-03 Thread wangkang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangkang closed FLINK-30512. Release Note: add param : set table.exec.source.idle-timeout=120s; the issue fixed. Resolution: Fixe

[jira] [Commented] (FLINK-30512) Flink SQL state TTL has no effect when using Interval Join

2023-01-03 Thread wangkang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17653889#comment-17653889 ] wangkang commented on FLINK-30512: -- add param : set table.exec.source.idle-timeout=120s

[jira] [Commented] (FLINK-27518) Refactor migration tests to support version update automatically

2023-01-03 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17653890#comment-17653890 ] Matthias Pohl commented on FLINK-27518: --- Awesome, thanks~ > Refactor migration te

[jira] [Updated] (FLINK-29835) NoClassDefFoundError in PulsarSourceUnorderedE2ECase

2023-01-03 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-29835: -- Affects Version/s: pulsar-3.0.0 pulsar-4.0.0

[jira] [Comment Edited] (FLINK-29835) NoClassDefFoundError in PulsarSourceUnorderedE2ECase

2023-01-03 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17653894#comment-17653894 ] Matthias Pohl edited comment on FLINK-29835 at 1/3/23 9:26 AM: ---

[jira] [Commented] (FLINK-29835) NoClassDefFoundError in PulsarSourceUnorderedE2ECase

2023-01-03 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17653894#comment-17653894 ] Matthias Pohl commented on FLINK-29835: --- I updated the affected versions. FLINK-30

[jira] [Commented] (FLINK-30340) PulsarUnorderedSourceITCase fails with IllegalStateException

2023-01-03 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17653895#comment-17653895 ] Matthias Pohl commented on FLINK-30340: --- I updated the affected versions. FLINK-30

[jira] [Updated] (FLINK-30340) PulsarUnorderedSourceITCase fails with IllegalStateException

2023-01-03 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-30340: -- Affects Version/s: pulsar-4.0.0 (was: 1.17.0) > PulsarUnorderedSour

[jira] [Created] (FLINK-30547) Flink-table-runtime free for flink-table-store-common

2023-01-03 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-30547: Summary: Flink-table-runtime free for flink-table-store-common Key: FLINK-30547 URL: https://issues.apache.org/jira/browse/FLINK-30547 Project: Flink Issue T

[GitHub] [flink-table-store] JingsongLi commented on a diff in pull request #451: [FLINK-30522] Fix 'SHOW TBLPROPERTIES' can't read properties of table in Spark3

2023-01-03 Thread GitBox
JingsongLi commented on code in PR #451: URL: https://github.com/apache/flink-table-store/pull/451#discussion_r1060403458 ## flink-table-store-core/src/main/java/org/apache/flink/table/store/CoreOptions.java: ## @@ -405,6 +405,10 @@ public CoreOptions(Configuration options) {

[jira] [Updated] (FLINK-30522) `SHOW TBLPROPERTIES` can't read properties of table in Spark3

2023-01-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-30522: --- Labels: pull-request-available (was: ) > `SHOW TBLPROPERTIES` can't read properties of tabl

[GitHub] [flink] xintongsong commented on a diff in pull request #21508: [FLINK-30128] Introduce Azure Data Lake Gen2 APIs in the Hadoop Recoverable path

2023-01-03 Thread GitBox
xintongsong commented on code in PR #21508: URL: https://github.com/apache/flink/pull/21508#discussion_r1060404322 ## flink-filesystems/flink-azure-fs-hadoop/src/main/java/org/apache/flink/fs/azurefs/AzureBlobFsRecoverableDataOutputStream.java: ## @@ -0,0 +1,299 @@ +/* + * Licen

[GitHub] [flink-table-store] JingsongLi merged pull request #450: Bump json-smart from 2.3 to 2.3.1

2023-01-03 Thread GitBox
JingsongLi merged PR #450: URL: https://github.com/apache/flink-table-store/pull/450 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@

[GitHub] [flink-table-store] yuzelin commented on a diff in pull request #451: [FLINK-30522] Fix 'SHOW TBLPROPERTIES' can't read properties of table in Spark3

2023-01-03 Thread GitBox
yuzelin commented on code in PR #451: URL: https://github.com/apache/flink-table-store/pull/451#discussion_r1060405512 ## flink-table-store-core/src/main/java/org/apache/flink/table/store/CoreOptions.java: ## @@ -405,6 +405,10 @@ public CoreOptions(Configuration options) {

[GitHub] [flink] gaborgsomogyi commented on pull request #21583: [FLINK-30539][tests] Removes timeout from YARNSessionCapacitySchedulerITCase

2023-01-03 Thread GitBox
gaborgsomogyi commented on PR #21583: URL: https://github.com/apache/flink/pull/21583#issuecomment-1369559291 Seems like `LookupJoinITCase` is super super stable. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [flink] gaborgsomogyi commented on pull request #21583: [FLINK-30539][tests] Removes timeout from YARNSessionCapacitySchedulerITCase

2023-01-03 Thread GitBox
gaborgsomogyi commented on PR #21583: URL: https://github.com/apache/flink/pull/21583#issuecomment-1369559417 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

[GitHub] [flink] gaborgsomogyi commented on pull request #21584: [BP-1.16][FLINK-30539][tests] Removes timeout from YARNSessionCapacitySchedulerITCase

2023-01-03 Thread GitBox
gaborgsomogyi commented on PR #21584: URL: https://github.com/apache/flink/pull/21584#issuecomment-1369560946 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

[jira] [Commented] (FLINK-30539) YARNSessionCapacitySchedulerITCase.testDetachedPerJobYarnCluster and testDetachedPerJobYarnClusterWithStreamingJob timing out

2023-01-03 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17653900#comment-17653900 ] Gabor Somogyi commented on FLINK-30539: --- I think it's not going to cause any big c

[jira] [Created] (FLINK-30548) In some cases AvroDeserializationSchema buffer is not reset

2023-01-03 Thread heyu dou (Jira)
heyu dou created FLINK-30548: Summary: In some cases AvroDeserializationSchema buffer is not reset Key: FLINK-30548 URL: https://issues.apache.org/jira/browse/FLINK-30548 Project: Flink Issue Ty

[jira] [Updated] (FLINK-30548) In some cases AvroDeserializationSchema buffer is not reset

2023-01-03 Thread heyu dou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] heyu dou updated FLINK-30548: - Description: When the avro schema changes, if the downstream uses the old schema to read the data gener

[GitHub] [flink] ruanhang1993 opened a new pull request, #21589: [FLINK-25509][connector-base] Add RecordEvaluator to dynamically stop source based on de-serialized records

2023-01-03 Thread GitBox
ruanhang1993 opened a new pull request, #21589: URL: https://github.com/apache/flink/pull/21589 ## What is the purpose of the change This pull request add RecordEvaluator to dynamically stop source based on de-serialized records. ## Brief change log The changes could be

[jira] [Updated] (FLINK-25509) FLIP-208: Add RecordEvaluator to dynamically stop source based on de-serialized records

2023-01-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-25509: --- Labels: pull-request-available (was: ) > FLIP-208: Add RecordEvaluator to dynamically stop

[jira] [Updated] (FLINK-30548) In some cases AvroDeserializationSchema buffer is not reset

2023-01-03 Thread heyu dou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] heyu dou updated FLINK-30548: - Component/s: Formats (JSON, Avro, Parquet, ORC, SequenceFile) > In some cases AvroDeserializationSchema

[GitHub] [flink] flinkbot commented on pull request #21589: [FLINK-25509][connector-base] Add RecordEvaluator to dynamically stop source based on de-serialized records

2023-01-03 Thread GitBox
flinkbot commented on PR #21589: URL: https://github.com/apache/flink/pull/21589#issuecomment-1369567350 ## CI report: * d423b3536c0ad2899a29c4d2f478477db6ad37d6 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-30548) In some cases AvroDeserializationSchema buffer is not reset

2023-01-03 Thread heyu dou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] heyu dou updated FLINK-30548: - Description: When the avro schema changes, if the downstream uses the old schema to read the data gener

[jira] [Updated] (FLINK-30548) In some cases AvroDeserializationSchema buffer is not reset

2023-01-03 Thread heyu dou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] heyu dou updated FLINK-30548: - Description: When the avro schema changes, if the downstream uses the old schema to read the data gener

[jira] [Updated] (FLINK-30548) In some cases AvroDeserializationSchema buffer is not reset

2023-01-03 Thread heyu dou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] heyu dou updated FLINK-30548: - Description: When the avro schema changes, if the downstream uses the old schema to read the data gener

[jira] [Updated] (FLINK-30548) In some cases AvroDeserializationSchema buffer is not reset

2023-01-03 Thread heyu dou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] heyu dou updated FLINK-30548: - Attachment: AvroNew.java AvroOld.java > In some cases AvroDeserializationSchema buffer i

[GitHub] [flink] reswqa commented on a diff in pull request #21560: [FLINK-29768] Hybrid shuffle supports consume partial finished subtask

2023-01-03 Thread GitBox
reswqa commented on code in PR #21560: URL: https://github.com/apache/flink/pull/21560#discussion_r1060429247 ## flink-runtime/src/main/java/org/apache/flink/runtime/deployment/InputGateDeploymentDescriptor.java: ## @@ -75,7 +77,7 @@ public class InputGateDeploymentDescriptor im

[jira] [Commented] (FLINK-18356) flink-table-planner Exit code 137 returned from process

2023-01-03 Thread Yunhong Zheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17653909#comment-17653909 ] Yunhong Zheng commented on FLINK-18356: --- [~godfrey] and [~martijnvisser] . I will

[GitHub] [flink-table-store] JingsongLi commented on pull request #447: Speed up FTS build

2023-01-03 Thread GitBox
JingsongLi commented on PR #447: URL: https://github.com/apache/flink-table-store/pull/447#issuecomment-1369589430 Revert this in https://github.com/apache/flink-table-store/commit/6489d299aa87666f6f26b88c691850ea9fd63428 maven 3.2.5 is widely used by us, this change will make maven 3.2.

[jira] [Commented] (FLINK-30548) In some cases AvroDeserializationSchema buffer is not reset

2023-01-03 Thread heyu dou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17653916#comment-17653916 ] heyu dou commented on FLINK-30548: -- If you agree, can you let me modify it? > In some

[GitHub] [flink-kubernetes-operator] gyfora commented on pull request #493: [FLINK-30464] Exclude metrics during stabilization and ensure a full metric window

2023-01-03 Thread GitBox
gyfora commented on PR #493: URL: https://github.com/apache/flink-kubernetes-operator/pull/493#issuecomment-1369591561 After some offline discussions, we have agreed with @mxm to keep the original version of this PR and not introduce an extra config for minimum metric window now to keep th

[jira] [Updated] (FLINK-29755) PulsarSourceUnorderedE2ECase.testSavepoint failed because of missing TaskManagers

2023-01-03 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-29755: -- Affects Version/s: pulsar-3.0.0 pulsar-4.0.0

[jira] [Commented] (FLINK-29755) PulsarSourceUnorderedE2ECase.testSavepoint failed because of missing TaskManagers

2023-01-03 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17653927#comment-17653927 ] Matthias Pohl commented on FLINK-29755: --- I updated the affected versions. FLINK-30

[GitHub] [flink] XComp commented on pull request #21583: [FLINK-30539][tests] Removes timeout from YARNSessionCapacitySchedulerITCase

2023-01-03 Thread GitBox
XComp commented on PR #21583: URL: https://github.com/apache/flink/pull/21583#issuecomment-1369599382 Yeah, we're planning to pick up on FLINK-29427. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [flink] XComp merged pull request #21583: [FLINK-30539][tests] Removes timeout from YARNSessionCapacitySchedulerITCase

2023-01-03 Thread GitBox
XComp merged PR #21583: URL: https://github.com/apache/flink/pull/21583 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.

[GitHub] [flink] XComp merged pull request #21584: [BP-1.16][FLINK-30539][tests] Removes timeout from YARNSessionCapacitySchedulerITCase

2023-01-03 Thread GitBox
XComp merged PR #21584: URL: https://github.com/apache/flink/pull/21584 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.

[GitHub] [flink] XComp commented on pull request #21584: [BP-1.16][FLINK-30539][tests] Removes timeout from YARNSessionCapacitySchedulerITCase

2023-01-03 Thread GitBox
XComp commented on PR #21584: URL: https://github.com/apache/flink/pull/21584#issuecomment-1369602071 Sorry, I missed that the build is still pending for that one. But, `YARNSessionCapacitySchedulerITCase` is packaged in `misc` which succeeded already. So, we should be fine. -- This is a

[GitHub] [flink] XComp merged pull request #21585: [BP-1.15][FLINK-30539][tests] Removes timeout from YARNSessionCapacitySchedulerITCase

2023-01-03 Thread GitBox
XComp merged PR #21585: URL: https://github.com/apache/flink/pull/21585 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.

[jira] [Commented] (FLINK-30539) YARNSessionCapacitySchedulerITCase.testDetachedPerJobYarnCluster and testDetachedPerJobYarnClusterWithStreamingJob timing out

2023-01-03 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17653930#comment-17653930 ] Matthias Pohl commented on FLINK-30539: --- Removed timeouts: master: 2ffe7e01919682b

[jira] [Created] (FLINK-30549) Remove flink-connector-firehose from Flink master branch

2023-01-03 Thread Danny Cranmer (Jira)
Danny Cranmer created FLINK-30549: - Summary: Remove flink-connector-firehose from Flink master branch Key: FLINK-30549 URL: https://issues.apache.org/jira/browse/FLINK-30549 Project: Flink Is

[jira] [Updated] (FLINK-30385) Remove AWS connectors from master branch

2023-01-03 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-30385: -- Summary: Remove AWS connectors from master branch (was: Remove KDS/KDF/AWS Base connectors fr

[jira] [Updated] (FLINK-30549) Remove flink-connector-firehose from Flink master branch

2023-01-03 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-30549: -- Description: Remove: * {{flink-connector-fir > Remove flink-connector-firehose from Flink ma

[jira] [Assigned] (FLINK-30549) Remove flink-connector-firehose from Flink master branch

2023-01-03 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer reassigned FLINK-30549: - Assignee: Danny Cranmer > Remove flink-connector-firehose from Flink master branch > --

[jira] [Updated] (FLINK-30549) Remove flink-connector-aws-kinesis-firehose from Flink master branch

2023-01-03 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-30549: -- Summary: Remove flink-connector-aws-kinesis-firehose from Flink master branch (was: Remove fl

[jira] [Updated] (FLINK-30549) Remove flink-connector-aws-kinesis-firehose from Flink master branch

2023-01-03 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-30549: -- Description: Remove: * {{flink-connector-aws-kinesis-firehose}} * {{flink-sql-connector-aws-

[jira] [Created] (FLINK-30550) Flink master to integrate KDS/KDF docs from flink-connector-aws

2023-01-03 Thread Danny Cranmer (Jira)
Danny Cranmer created FLINK-30550: - Summary: Flink master to integrate KDS/KDF docs from flink-connector-aws Key: FLINK-30550 URL: https://issues.apache.org/jira/browse/FLINK-30550 Project: Flink

[jira] [Updated] (FLINK-30550) Flink master to integrate KDS/KDF docs from flink-connector-aws

2023-01-03 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-30550: -- Fix Version/s: 1.17.0 (was: 1.16.1) > Flink master to integrate KDS/KDF

[jira] [Updated] (FLINK-30550) Flink master to integrate KDS/KDF docs from flink-connector-aws

2023-01-03 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-30550: -- Affects Version/s: (was: 1.16.0) > Flink master to integrate KDS/KDF docs from flink-conne

[jira] [Updated] (FLINK-30550) Flink master to integrate KDS/KDF docs from flink-connector-aws

2023-01-03 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-30550: -- Component/s: Connectors / Firehose Connectors / Kinesis > Flink master to int

[GitHub] [flink-ml] zhipeng93 commented on a diff in pull request #188: [FLINK-30249] Fix TableUtils.getRowTypeInfo by using ExternalTypeInfo.of()

2023-01-03 Thread GitBox
zhipeng93 commented on code in PR #188: URL: https://github.com/apache/flink-ml/pull/188#discussion_r1060470625 ## flink-ml-core/src/test/java/org/apache/flink/ml/common/datastream/TableUtilsTest.java: ## @@ -0,0 +1,75 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [flink-table-store] zjureel commented on pull request #423: [FLINK-27844] Support column type evolution in file meta

2023-01-03 Thread GitBox
zjureel commented on PR #423: URL: https://github.com/apache/flink-table-store/pull/423#issuecomment-1369631457 Hi @JingsongLi I have updated this PR according to the cast executor, please help to review it again, thanks -- This is an automated message from the Apache Git Service. To res

[GitHub] [flink] dannycranmer opened a new pull request, #21590: [FLINK-30550] Flink master to integrate KDS/KDF docs from flink-conne…

2023-01-03 Thread GitBox
dannycranmer opened a new pull request, #21590: URL: https://github.com/apache/flink/pull/21590 …ctor-aws ## What is the purpose of the change Integrate AWS connectors v4.0.0 docs with Flink master ## Brief change log - Pull Kinesis/Firehose docs from flink-connect

[GitHub] [flink-ml] zhipeng93 commented on a diff in pull request #188: [FLINK-30249] Fix TableUtils.getRowTypeInfo by using ExternalTypeInfo.of()

2023-01-03 Thread GitBox
zhipeng93 commented on code in PR #188: URL: https://github.com/apache/flink-ml/pull/188#discussion_r1060480557 ## flink-ml-lib/src/main/java/org/apache/flink/ml/feature/binarizer/Binarizer.java: ## @@ -70,11 +71,12 @@ public Table[] transform(Table... inputs) { for (

[GitHub] [flink] flinkbot commented on pull request #21590: [FLINK-30550] Flink master to integrate KDS/KDF docs from flink-conne…

2023-01-03 Thread GitBox
flinkbot commented on PR #21590: URL: https://github.com/apache/flink/pull/21590#issuecomment-1369641260 ## CI report: * d52af1f6d8046367a1617146b054fd484a645f25 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] hlteoh37 commented on a diff in pull request #21590: [FLINK-30550] Flink master to integrate KDS/KDF docs from flink-conne…

2023-01-03 Thread GitBox
hlteoh37 commented on code in PR #21590: URL: https://github.com/apache/flink/pull/21590#discussion_r1060482687 ## docs/data/sql_connectors.yml: ## @@ -169,22 +169,26 @@ upsert-kafka: kinesis: name: Amazon Kinesis Data Streams category: connector -maven: flink-con

[GitHub] [flink] hlteoh37 commented on a diff in pull request #21590: [FLINK-30550] Flink master to integrate KDS/KDF docs from flink-conne…

2023-01-03 Thread GitBox
hlteoh37 commented on code in PR #21590: URL: https://github.com/apache/flink/pull/21590#discussion_r1060484427 ## docs/data/sql_connectors.yml: ## @@ -169,22 +169,26 @@ upsert-kafka: kinesis: name: Amazon Kinesis Data Streams category: connector -maven: flink-con

[GitHub] [flink] dannycranmer commented on a diff in pull request #21590: [FLINK-30550] Flink master to integrate KDS/KDF docs from flink-conne…

2023-01-03 Thread GitBox
dannycranmer commented on code in PR #21590: URL: https://github.com/apache/flink/pull/21590#discussion_r1060488627 ## docs/data/sql_connectors.yml: ## @@ -169,22 +169,26 @@ upsert-kafka: kinesis: name: Amazon Kinesis Data Streams category: connector -maven: flink

[GitHub] [flink] dannycranmer commented on a diff in pull request #21590: [FLINK-30550] Flink master to integrate KDS/KDF docs from flink-conne…

2023-01-03 Thread GitBox
dannycranmer commented on code in PR #21590: URL: https://github.com/apache/flink/pull/21590#discussion_r1060489104 ## docs/data/sql_connectors.yml: ## @@ -169,22 +169,26 @@ upsert-kafka: kinesis: name: Amazon Kinesis Data Streams category: connector -maven: flink

[GitHub] [flink] dannycranmer commented on a diff in pull request #21590: [FLINK-30550] Flink master to integrate KDS/KDF docs from flink-conne…

2023-01-03 Thread GitBox
dannycranmer commented on code in PR #21590: URL: https://github.com/apache/flink/pull/21590#discussion_r1060489589 ## docs/setup_docs.sh: ## @@ -63,7 +63,7 @@ mkdir tmp cd tmp integrate_connector_docs elasticsearch v3.0.0 -integrate_connector_docs aws v3.0.0 +integrate_conn

[GitHub] [flink] dannycranmer commented on a diff in pull request #21590: [FLINK-30550] Flink master to integrate KDS/KDF docs from flink-conne…

2023-01-03 Thread GitBox
dannycranmer commented on code in PR #21590: URL: https://github.com/apache/flink/pull/21590#discussion_r1060489589 ## docs/setup_docs.sh: ## @@ -63,7 +63,7 @@ mkdir tmp cd tmp integrate_connector_docs elasticsearch v3.0.0 -integrate_connector_docs aws v3.0.0 +integrate_conn

[jira] [Commented] (FLINK-16006) Add host blacklist support for Flink YarnResourceManager

2023-01-03 Thread qiunan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17653945#comment-17653945 ] qiunan commented on FLINK-16006: [~ZhenqiuHuang] Hi, Why didn't you support it? > Add h

[jira] [Commented] (FLINK-26974) Python EmbeddedThreadDependencyTests.test_add_python_file failed on azure

2023-01-03 Thread Xingbo Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17653944#comment-17653944 ] Xingbo Huang commented on FLINK-26974: -- [~mapohl] Sure. I will take a look. > Pyth

[GitHub] [flink] XComp commented on a diff in pull request #21467: [FLINK-30301][tests] Increase heartbeat timeout in TaskExecutorTest to prevent unrelated failures

2023-01-03 Thread GitBox
XComp commented on code in PR #21467: URL: https://github.com/apache/flink/pull/21467#discussion_r1060497575 ## flink-runtime/src/main/java/org/apache/flink/runtime/heartbeat/HeartbeatMonitorImpl.java: ## @@ -39,6 +39,8 @@ private static final Logger LOG = LoggerFactory.

[GitHub] [flink-table-store] JingsongLi commented on a diff in pull request #423: [FLINK-27844] Support column type evolution in file meta

2023-01-03 Thread GitBox
JingsongLi commented on code in PR #423: URL: https://github.com/apache/flink-table-store/pull/423#discussion_r1060497684 ## flink-table-store-core/src/main/java/org/apache/flink/table/store/file/casting/CastExecutors.java: ## @@ -176,7 +176,7 @@ public class CastExecutors {

[GitHub] [flink] XComp commented on a diff in pull request #21467: [FLINK-30301][tests] Increase heartbeat timeout in TaskExecutorTest to prevent unrelated failures

2023-01-03 Thread GitBox
XComp commented on code in PR #21467: URL: https://github.com/apache/flink/pull/21467#discussion_r1060497575 ## flink-runtime/src/main/java/org/apache/flink/runtime/heartbeat/HeartbeatMonitorImpl.java: ## @@ -39,6 +39,8 @@ private static final Logger LOG = LoggerFactory.

[GitHub] [flink] XComp commented on a diff in pull request #21467: [FLINK-30301][tests] Increase heartbeat timeout in TaskExecutorTest to prevent unrelated failures

2023-01-03 Thread GitBox
XComp commented on code in PR #21467: URL: https://github.com/apache/flink/pull/21467#discussion_r1060497575 ## flink-runtime/src/main/java/org/apache/flink/runtime/heartbeat/HeartbeatMonitorImpl.java: ## @@ -39,6 +39,8 @@ private static final Logger LOG = LoggerFactory.

[GitHub] [flink-table-store] JingsongLi commented on a diff in pull request #423: [FLINK-27844] Support column type evolution in file meta

2023-01-03 Thread GitBox
JingsongLi commented on code in PR #423: URL: https://github.com/apache/flink-table-store/pull/423#discussion_r1060500678 ## flink-table-store-core/src/main/java/org/apache/flink/table/store/file/schema/SchemaEvolutionUtil.java: ## @@ -304,4 +307,56 @@ private static int indexOf

[GitHub] [flink-table-store] JingsongLi commented on a diff in pull request #423: [FLINK-27844] Support column type evolution in file meta

2023-01-03 Thread GitBox
JingsongLi commented on code in PR #423: URL: https://github.com/apache/flink-table-store/pull/423#discussion_r1060501943 ## flink-table-store-core/src/main/java/org/apache/flink/table/store/file/schema/SchemaEvolutionUtil.java: ## @@ -304,4 +307,56 @@ private static int indexOf

  1   2   3   >