[jira] [Updated] (FLINK-14431) Update TaskManager's memory information to match its memory composition

2020-11-05 Thread Matthias (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias updated FLINK-14431: - Release Note: FLINK-14431 (FLIP-102) updated the metrics overview page of the TaskManagers aligning it

[GitHub] [flink] JingsongLi closed pull request #13915: [FLINK-19365][hive] Migrate Hive source to FLIP-27 source interface f…

2020-11-05 Thread GitBox
JingsongLi closed pull request #13915: URL: https://github.com/apache/flink/pull/13915 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Closed] (FLINK-19365) Migrate Hive source to FLIP-27 source interface for batch

2020-11-05 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-19365. Resolution: Fixed master (1.12): 56207e8a578394c01022bbe848d03cf8b97c2380 > Migrate Hive source t

[GitHub] [flink] JingsongLi merged pull request #13915: [FLINK-19365][hive] Migrate Hive source to FLIP-27 source interface f…

2020-11-05 Thread GitBox
JingsongLi merged pull request #13915: URL: https://github.com/apache/flink/pull/13915 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [flink] flinkbot edited a comment on pull request #13932: [FLINK-19947][Connectors / Common]Support sink parallelism configuration for Print connector

2020-11-05 Thread GitBox
flinkbot edited a comment on pull request #13932: URL: https://github.com/apache/flink/pull/13932#issuecomment-722193609 ## CI report: * cd87ec7806bbe57badf0302188c7041a71349b59 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

[GitHub] [flink] flinkbot edited a comment on pull request #13931: [FLINK-19811][table-planner] Introduce RexSimplify to simplify SEARCH conditions

2020-11-05 Thread GitBox
flinkbot edited a comment on pull request #13931: URL: https://github.com/apache/flink/pull/13931#issuecomment-722165982 ## CI report: * ea93667f09807f3e9eae819bed19678d7a699173 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

[jira] [Updated] (FLINK-14431) Update TaskManager's memory information to match its memory composition

2020-11-05 Thread Matthias (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias updated FLINK-14431: - Description: This is the umbrella Jira issue collecting all the work on aligning the TaskManager's metri

[GitHub] [flink] rmetzger commented on a change in pull request #13930: [FLINK-19974][python][e2e] Fix the bug that kafka related services are not teardown properly after tests finished

2020-11-05 Thread GitBox
rmetzger commented on a change in pull request #13930: URL: https://github.com/apache/flink/pull/13930#discussion_r517854585 ## File path: flink-end-to-end-tests/test-scripts/test_pyflink.sh ## @@ -272,8 +272,6 @@ if [[ "${EXPECTED_MSG[*]}" != "${SORTED_READ_MSG[*]}" ]]; then

[GitHub] [flink] wuchong commented on a change in pull request #13331: [FLINK-19079][table-runtime] Import rowtime deduplicate operator

2020-11-05 Thread GitBox
wuchong commented on a change in pull request #13331: URL: https://github.com/apache/flink/pull/13331#discussion_r517854922 ## File path: flink-table/flink-table-runtime-blink/src/test/java/org/apache/flink/table/runtime/operators/deduplicate/RowTimeMiniBatchDeduplicateFunctionTest.ja

[GitHub] [flink] flinkbot commented on pull request #13933: [FLINK-19946][Connectors / HBase]Support sink parallelism configuration for Hbase connector

2020-11-05 Thread GitBox
flinkbot commented on pull request #13933: URL: https://github.com/apache/flink/pull/13933#issuecomment-722212503 ## CI report: * eed3ec1b04aa25fcaafe0ac2003d22e5ff202941 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot r

[GitHub] [flink] wuchong commented on pull request #13296: [FLINK-18774][format][debezium] Support debezium-avro format

2020-11-05 Thread GitBox
wuchong commented on pull request #13296: URL: https://github.com/apache/flink/pull/13296#issuecomment-722213913 @caozhen1937 , recently we applied some fixes on the `AvroSchemaConverter#convertToSchema`, it doesn't work correctly for duplicate nested field names, see FLINK-19291, FLINK-19

[jira] [Commented] (FLINK-19912) JSON format fails to serialize map value with null keys

2020-11-05 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17226563#comment-17226563 ] Jark Wu commented on FLINK-19912: - Sounds good to me. I will add the solution to the iss

[GitHub] [flink] flinkbot commented on pull request #13934: [FLINK-19986] Skip license check for scala 2.12 profile

2020-11-05 Thread GitBox
flinkbot commented on pull request #13934: URL: https://github.com/apache/flink/pull/13934#issuecomment-722214429 ## CI report: * a95425118d19a5855166b1ba3ce46a4da804b3ff UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot r

[jira] [Updated] (FLINK-19645) ShuffleCompressionITCase.testDataCompressionForBlockingShuffle is instable

2020-11-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-19645: --- Labels: pull-request-available test-stability (was: test-stability) > ShuffleCompressionITC

[GitHub] [flink] wsry opened a new pull request #13936: [FLINK-19645][tests] Fix akka rpc timeout issue of ShuffleCompressionITCase

2020-11-05 Thread GitBox
wsry opened a new pull request #13936: URL: https://github.com/apache/flink/pull/13936 ## What is the purpose of the change Fix akka rpc timeout issue of ShuffleCompressionITCase by increasing the timeout configuration. ## Brief change log - Fix akka rpc timeout issue

[jira] [Commented] (FLINK-19912) JSON format fails to serialize map value with null keys

2020-11-05 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17226565#comment-17226565 ] Jark Wu commented on FLINK-19912: - I saw you first suggest {{json.map-null-key.handling}

[jira] [Commented] (FLINK-19645) ShuffleCompressionITCase.testDataCompressionForBlockingShuffle is instable

2020-11-05 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17226566#comment-17226566 ] Yingjie Cao commented on FLINK-19645: - After some investigation, I didn't find any p

[GitHub] [flink] rmetzger commented on pull request #13894: [FLINK-18117][e2e] Dynamically allocate port causing test instabilities

2020-11-05 Thread GitBox
rmetzger commented on pull request #13894: URL: https://github.com/apache/flink/pull/13894#issuecomment-722216319 CI has passed. Merging. This is an automated message from the Apache Git Service. To respond to the message, pl

[GitHub] [flink] flinkbot commented on pull request #13936: [FLINK-19645][tests] Fix akka rpc timeout issue of ShuffleCompressionITCase

2020-11-05 Thread GitBox
flinkbot commented on pull request #13936: URL: https://github.com/apache/flink/pull/13936#issuecomment-722215984 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the pro

[GitHub] [flink] becketqin commented on pull request #13784: [FLINK-19698][connectors/common] API improvements to the Sources.

2020-11-05 Thread GitBox
becketqin commented on pull request #13784: URL: https://github.com/apache/flink/pull/13784#issuecomment-722216486 @flinkbot run azure This is an automated message from the Apache Git Service. To respond to the message, pleas

[jira] [Closed] (FLINK-18117) "Kerberized YARN per-job on Docker test" fails with "Could not start hadoop cluster."

2020-11-05 Thread Robert Metzger (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger closed FLINK-18117. -- Resolution: Fixed Resolved in https://github.com/apache/flink/commit/358713ba5b1f29fb9befa72c

[GitHub] [flink] rmetzger merged pull request #13894: [FLINK-18117][e2e] Dynamically allocate port causing test instabilities

2020-11-05 Thread GitBox
rmetzger merged pull request #13894: URL: https://github.com/apache/flink/pull/13894 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Updated] (FLINK-19912) JSON format fails to serialize map value with null keys

2020-11-05 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-19912: Description: When JsonRowDataSerializationSchema serializing map data with null keys, it will throw NPE.

[jira] [Resolved] (FLINK-19661) Implement changes required to resolve FLIP-104

2020-11-05 Thread Matthias (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias resolved FLINK-19661. -- Resolution: Fixed > Implement changes required to resolve FLIP-104 > -

[jira] [Updated] (FLINK-19661) Implement changes required to resolve FLIP-104

2020-11-05 Thread Matthias (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias updated FLINK-19661: - Release Note: FLINK-19661 (FLIP-104) introduced the metrics overview page for the JobManager to align i

[jira] [Updated] (FLINK-19912) JSON format fails to serialize map value with null keys

2020-11-05 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-19912: Description: When JsonRowDataSerializationSchema serializing map data with null keys, it will throw NPE.

[jira] [Updated] (FLINK-19661) Implement changes required to resolve FLIP-104

2020-11-05 Thread Matthias (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias updated FLINK-19661: - Fix Version/s: 1.12.0 > Implement changes required to resolve FLIP-104 > ---

[GitHub] [flink] becketqin commented on pull request #13784: [FLINK-19698][connectors/common] API improvements to the Sources.

2020-11-05 Thread GitBox
becketqin commented on pull request #13784: URL: https://github.com/apache/flink/pull/13784#issuecomment-722219407 > Maybe we don't backport the CheckpointListener part, but only the close() method part? Sounds good to me. Personally I don't think backporting this interface change i

[GitHub] [flink] becketqin commented on pull request #13784: [FLINK-19698][connectors/common] API improvements to the Sources.

2020-11-05 Thread GitBox
becketqin commented on pull request #13784: URL: https://github.com/apache/flink/pull/13784#issuecomment-70211 The CI case failure seems unrelated. I am running the CI test again and will merge the code after that. This

[jira] [Updated] (FLINK-14431) Update TaskManager's memory information to match its memory composition

2020-11-05 Thread Matthias (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias updated FLINK-14431: - Fix Version/s: 1.12.0 > Update TaskManager's memory information to match its memory composition > --

[jira] [Resolved] (FLINK-14431) Update TaskManager's memory information to match its memory composition

2020-11-05 Thread Matthias (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias resolved FLINK-14431. -- Resolution: Fixed > Update TaskManager's memory information to match its memory composition >

[GitHub] [flink] flinkbot edited a comment on pull request #13280: [FLINK-18070][table-planner-blink] Don't materialize time attribute in SubGraphOptimize

2020-11-05 Thread GitBox
flinkbot edited a comment on pull request #13280: URL: https://github.com/apache/flink/pull/13280#issuecomment-683394013 ## CI report: * Unknown: [CANCELED](TBD) * 3c7c8dba3fcf15fd46a73200c633269f13904723 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620

[GitHub] [flink] godfreyhe commented on a change in pull request #13897: [FLINK-19939][table-planner-blink] Remove redundant union from multiple input node

2020-11-05 Thread GitBox
godfreyhe commented on a change in pull request #13897: URL: https://github.com/apache/flink/pull/13897#discussion_r517849708 ## File path: flink-table/flink-table-planner-blink/src/main/java/org/apache/flink/table/planner/plan/processors/MultipleInputNodeCreationProcessor.java ##

[GitHub] [flink] wangyang0918 commented on a change in pull request #13864: [FLINK-19543][k8s] Implement RunningJobsRegistry, JobGraphStore based on Kubernetes API

2020-11-05 Thread GitBox
wangyang0918 commented on a change in pull request #13864: URL: https://github.com/apache/flink/pull/13864#discussion_r517867848 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/zookeeper/ZooKeeperStateHandleStore.java ## @@ -474,6 +488,8 @@ protected String

[GitHub] [flink] caozhen1937 commented on pull request #13296: [FLINK-18774][format][debezium] Support debezium-avro format

2020-11-05 Thread GitBox
caozhen1937 commented on pull request #13296: URL: https://github.com/apache/flink/pull/13296#issuecomment-74794 @wuchong , yes, I see FLINK-19291. Before FLINK-19291, recordName maybe repeated, I think it can be fixed by the `6a7afb7` commit. ![image](https://user-images.github

[GitHub] [flink] flinkbot edited a comment on pull request #13331: [FLINK-19079][table-runtime] Import rowtime deduplicate operator

2020-11-05 Thread GitBox
flinkbot edited a comment on pull request #13331: URL: https://github.com/apache/flink/pull/13331#issuecomment-687585649 ## CI report: * b3252a0d7e4481aebb849b2777ae544209cff1e8 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

[GitHub] [flink] wangyang0918 commented on a change in pull request #13864: [FLINK-19543][k8s] Implement RunningJobsRegistry, JobGraphStore based on Kubernetes API

2020-11-05 Thread GitBox
wangyang0918 commented on a change in pull request #13864: URL: https://github.com/apache/flink/pull/13864#discussion_r517871011 ## File path: flink-kubernetes/src/main/java/org/apache/flink/kubernetes/highavailability/KubernetesStateHandleStore.java ## @@ -0,0 +1,422 @@ +/* +

[GitHub] [flink] dawidwys commented on a change in pull request #13853: [FLINK-19837][DataStream] Don't emit intermediate watermarks from watermark operators in BATCH execution mode

2020-11-05 Thread GitBox
dawidwys commented on a change in pull request #13853: URL: https://github.com/apache/flink/pull/13853#discussion_r517872088 ## File path: flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/operators/TimestampsAndWatermarksOperator.java ## @@ -83,12 +81,14 @

[GitHub] [flink] wangyang0918 commented on a change in pull request #13864: [FLINK-19543][k8s] Implement RunningJobsRegistry, JobGraphStore based on Kubernetes API

2020-11-05 Thread GitBox
wangyang0918 commented on a change in pull request #13864: URL: https://github.com/apache/flink/pull/13864#discussion_r517872335 ## File path: flink-kubernetes/src/main/java/org/apache/flink/kubernetes/highavailability/KubernetesStateHandleStore.java ## @@ -0,0 +1,422 @@ +/* +

[jira] [Created] (FLINK-19991) UnalignedCheckpointITCase#shouldPerformUnalignedCheckpointMassivelyParallel fails on Azure Pipeline

2020-11-05 Thread Yingjie Cao (Jira)
Yingjie Cao created FLINK-19991: --- Summary: UnalignedCheckpointITCase#shouldPerformUnalignedCheckpointMassivelyParallel fails on Azure Pipeline Key: FLINK-19991 URL: https://issues.apache.org/jira/browse/FLINK-19991

[GitHub] [flink] curcur commented on a change in pull request #13880: [FLINK-19693][runtime] Downstream Failover for Approximate Local Recovery

2020-11-05 Thread GitBox
curcur commented on a change in pull request #13880: URL: https://github.com/apache/flink/pull/13880#discussion_r517876455 ## File path: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/graph/StreamingJobGraphGenerator.java ## @@ -717,6 +717,11 @@ private stat

[GitHub] [flink] JingsongLi opened a new pull request #13937: [FLINK-19886][hive] Integrate file compaction to Hive connector

2020-11-05 Thread GitBox
JingsongLi opened a new pull request #13937: URL: https://github.com/apache/flink/pull/13937 ## What is the purpose of the change Integrate file compaction to Hive connector ## Brief change log - Introduce `HivePartitionUtils` - Introduce HiveCompactReader.java

[jira] [Updated] (FLINK-19886) Integrate file compaction to Hive connector

2020-11-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-19886: --- Labels: pull-request-available (was: ) > Integrate file compaction to Hive connector >

[GitHub] [flink] curcur commented on a change in pull request #13880: [FLINK-19693][runtime] Downstream Failover for Approximate Local Recovery

2020-11-05 Thread GitBox
curcur commented on a change in pull request #13880: URL: https://github.com/apache/flink/pull/13880#discussion_r517876455 ## File path: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/graph/StreamingJobGraphGenerator.java ## @@ -717,6 +717,11 @@ private stat

[jira] [Assigned] (FLINK-19886) Integrate file compaction to Hive connector

2020-11-05 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee reassigned FLINK-19886: Assignee: Jingsong Lee > Integrate file compaction to Hive connector > --

[GitHub] [flink] flinkbot commented on pull request #13937: [FLINK-19886][hive] Integrate file compaction to Hive connector

2020-11-05 Thread GitBox
flinkbot commented on pull request #13937: URL: https://github.com/apache/flink/pull/13937#issuecomment-722231925 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the pro

[jira] [Created] (FLINK-19992) Integrate new orc to Hive source

2020-11-05 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-19992: Summary: Integrate new orc to Hive source Key: FLINK-19992 URL: https://issues.apache.org/jira/browse/FLINK-19992 Project: Flink Issue Type: Sub-task

[jira] [Updated] (FLINK-19992) Integrate new orc to Hive source

2020-11-05 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-19992: - Description: After introducing `OrcColumnarRowFileInputFormat` We need integrate it to Hive, in

[jira] [Created] (FLINK-19993) Remove the flink-connector-filesystem module

2020-11-05 Thread Kostas Kloudas (Jira)
Kostas Kloudas created FLINK-19993: -- Summary: Remove the flink-connector-filesystem module Key: FLINK-19993 URL: https://issues.apache.org/jira/browse/FLINK-19993 Project: Flink Issue Type:

[jira] [Updated] (FLINK-19993) Remove the flink-connector-filesystem module

2020-11-05 Thread Kostas Kloudas (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kostas Kloudas updated FLINK-19993: --- Description: The flink-connector-filesystem module contains (only) the deprecated {{Bucketi

[jira] [Commented] (FLINK-19864) TwoInputStreamTaskTest.testWatermarkMetrics failed with "expected:<1> but was:<-9223372036854775808>"

2020-11-05 Thread Robert Metzger (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17226580#comment-17226580 ] Robert Metzger commented on FLINK-19864: This issue only seems to occur on Azure

[GitHub] [flink] caozhen1937 commented on pull request #13296: [FLINK-18774][format][debezium] Support debezium-avro format

2020-11-05 Thread GitBox
caozhen1937 commented on pull request #13296: URL: https://github.com/apache/flink/pull/13296#issuecomment-722235811 @wuchong I see the FLINK-19779 update 7 days ago. Maybe I need merge the code in my branch. This is an aut

[GitHub] [flink] wangyang0918 commented on pull request #13864: [FLINK-19543][k8s] Implement RunningJobsRegistry, JobGraphStore based on Kubernetes API

2020-11-05 Thread GitBox
wangyang0918 commented on pull request #13864: URL: https://github.com/apache/flink/pull/13864#issuecomment-722236705 cc @KarmaGYZ @xintongsong @tillrohrmann I have addressed all the comments and force pushed. Please start another round of review :). --

[GitHub] [flink] flinkbot edited a comment on pull request #13724: [FLINK-19581][orc] Introduce Orc ColumnarRow File source bulk Format

2020-11-05 Thread GitBox
flinkbot edited a comment on pull request #13724: URL: https://github.com/apache/flink/pull/13724#issuecomment-713528928 ## CI report: * bf777e65a831b6c6ee8f1c22ae8f6a232ee87deb UNKNOWN * 3d25c91253ce75af6d2d87b0bae62bc7dbd575bb Azure: [SUCCESS](https://dev.azure.com/apache-fl

[jira] [Updated] (FLINK-19987) HBaseDynamicTableFactoryTest.testTableSourceFactory failed with "NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Obje

2020-11-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-19987: --- Labels: pull-request-available test-stability (was: test-stability) > HBaseDynamicTableFact

[GitHub] [flink] rmetzger opened a new pull request #13938: [FLINK-19987] Fix Hbase1.4 tests on Hadoop 3.1.3

2020-11-05 Thread GitBox
rmetzger opened a new pull request #13938: URL: https://github.com/apache/flink/pull/13938 ## What is the purpose of the change The Hbase tests were failing in the Hadoop 3.1.3 profile. This was caused by the newly added `org.apache.hbase:hbase-common:jar:tests:1.4.3:test` d

[GitHub] [flink] wuchong commented on pull request #13296: [FLINK-18774][format][debezium] Support debezium-avro format

2020-11-05 Thread GitBox
wuchong commented on pull request #13296: URL: https://github.com/apache/flink/pull/13296#issuecomment-722238552 Yes @caozhen1937 , please rebase (DO NOT `git merge`) to the latest master branch and try again. This is an au

[jira] [Commented] (FLINK-19653) HiveCatalogITCase fails on azure

2020-11-05 Thread Rui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17226584#comment-17226584 ] Rui Li commented on FLINK-19653: The error message basically just tells us the HMS faile

[GitHub] [flink] flinkbot commented on pull request #13938: [FLINK-19987] Fix Hbase1.4 tests on Hadoop 3.1.3

2020-11-05 Thread GitBox
flinkbot commented on pull request #13938: URL: https://github.com/apache/flink/pull/13938#issuecomment-722239652 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the pro

[GitHub] [flink] rkhachatryan commented on a change in pull request #13928: [hotfix] Do not emit EndOfChannelRecoveryEvent for Approximate Local …

2020-11-05 Thread GitBox
rkhachatryan commented on a change in pull request #13928: URL: https://github.com/apache/flink/pull/13928#discussion_r517888974 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/PipelinedApproximateSubpartition.java ## @@ -92,6 +94,11 @@

[GitHub] [flink] wangyang0918 commented on a change in pull request #13864: [FLINK-19543][k8s] Implement RunningJobsRegistry, JobGraphStore based on Kubernetes API

2020-11-05 Thread GitBox
wangyang0918 commented on a change in pull request #13864: URL: https://github.com/apache/flink/pull/13864#discussion_r517889323 ## File path: flink-kubernetes/src/main/java/org/apache/flink/kubernetes/highavailability/KubernetesJobGraphStoreWatcher.java ## @@ -0,0 +1,148 @@ +

[GitHub] [flink] JingsongLi opened a new pull request #13939: [FLINK-19992][hive] Integrate new orc to Hive source

2020-11-05 Thread GitBox
JingsongLi opened a new pull request #13939: URL: https://github.com/apache/flink/pull/13939 ## What is the purpose of the change After introducing `OrcColumnarRowFileInputFormat` We need integrate it to Hive, including Hive 2+ and Hive 1.X ## Brief change log - I

[GitHub] [flink] flinkbot edited a comment on pull request #13784: [FLINK-19698][connectors/common] API improvements to the Sources.

2020-11-05 Thread GitBox
flinkbot edited a comment on pull request #13784: URL: https://github.com/apache/flink/pull/13784#issuecomment-716153889 ## CI report: * 2cefd8778ecdde11c40b46e613cce9bff6de398b Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

[jira] [Updated] (FLINK-19992) Integrate new orc to Hive source

2020-11-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-19992: --- Labels: pull-request-available (was: ) > Integrate new orc to Hive source > ---

[GitHub] [flink] AHeise merged pull request #13928: [hotfix] Do not emit EndOfChannelRecoveryEvent for Approximate Local …

2020-11-05 Thread GitBox
AHeise merged pull request #13928: URL: https://github.com/apache/flink/pull/13928 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [flink] flinkbot edited a comment on pull request #13850: [FLINK-19858]Intorduce the upsert-kafka table factory

2020-11-05 Thread GitBox
flinkbot edited a comment on pull request #13850: URL: https://github.com/apache/flink/pull/13850#issuecomment-719162027 ## CI report: * 45845058aa91089037420a3dea07901497e645d4 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

[GitHub] [flink] flinkbot commented on pull request #13939: [FLINK-19992][hive] Integrate new orc to Hive source

2020-11-05 Thread GitBox
flinkbot commented on pull request #13939: URL: https://github.com/apache/flink/pull/13939#issuecomment-722242562 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the pro

[GitHub] [flink] zentol commented on a change in pull request #13722: [FLINK-19636][coordination] Add DeclarativeSlotPool

2020-11-05 Thread GitBox
zentol commented on a change in pull request #13722: URL: https://github.com/apache/flink/pull/13722#discussion_r517452702 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/jobmaster/slotpool/AutoRequirementDecrementingSlotPoolWrapper.java ## @@ -0,0 +1,114 @@

[GitHub] [flink] flinkbot edited a comment on pull request #13860: [FLINK-19756][table-planner] Enabled multiple input optimization by default

2020-11-05 Thread GitBox
flinkbot edited a comment on pull request #13860: URL: https://github.com/apache/flink/pull/13860#issuecomment-719522056 ## CI report: * 2cb279be619572ff7a0d6d7ce80e061730f68525 UNKNOWN * 042917063c547f44d89a7675a39bb59e9c5a48e2 Azure: [FAILURE](https://dev.azure.com/apache-fl

[jira] [Commented] (FLINK-19653) HiveCatalogITCase fails on azure

2020-11-05 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17226586#comment-17226586 ] Jingsong Lee commented on FLINK-19653: -- +1 to embedded metastore. A standalone HMS

[jira] [Commented] (FLINK-19973) 【Flink-Deployment】YARN CLI Parameter doesn't work when set `execution.target: yarn-per-job` config

2020-11-05 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17226588#comment-17226588 ] Till Rohrmann commented on FLINK-19973: --- cc [~kkl0u] do you have an idea what coul

[GitHub] [flink] flinkbot edited a comment on pull request #13931: [FLINK-19811][table-planner] Introduce RexSimplify to simplify SEARCH conditions

2020-11-05 Thread GitBox
flinkbot edited a comment on pull request #13931: URL: https://github.com/apache/flink/pull/13931#issuecomment-722165982 ## CI report: * ea93667f09807f3e9eae819bed19678d7a699173 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

[GitHub] [flink] flinkbot edited a comment on pull request #13920: [FLINK-19743] Add metric definitions in FLIP-33 and report some of them by default.

2020-11-05 Thread GitBox
flinkbot edited a comment on pull request #13920: URL: https://github.com/apache/flink/pull/13920#issuecomment-721560528 ## CI report: * e273dd928114bca2ffa0baaab0b9ca71df6b3951 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

[GitHub] [flink] flinkbot edited a comment on pull request #13933: [FLINK-19946][Connectors / HBase]Support sink parallelism configuration for Hbase connector

2020-11-05 Thread GitBox
flinkbot edited a comment on pull request #13933: URL: https://github.com/apache/flink/pull/13933#issuecomment-722212503 ## CI report: * eed3ec1b04aa25fcaafe0ac2003d22e5ff202941 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

[jira] [Updated] (FLINK-19973) 【Flink-Deployment】YARN CLI Parameter doesn't work when set `execution.target: yarn-per-job` config

2020-11-05 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann updated FLINK-19973: -- Component/s: Command Line Client > 【Flink-Deployment】YARN CLI Parameter doesn't work when set

[GitHub] [flink] flinkbot edited a comment on pull request #13934: [FLINK-19986] Skip license check for scala 2.12 profile

2020-11-05 Thread GitBox
flinkbot edited a comment on pull request #13934: URL: https://github.com/apache/flink/pull/13934#issuecomment-722214429 ## CI report: * a95425118d19a5855166b1ba3ce46a4da804b3ff Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

[GitHub] [flink] flinkbot edited a comment on pull request #13929: [FLINK-17295] Make ExecutionAttemptID random again

2020-11-05 Thread GitBox
flinkbot edited a comment on pull request #13929: URL: https://github.com/apache/flink/pull/13929#issuecomment-721937043 ## CI report: * 88d4aa50d193df7676b013387e28073324a7a7e2 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

[GitHub] [flink] flinkbot commented on pull request #13935: [FLINK-18926][python][doc] Add a "Environment Variables" document under the "Python API" -> "User Guide" -> "Table API" section.

2020-11-05 Thread GitBox
flinkbot commented on pull request #13935: URL: https://github.com/apache/flink/pull/13935#issuecomment-722244949 ## CI report: * 3758f3ad3644ca64bbb7e7bb40db4db903354236 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot r

[jira] [Commented] (FLINK-19864) TwoInputStreamTaskTest.testWatermarkMetrics failed with "expected:<1> but was:<-9223372036854775808>"

2020-11-05 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17226589#comment-17226589 ] Arvid Heise commented on FLINK-19864: - >From my experience so far, there are no Azur

[GitHub] [flink] flinkbot commented on pull request #13936: [FLINK-19645][tests] Fix akka rpc timeout issue of ShuffleCompressionITCase

2020-11-05 Thread GitBox
flinkbot commented on pull request #13936: URL: https://github.com/apache/flink/pull/13936#issuecomment-722246004 ## CI report: * 55a9612f3705bc53d7159c6f14985872193ce6fb UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot r

[jira] [Commented] (FLINK-19816) Flink restored from a wrong checkpoint (a very old one and not the last completed one)

2020-11-05 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17226595#comment-17226595 ] Till Rohrmann commented on FLINK-19816: --- Hi [~stevenz3wu], thanks a lot for this a

[GitHub] [flink] curcur commented on a change in pull request #13880: [FLINK-19693][runtime] Downstream Failover for Approximate Local Recovery

2020-11-05 Thread GitBox
curcur commented on a change in pull request #13880: URL: https://github.com/apache/flink/pull/13880#discussion_r517902216 ## File path: flink-tests/src/test/java/org/apache/flink/test/checkpointing/ApproximateLocalRecoveryDownstreamITCase.java ## @@ -0,0 +1,274 @@ +/* + * Lic

[GitHub] [flink] curcur commented on a change in pull request #13880: [FLINK-19693][runtime] Downstream Failover for Approximate Local Recovery

2020-11-05 Thread GitBox
curcur commented on a change in pull request #13880: URL: https://github.com/apache/flink/pull/13880#discussion_r517902216 ## File path: flink-tests/src/test/java/org/apache/flink/test/checkpointing/ApproximateLocalRecoveryDownstreamITCase.java ## @@ -0,0 +1,274 @@ +/* + * Lic

[GitHub] [flink] curcur commented on a change in pull request #13880: [FLINK-19693][runtime] Downstream Failover for Approximate Local Recovery

2020-11-05 Thread GitBox
curcur commented on a change in pull request #13880: URL: https://github.com/apache/flink/pull/13880#discussion_r517902216 ## File path: flink-tests/src/test/java/org/apache/flink/test/checkpointing/ApproximateLocalRecoveryDownstreamITCase.java ## @@ -0,0 +1,274 @@ +/* + * Lic

[GitHub] [flink] rmetzger commented on pull request #13929: [FLINK-17295] Make ExecutionAttemptID random again

2020-11-05 Thread GitBox
rmetzger commented on pull request #13929: URL: https://github.com/apache/flink/pull/13929#issuecomment-722253765 Thanks a lot for both of your reviews. Merging! This is an automated message from the Apache Git Service. To re

[jira] [Commented] (FLINK-19699) PrometheusReporterEndToEndITCase crashes with exit code 143

2020-11-05 Thread Robert Metzger (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17226598#comment-17226598 ] Robert Metzger commented on FLINK-19699: I did some further research: Signal 143

[GitHub] [flink] rmetzger merged pull request #13929: [FLINK-17295] Make ExecutionAttemptID random again

2020-11-05 Thread GitBox
rmetzger merged pull request #13929: URL: https://github.com/apache/flink/pull/13929 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Commented] (FLINK-17295) Refactor the ExecutionAttemptID to consist of ExecutionVertexID and attemptNumber

2020-11-05 Thread Robert Metzger (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17226600#comment-17226600 ] Robert Metzger commented on FLINK-17295: I now reverted ExecutionAttemptID refac

[jira] [Commented] (FLINK-19805) LeaderChangeClusterComponentsTest.testReelectionOfJobMaster is instable

2020-11-05 Thread Robert Metzger (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17226601#comment-17226601 ] Robert Metzger commented on FLINK-19805: I'm now closing this ticket: - FLINK-17

[jira] [Closed] (FLINK-19805) LeaderChangeClusterComponentsTest.testReelectionOfJobMaster is instable

2020-11-05 Thread Robert Metzger (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger closed FLINK-19805. -- Resolution: Fixed > LeaderChangeClusterComponentsTest.testReelectionOfJobMaster is instable >

[jira] [Created] (FLINK-19994) All vertices in an DataSet iteration job will be eagerly scheduled

2020-11-05 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-19994: --- Summary: All vertices in an DataSet iteration job will be eagerly scheduled Key: FLINK-19994 URL: https://issues.apache.org/jira/browse/FLINK-19994 Project: Flink Iss

[jira] [Commented] (FLINK-19994) All vertices in an DataSet iteration job will be eagerly scheduled

2020-11-05 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17226604#comment-17226604 ] Zhu Zhu commented on FLINK-19994: - cc [~trohrmann][~azagrebin] WDYT? Correct me if I mi

[jira] [Comment Edited] (FLINK-19994) All vertices in an DataSet iteration job will be eagerly scheduled

2020-11-05 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17226604#comment-17226604 ] Zhu Zhu edited comment on FLINK-19994 at 11/5/20, 9:33 AM: --- cc

[GitHub] [flink] Myasuka commented on a change in pull request #13885: [FLINK-19911] Read checkpoint stream with buffer to speedup restore

2020-11-05 Thread GitBox
Myasuka commented on a change in pull request #13885: URL: https://github.com/apache/flink/pull/13885#discussion_r517888118 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/state/filesystem/FSDataBufferedInputStream.java ## @@ -0,0 +1,189 @@ +/* + * Licensed

[GitHub] [flink] dawidwys opened a new pull request #13940: [FLINK-18546] Upgrade to Kafka Schema Registry Client 5.5.2

2020-11-05 Thread GitBox
dawidwys opened a new pull request #13940: URL: https://github.com/apache/flink/pull/13940 ## What is the purpose of the change The PR updates the Confluent Schema Registry client version to 5.5.2. ## Brief change log 1. The PR changes the packaging of flink-avro-conflue

[jira] [Commented] (FLINK-19687) Support to get execution plan in `StatementSet`

2020-11-05 Thread Yi Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17226607#comment-17226607 ] Yi Tang commented on FLINK-19687: - It's good to expose the api to get the structured JSO

[jira] [Updated] (FLINK-18546) Upgrade to Kafka Schema Registry Client 5.5.0

2020-11-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-18546: --- Labels: Avro avro pull-request-available (was: Avro avro) > Upgrade to Kafka Schema Registr

[GitHub] [flink] flinkbot commented on pull request #13940: [FLINK-18546] Upgrade to Kafka Schema Registry Client 5.5.2

2020-11-05 Thread GitBox
flinkbot commented on pull request #13940: URL: https://github.com/apache/flink/pull/13940#issuecomment-722262027 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the pro

[GitHub] [flink] curcur commented on a change in pull request #13880: [FLINK-19693][runtime] Downstream Failover for Approximate Local Recovery

2020-11-05 Thread GitBox
curcur commented on a change in pull request #13880: URL: https://github.com/apache/flink/pull/13880#discussion_r517902216 ## File path: flink-tests/src/test/java/org/apache/flink/test/checkpointing/ApproximateLocalRecoveryDownstreamITCase.java ## @@ -0,0 +1,274 @@ +/* + * Lic

[GitHub] [flink] rmetzger commented on a change in pull request #13940: [FLINK-18546] Upgrade to Kafka Schema Registry Client 5.5.2

2020-11-05 Thread GitBox
rmetzger commented on a change in pull request #13940: URL: https://github.com/apache/flink/pull/13940#discussion_r517916430 ## File path: flink-formats/flink-sql-avro-confluent-registry/src/main/resources/META-INF/NOTICE ## @@ -0,0 +1,25 @@ +flink-sql-avro-confluent-registry

  1   2   3   4   5   6   7   >