[jira] [Comment Edited] (FLINK-34043) Remove deprecated Sink V2 interfaces

2024-09-03 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17878995#comment-17878995 ] Peter Vary edited comment on FLINK-34043 at 9/3/24 7:23 PM:

[jira] [Commented] (FLINK-34043) Remove deprecated Sink V2 interfaces

2024-09-03 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17878995#comment-17878995 ] Peter Vary commented on FLINK-34043: [~guoweijie]: It would be nice if you could rem

[jira] [Commented] (FLINK-34840) [3.1][pipeline-connectors] Add Implementation of DataSink in Iceberg.

2024-05-26 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17849623#comment-17849623 ] Peter Vary commented on FLINK-34840: If you need help with Iceberg reviews, feel fre

[jira] [Commented] (FLINK-35051) Weird priorities when processing unaligned checkpoints

2024-04-08 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17835142#comment-17835142 ] Peter Vary commented on FLINK-35051: FLINK-34704 is one of the ways this issue mater

[jira] [Commented] (FLINK-34042) Update the documentation for Sink V2

2024-02-06 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17814739#comment-17814739 ] Peter Vary commented on FLINK-34042: Currently there is no existing documentation fo

[jira] [Closed] (FLINK-33328) Allow TwoPhaseCommittingSink WithPreCommitTopology to alter the type of the Committable

2024-02-06 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary closed FLINK-33328. -- Resolution: Duplicate Solved as part of FLINK-33972 > Allow TwoPhaseCommittingSink WithPreCommitTopol

[jira] [Closed] (FLINK-34307) Release Testing Instructions: Verify FLINK-33972 Enhance and synchronize Sink API to match the Source API

2024-02-06 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary closed FLINK-34307. -- Resolution: Won't Fix [~lincoln.86xy]: Thanks for managing the release. For now, the unit tests are su

[jira] [Resolved] (FLINK-34306) Release Testing Instructions: Verify FLINK-25857 Add committer metrics to track the status of committables

2024-02-06 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary resolved FLINK-34306. Resolution: Won't Fix > Release Testing Instructions: Verify FLINK-25857 Add committer metrics to

[jira] [Commented] (FLINK-34306) Release Testing Instructions: Verify FLINK-25857 Add committer metrics to track the status of committables

2024-02-06 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17814733#comment-17814733 ] Peter Vary commented on FLINK-34306: [~lincoln.86xy]: Thanks for managing the releas

[jira] [Updated] (FLINK-25857) Add committer metrics to track the status of committables

2024-01-31 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary updated FLINK-25857: --- Release Note: The TwoPhaseCommittingSink.createCommitter method parametrization has been changed, a

[jira] [Updated] (FLINK-33973) Add new interfaces for SinkV2 to synchronize the API with the SourceV2 API

2024-01-31 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary updated FLINK-33973: --- Release Note: According to FILP-372 (https://cwiki.apache.org/confluence/display/FLINK/FLIP-372%3A+

[jira] [Created] (FLINK-34228) Add long UTF serializer/deserializer

2024-01-24 Thread Peter Vary (Jira)
Peter Vary created FLINK-34228: -- Summary: Add long UTF serializer/deserializer Key: FLINK-34228 URL: https://issues.apache.org/jira/browse/FLINK-34228 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-34209) Migrate FileSink to the new SinkV2 API

2024-01-23 Thread Peter Vary (Jira)
Peter Vary created FLINK-34209: -- Summary: Migrate FileSink to the new SinkV2 API Key: FLINK-34209 URL: https://issues.apache.org/jira/browse/FLINK-34209 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-34208) Migrate SinkV1Adapter to the new SinkV2 API

2024-01-23 Thread Peter Vary (Jira)
Peter Vary created FLINK-34208: -- Summary: Migrate SinkV1Adapter to the new SinkV2 API Key: FLINK-34208 URL: https://issues.apache.org/jira/browse/FLINK-34208 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-34043) Remove deprecated Sink V2 interfaces

2024-01-09 Thread Peter Vary (Jira)
Peter Vary created FLINK-34043: -- Summary: Remove deprecated Sink V2 interfaces Key: FLINK-34043 URL: https://issues.apache.org/jira/browse/FLINK-34043 Project: Flink Issue Type: Sub-task

[jira] [Updated] (FLINK-34042) Update the documentation for Sink V2

2024-01-09 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary updated FLINK-34042: --- Description: Check the documentation and update the Sink V2 API usages whenever it is needed > Upda

[jira] [Created] (FLINK-34042) Update the documentation

2024-01-09 Thread Peter Vary (Jira)
Peter Vary created FLINK-34042: -- Summary: Update the documentation Key: FLINK-34042 URL: https://issues.apache.org/jira/browse/FLINK-34042 Project: Flink Issue Type: Sub-task Report

[jira] [Updated] (FLINK-34042) Update the documentation for Sink V2

2024-01-09 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary updated FLINK-34042: --- Summary: Update the documentation for Sink V2 (was: Update the documentation ) > Update the docume

[jira] [Created] (FLINK-33975) Tests for the new Sink V2 transformations

2024-01-03 Thread Peter Vary (Jira)
Peter Vary created FLINK-33975: -- Summary: Tests for the new Sink V2 transformations Key: FLINK-33975 URL: https://issues.apache.org/jira/browse/FLINK-33975 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-33974) Implement the Sink transformation depending on the new SinkV2 interfaces

2024-01-03 Thread Peter Vary (Jira)
Peter Vary created FLINK-33974: -- Summary: Implement the Sink transformation depending on the new SinkV2 interfaces Key: FLINK-33974 URL: https://issues.apache.org/jira/browse/FLINK-33974 Project: Flink

[jira] [Created] (FLINK-33973) Add new interfaces for SinkV2 to synchronize the API with the SourceV2 API

2024-01-03 Thread Peter Vary (Jira)
Peter Vary created FLINK-33973: -- Summary: Add new interfaces for SinkV2 to synchronize the API with the SourceV2 API Key: FLINK-33973 URL: https://issues.apache.org/jira/browse/FLINK-33973 Project: Flink

[jira] [Created] (FLINK-33972) Enhance and synchronize Sink API to match the Source API

2024-01-03 Thread Peter Vary (Jira)
Peter Vary created FLINK-33972: -- Summary: Enhance and synchronize Sink API to match the Source API Key: FLINK-33972 URL: https://issues.apache.org/jira/browse/FLINK-33972 Project: Flink Issue Ty

[jira] [Commented] (FLINK-33528) Externalize Python connector code

2023-12-21 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17799320#comment-17799320 ] Peter Vary commented on FLINK-33528: [~Sergey Nuyanzin]: FLINK-33762 is needed, so t

[jira] [Commented] (FLINK-33523) DataType ARRAY fails to cast into Object[]

2023-12-07 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17794128#comment-17794128 ] Peter Vary commented on FLINK-33523: Created a thread about this topic on the mailin

[jira] [Created] (FLINK-33762) Versioned release of flink-connector-shared-utils python scripts

2023-12-06 Thread Peter Vary (Jira)
Peter Vary created FLINK-33762: -- Summary: Versioned release of flink-connector-shared-utils python scripts Key: FLINK-33762 URL: https://issues.apache.org/jira/browse/FLINK-33762 Project: Flink

[jira] [Commented] (FLINK-25857) Add committer metrics to track the status of committables

2023-11-27 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17789963#comment-17789963 ] Peter Vary commented on FLINK-25857: If you check the discussion [1] the diamond inh

[jira] [Commented] (FLINK-25857) Add committer metrics to track the status of committables

2023-11-23 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17789335#comment-17789335 ] Peter Vary commented on FLINK-25857: For the Iceberg connector we release separate v

[jira] [Commented] (FLINK-33568) SinkV2MetricsITCase.testCommitterMetrics fails with NullPointerException

2023-11-16 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17786947#comment-17786947 ] Peter Vary commented on FLINK-33568: With the patch it looks like this: !Screenshot

[jira] [Updated] (FLINK-33568) SinkV2MetricsITCase.testCommitterMetrics fails with NullPointerException

2023-11-16 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary updated FLINK-33568: --- Attachment: Screenshot 2023-11-16 at 22.30.51.png > SinkV2MetricsITCase.testCommitterMetrics fails w

[jira] [Commented] (FLINK-33568) SinkV2MetricsITCase.testCommitterMetrics fails with NullPointerException

2023-11-16 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17786814#comment-17786814 ] Peter Vary commented on FLINK-33568: Checking > SinkV2MetricsITCase.testCommitterMe

[jira] [Comment Edited] (FLINK-33295) Separate SinkV2 and SinkV1Adapter tests

2023-11-09 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17784689#comment-17784689 ] Peter Vary edited comment on FLINK-33295 at 11/10/23 6:23 AM:

[jira] [Commented] (FLINK-33295) Separate SinkV2 and SinkV1Adapter tests

2023-11-09 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17784689#comment-17784689 ] Peter Vary commented on FLINK-33295: `InternalSinkWriterMetricGroup` is an initial c

[jira] [Created] (FLINK-33328) Allow TwoPhaseCommittingSink WithPreCommitTopology to alter the type of the Committable

2023-10-20 Thread Peter Vary (Jira)
Peter Vary created FLINK-33328: -- Summary: Allow TwoPhaseCommittingSink WithPreCommitTopology to alter the type of the Committable Key: FLINK-33328 URL: https://issues.apache.org/jira/browse/FLINK-33328 P

[jira] [Created] (FLINK-33295) Separate SinkV2 and SinkV1Adapter tests

2023-10-17 Thread Peter Vary (Jira)
Peter Vary created FLINK-33295: -- Summary: Separate SinkV2 and SinkV1Adapter tests Key: FLINK-33295 URL: https://issues.apache.org/jira/browse/FLINK-33295 Project: Flink Issue Type: Sub-task

[jira] [Updated] (FLINK-32046) OOM caused by SplitAssignmentTracker.uncheckpointedAssignments

2023-05-10 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary updated FLINK-32046: --- Description: If the checkpointing is turned off then the {{SplitAssignmentTracker.uncheckpointedAss

[jira] [Created] (FLINK-32046) OOM caused by SplitAssignmentTracker.uncheckpointedAssignments

2023-05-10 Thread Peter Vary (Jira)
Peter Vary created FLINK-32046: -- Summary: OOM caused by SplitAssignmentTracker.uncheckpointedAssignments Key: FLINK-32046 URL: https://issues.apache.org/jira/browse/FLINK-32046 Project: Flink I

[jira] [Created] (FLINK-31868) Fix DefaultInputSplitAssigner javadoc for class

2023-04-20 Thread Peter Vary (Jira)
Peter Vary created FLINK-31868: -- Summary: Fix DefaultInputSplitAssigner javadoc for class Key: FLINK-31868 URL: https://issues.apache.org/jira/browse/FLINK-31868 Project: Flink Issue Type: Impro

[jira] [Updated] (FLINK-31246) Beautify the SpecChange message

2023-03-01 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary updated FLINK-31246: --- Summary: Beautify the SpecChange message (was: Remove PodTemplate description from the SpecChange m

[jira] [Comment Edited] (FLINK-31246) Remove PodTemplate description from the SpecChange message

2023-02-28 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17694443#comment-17694443 ] Peter Vary edited comment on FLINK-31246 at 2/28/23 8:57 AM: -

[jira] [Commented] (FLINK-31246) Remove PodTemplate description from the SpecChange message

2023-02-28 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17694443#comment-17694443 ] Peter Vary commented on FLINK-31246: Talked with [~gyfora] about this, and he is con

[jira] [Created] (FLINK-31246) Remove PodTemplate description from the SpecChange message

2023-02-27 Thread Peter Vary (Jira)
Peter Vary created FLINK-31246: -- Summary: Remove PodTemplate description from the SpecChange message Key: FLINK-31246 URL: https://issues.apache.org/jira/browse/FLINK-31246 Project: Flink Issue

[jira] [Updated] (FLINK-30543) Adding more examples for setting up jobs via operator.

2023-01-03 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary updated FLINK-30543: --- Component/s: Kubernetes Operator > Adding more examples for setting up jobs via operator. >

[jira] [Commented] (FLINK-30367) Enrich the thread dump info with deeper stack

2022-12-12 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17646136#comment-17646136 ] Peter Vary commented on FLINK-30367: The depth of the stack trace could be set by th

[jira] [Updated] (FLINK-30315) Add more information about image pull failures to the operator log

2022-12-06 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary updated FLINK-30315: --- Description: When there is an image pull error, this is what we see in the operator log: {code:java}

[jira] [Commented] (FLINK-30315) Add more information about image pull failures to the operator log

2022-12-06 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17643909#comment-17643909 ] Peter Vary commented on FLINK-30315: The {{ContainerStateWaiting}} contains the mess

[jira] [Created] (FLINK-30315) Add more information about image pull failures to the operator log

2022-12-06 Thread Peter Vary (Jira)
Peter Vary created FLINK-30315: -- Summary: Add more information about image pull failures to the operator log Key: FLINK-30315 URL: https://issues.apache.org/jira/browse/FLINK-30315 Project: Flink

[jira] [Created] (FLINK-30311) CI error: Back-off pulling image "flink:1.14"

2022-12-06 Thread Peter Vary (Jira)
Peter Vary created FLINK-30311: -- Summary: CI error: Back-off pulling image "flink:1.14" Key: FLINK-30311 URL: https://issues.apache.org/jira/browse/FLINK-30311 Project: Flink Issue Type: Sub-tas

[jira] [Commented] (FLINK-30150) Evaluate operator error log whitelist entry: REST service in session cluster is bad now

2022-12-05 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17643305#comment-17643305 ] Peter Vary commented on FLINK-30150: This is the exception in the logs: {code:java}

[jira] [Created] (FLINK-30199) Add a script to run Kubernetes Operator e2e tests manually

2022-11-24 Thread Peter Vary (Jira)
Peter Vary created FLINK-30199: -- Summary: Add a script to run Kubernetes Operator e2e tests manually Key: FLINK-30199 URL: https://issues.apache.org/jira/browse/FLINK-30199 Project: Flink Issue

[jira] [Commented] (FLINK-29629) FlameGraph is empty for Legacy Source Threads

2022-11-07 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17629824#comment-17629824 ] Peter Vary commented on FLINK-29629: Most probably I will not have time to work on t

[jira] [Commented] (FLINK-29754) HadoopConfigLoader should consider Hadoop configuration files

2022-10-25 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17623882#comment-17623882 ] Peter Vary commented on FLINK-29754: [This|https://github.com/apache/flink/blob/0e61

[jira] [Commented] (FLINK-29754) HadoopConfigLoader should consider Hadoop configuration files

2022-10-25 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17623704#comment-17623704 ] Peter Vary commented on FLINK-29754: I create a configuration file like this: {code:

[jira] [Created] (FLINK-29754) HadoopConfigLoader should consider Hadoop configuration files

2022-10-25 Thread Peter Vary (Jira)
Peter Vary created FLINK-29754: -- Summary: HadoopConfigLoader should consider Hadoop configuration files Key: FLINK-29754 URL: https://issues.apache.org/jira/browse/FLINK-29754 Project: Flink Is

[jira] [Commented] (FLINK-29629) FlameGraph is empty for Legacy Source Threads

2022-10-25 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17623647#comment-17623647 ] Peter Vary commented on FLINK-29629: Thanks [~zhuzh]! Thanks for the info, I checke

[jira] [Commented] (FLINK-29713) Kubernetes operator should restart failed jobs

2022-10-21 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17622561#comment-17622561 ] Peter Vary commented on FLINK-29713: The main goal is to have a possibility to add a

[jira] [Created] (FLINK-29713) Kubernetes operator should restart failed jobs

2022-10-21 Thread Peter Vary (Jira)
Peter Vary created FLINK-29713: -- Summary: Kubernetes operator should restart failed jobs Key: FLINK-29713 URL: https://issues.apache.org/jira/browse/FLINK-29713 Project: Flink Issue Type: Improv

[jira] [Commented] (FLINK-29629) FlameGraph is empty for Legacy Source Threads

2022-10-17 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17619053#comment-17619053 ] Peter Vary commented on FLINK-29629: [~chesnay]: Does that mean that some of the cod

[jira] [Created] (FLINK-29629) FlameGraph is empty for Legacy Source Threads

2022-10-13 Thread Peter Vary (Jira)
Peter Vary created FLINK-29629: -- Summary: FlameGraph is empty for Legacy Source Threads Key: FLINK-29629 URL: https://issues.apache.org/jira/browse/FLINK-29629 Project: Flink Issue Type: Bug

[jira] [Updated] (FLINK-29123) Dynamic paramters are not pushed to working with kubernetes

2022-08-26 Thread Peter Vary (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary updated FLINK-29123: --- Summary: Dynamic paramters are not pushed to working with kubernetes (was: Dynamic paramters are no

[jira] [Created] (FLINK-29123) Dynamic paramters are not pushed to working with kubertenes

2022-08-26 Thread Peter Vary (Jira)
Peter Vary created FLINK-29123: -- Summary: Dynamic paramters are not pushed to working with kubertenes Key: FLINK-29123 URL: https://issues.apache.org/jira/browse/FLINK-29123 Project: Flink Issu