[jira] [Updated] (FLINK-10981) Add or modify metrics to show the maximum usage of InputBufferPool/OutputBufferPool to help debugging back pressure

[ https://issues.apache.org/jira/browse/FLINK-10981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-10981: Description: Currently the network layer has provided two metrics items, namely _InputBufferPoolUsageGaug

[jira] [Created] (FLINK-10981) Add or modify metrics to show the maximum usage of InputBufferPool/OutputBufferPool to help debugging back pressure

Yun Gao created FLINK-10981: --- Summary: Add or modify metrics to show the maximum usage of InputBufferPool/OutputBufferPool to help debugging back pressure Key: FLINK-10981 URL: https://issues.apache.org/jira/browse/FLIN

[jira] [Updated] (FLINK-10981) Add or modify metrics to show the maximum usage of InputBufferPool/OutputBufferPool to help debugging back pressure

[ https://issues.apache.org/jira/browse/FLINK-10981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-10981: Description: Currently the network layer has provided two metrics items, namely _InputBufferPoolUsageGaug

[jira] [Commented] (FLINK-10981) Add or modify metrics to show the maximum usage of InputBufferPool/OutputBufferPool to help debugging back pressure

[ https://issues.apache.org/jira/browse/FLINK-10981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16698657#comment-16698657 ] Yun Gao commented on FLINK-10981: - Yes, I think so.    For back pressure monitor, if t

[jira] [Created] (FLINK-10469) FileChannel may not write the whole buffer in a single call to FileChannel.write(Buffer buffer)

Yun Gao created FLINK-10469: --- Summary: FileChannel may not write the whole buffer in a single call to FileChannel.write(Buffer buffer) Key: FLINK-10469 URL: https://issues.apache.org/jira/browse/FLINK-10469

[jira] [Assigned] (FLINK-10469) FileChannel may not write the whole buffer in a single call to FileChannel.write(Buffer buffer)

[ https://issues.apache.org/jira/browse/FLINK-10469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao reassigned FLINK-10469: --- Assignee: Yun Gao > FileChannel may not write the whole buffer in a single call to > FileChannel.w

[jira] [Commented] (FLINK-10469) FileChannel may not write the whole buffer in a single call to FileChannel.write(Buffer buffer)

[ https://issues.apache.org/jira/browse/FLINK-10469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638121#comment-16638121 ] Yun Gao commented on FLINK-10469: - [~NicoK] [~pnowojski] Sorry for responding later. I f

[jira] [Commented] (FLINK-10469) FileChannel may not write the whole buffer in a single call to FileChannel.write(Buffer buffer)

[ https://issues.apache.org/jira/browse/FLINK-10469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638378#comment-16638378 ] Yun Gao commented on FLINK-10469: - I commented on the pull request, but it seems that th

[jira] [Commented] (FLINK-14186) Nightly e2e-misc-jdk11 fails complaining unrecognized VM option

[ https://issues.apache.org/jira/browse/FLINK-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16938235#comment-16938235 ] Yun Gao commented on FLINK-14186: - The reason of this issue is that -XX:+UseParNewGC [ha

[jira] [Commented] (FLINK-14186) Nightly e2e-misc-jdk11 fails complaining unrecognized VM option

[ https://issues.apache.org/jira/browse/FLINK-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16938319#comment-16938319 ] Yun Gao commented on FLINK-14186: - I have tested the elastic search e2e test cases local

[jira] [Comment Edited] (FLINK-14186) Nightly e2e-misc-jdk11 fails complaining unrecognized VM option

[ https://issues.apache.org/jira/browse/FLINK-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16938235#comment-16938235 ] Yun Gao edited comment on FLINK-14186 at 9/26/19 5:19 PM: -- The

[jira] [Commented] (FLINK-14186) Nightly e2e-misc-jdk11 fails complaining unrecognized VM option

[ https://issues.apache.org/jira/browse/FLINK-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16938825#comment-16938825 ] Yun Gao commented on FLINK-14186: - With the discussion under the [PR|[https://github.com

[jira] [Commented] (FLINK-10672) Task stuck while writing output to flink

[ https://issues.apache.org/jira/browse/FLINK-10672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939094#comment-16939094 ] Yun Gao commented on FLINK-10672: - Hi [~ibzib],  very sorry for not very familiar with B

[jira] [Commented] (FLINK-10672) Task stuck while writing output to flink

[ https://issues.apache.org/jira/browse/FLINK-10672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940226#comment-16940226 ] Yun Gao commented on FLINK-10672: - Hi [~mxm], very thanks for the explanation. Besides,

[jira] [Commented] (FLINK-10672) Task stuck while writing output to flink

[ https://issues.apache.org/jira/browse/FLINK-10672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946410#comment-16946410 ] Yun Gao commented on FLINK-10672: - Hi [~angoenka] Very thanks for the input and very sor

[jira] [Updated] (FLINK-10672) Task stuck while writing output to flink

[ https://issues.apache.org/jira/browse/FLINK-10672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-10672: Attachment: 0.14_all_jobs.jpg > Task stuck while writing output to flink > ---

[jira] [Commented] (FLINK-10672) Task stuck while writing output to flink

[ https://issues.apache.org/jira/browse/FLINK-10672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16951507#comment-16951507 ] Yun Gao commented on FLINK-10672: - Hi [~angoenka], very sorry for the long delay because

[jira] [Commented] (FLINK-12171) The network buffer memory size should not be checked against the heap size on the TM side

[ https://issues.apache.org/jira/browse/FLINK-12171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16849304#comment-16849304 ] Yun Gao commented on FLINK-12171: - After further analyze this problem, now I think we do

[jira] [Updated] (FLINK-12765) JobMaster calculates resource needs and requests slot for the entire slot sharing group.

[ https://issues.apache.org/jira/browse/FLINK-12765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-12765: Description: In this version, a task will always requests slot with its own resource need. If the resourc

[jira] [Commented] (FLINK-12171) The network buffer memory size should not be checked against the heap size on the TM side

[ https://issues.apache.org/jira/browse/FLINK-12171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16862937#comment-16862937 ] Yun Gao commented on FLINK-12171: - [~pnowojski]  very sorry to disturb, but I would like

[jira] [Created] (FLINK-12852) Deadlock occurs when requiring exclusive buffer for RemoteInputChannel

Yun Gao created FLINK-12852: --- Summary: Deadlock occurs when requiring exclusive buffer for RemoteInputChannel Key: FLINK-12852 URL: https://issues.apache.org/jira/browse/FLINK-12852 Project: Flink

[jira] [Updated] (FLINK-12852) Deadlock occurs when requiring exclusive buffer for RemoteInputChannel

[ https://issues.apache.org/jira/browse/FLINK-12852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-12852: Component/s: Runtime / Network > Deadlock occurs when requiring exclusive buffer for RemoteInputChannel >

[jira] [Created] (FLINK-12865) State inconsistency between RM and TM on the slot status

Yun Gao created FLINK-12865: --- Summary: State inconsistency between RM and TM on the slot status Key: FLINK-12865 URL: https://issues.apache.org/jira/browse/FLINK-12865 Project: Flink Issue Type: Bu

[jira] [Commented] (FLINK-12865) State inconsistency between RM and TM on the slot status

[ https://issues.apache.org/jira/browse/FLINK-12865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16865296#comment-16865296 ] Yun Gao commented on FLINK-12865: - I think adding a version to the slot may solves this

[jira] [Updated] (FLINK-12865) State inconsistency between RM and TM on the slot status

[ https://issues.apache.org/jira/browse/FLINK-12865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-12865: Description: There may be state inconsistency between TM and RM due to race condition and message loss:

[jira] [Updated] (FLINK-12865) State inconsistency between RM and TM on the slot status

[ https://issues.apache.org/jira/browse/FLINK-12865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-12865: Description: There may be state inconsistency between TM and RM due to race condition and message loss:

[jira] [Commented] (FLINK-12863) Race condition between slot offerings and AllocatedSlotReport

[ https://issues.apache.org/jira/browse/FLINK-12863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16865333#comment-16865333 ] Yun Gao commented on FLINK-12863: - Hi all, I create a Jira for the state inconsistency b

[jira] [Updated] (FLINK-12171) The network buffer memory size should not be checked against the heap size on the TM side

[ https://issues.apache.org/jira/browse/FLINK-12171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-12171: Description: Currently when computing the network buffer memory size on the TM side in _TaskManagerServic

[jira] [Commented] (FLINK-12865) State inconsistency between RM and TM on the slot status

[ https://issues.apache.org/jira/browse/FLINK-12865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16866199#comment-16866199 ] Yun Gao commented on FLINK-12865: - [~till.rohrmann] Hi Till, thanks a lot for the explan

[jira] [Comment Edited] (FLINK-12865) State inconsistency between RM and TM on the slot status

[ https://issues.apache.org/jira/browse/FLINK-12865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16866199#comment-16866199 ] Yun Gao edited comment on FLINK-12865 at 6/18/19 3:52 AM: -- [~ti

[jira] [Commented] (FLINK-33128) TestValuesRuntimeFunctions$TestValuesLookupFunction does not call open() on converter

[ https://issues.apache.org/jira/browse/FLINK-33128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17779959#comment-17779959 ] Yun Gao commented on FLINK-33128: - Merged on master via f31770fcf5769052f1ac32a6529de979

[jira] [Assigned] (FLINK-33128) TestValuesRuntimeFunctions$TestValuesLookupFunction does not call open() on converter

[ https://issues.apache.org/jira/browse/FLINK-33128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao reassigned FLINK-33128: --- Assignee: Jerome Gagnon > TestValuesRuntimeFunctions$TestValuesLookupFunction does not call open()

[jira] [Updated] (FLINK-33128) TestValuesRuntimeFunctions$TestValuesLookupFunction does not call open() on converter

[ https://issues.apache.org/jira/browse/FLINK-33128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-33128: Affects Version/s: 1.19.0 (was: 1.16.2) > TestValuesRuntimeFunctions$TestValues

[jira] [Resolved] (FLINK-33128) TestValuesRuntimeFunctions$TestValuesLookupFunction does not call open() on converter

[ https://issues.apache.org/jira/browse/FLINK-33128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao resolved FLINK-33128. - Resolution: Fixed > TestValuesRuntimeFunctions$TestValuesLookupFunction does not call open() on > conve

[jira] [Closed] (FLINK-33128) TestValuesRuntimeFunctions$TestValuesLookupFunction does not call open() on converter

[ https://issues.apache.org/jira/browse/FLINK-33128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao closed FLINK-33128. --- > TestValuesRuntimeFunctions$TestValuesLookupFunction does not call open() on > converter > ---

[jira] [Commented] (FLINK-20208) Remove outdated in-progress files in StreamingFileSink

[ https://issues.apache.org/jira/browse/FLINK-20208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17240864#comment-17240864 ] Yun Gao commented on FLINK-20208: - Hi [~trushev] Very sorry for the late reply for think

[jira] [Comment Edited] (FLINK-20208) Remove outdated in-progress files in StreamingFileSink

[ https://issues.apache.org/jira/browse/FLINK-20208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17240864#comment-17240864 ] Yun Gao edited comment on FLINK-20208 at 11/30/20, 4:42 PM:

[jira] [Commented] (FLINK-20375) Add a switch to control the operator name in SQL

[ https://issues.apache.org/jira/browse/FLINK-20375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17240866#comment-17240866 ] Yun Gao commented on FLINK-20375: - Hi [~jark], the task name is computed in _StreamingJ

[jira] [Comment Edited] (FLINK-20208) Remove outdated in-progress files in StreamingFileSink

[ https://issues.apache.org/jira/browse/FLINK-20208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17240864#comment-17240864 ] Yun Gao edited comment on FLINK-20208 at 11/30/20, 4:48 PM:

[jira] [Commented] (FLINK-19398) Hive connector fails with IllegalAccessError if submitted as usercode

[ https://issues.apache.org/jira/browse/FLINK-19398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17242014#comment-17242014 ] Yun Gao commented on FLINK-19398: - OK, I'll open the PR, very sorry for not noticed the

[jira] [Commented] (FLINK-20476) New File Sink end-to-end test Failed

[ https://issues.apache.org/jira/browse/FLINK-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17244020#comment-17244020 ] Yun Gao commented on FLINK-20476: - I'll have a look, very sorry for the inconvenient...

[jira] [Commented] (FLINK-20476) New File Sink end-to-end test Failed

[ https://issues.apache.org/jira/browse/FLINK-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17244030#comment-17244030 ] Yun Gao commented on FLINK-20476: - A quick look of the above instances shows that almost

[jira] [Resolved] (FLINK-20122) Test Small file compaction

[ https://issues.apache.org/jira/browse/FLINK-20122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao resolved FLINK-20122. - Resolution: Fixed > Test Small file compaction > -- > > Key: FLI

[jira] [Closed] (FLINK-20122) Test Small file compaction

[ https://issues.apache.org/jira/browse/FLINK-20122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao closed FLINK-20122. --- > Test Small file compaction > -- > > Key: FLINK-20122 >

[jira] [Commented] (FLINK-16582) NettyBufferPoolTest may have warns on NettyBuffer leak

[ https://issues.apache.org/jira/browse/FLINK-16582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17245091#comment-17245091 ] Yun Gao commented on FLINK-16582: - Hi [~AHeise], very sorry for the long delay, I'll ope

[jira] [Commented] (FLINK-2491) Checkpointing only works if all operators/tasks are still running

[ https://issues.apache.org/jira/browse/FLINK-2491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248586#comment-17248586 ] Yun Gao commented on FLINK-2491: Hi [~swapnilkhante], very thanks for the attention! We a

[jira] [Commented] (FLINK-2491) Checkpointing only works if all operators/tasks are still running

[ https://issues.apache.org/jira/browse/FLINK-2491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17250134#comment-17250134 ] Yun Gao commented on FLINK-2491: Hi [~swapnilkhante], very sorry for the late reply. For

[jira] [Commented] (FLINK-20476) New File Sink end-to-end test Failed

[ https://issues.apache.org/jira/browse/FLINK-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17251572#comment-17251572 ] Yun Gao commented on FLINK-20476: -  Yes, there should be something changed at that time,

[jira] [Commented] (FLINK-20476) New File Sink end-to-end test Failed

[ https://issues.apache.org/jira/browse/FLINK-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252093#comment-17252093 ] Yun Gao commented on FLINK-20476: - Hi [~hxbks2ks], very thanks for reporting the issues!

[jira] [Commented] (FLINK-20476) New File Sink end-to-end test Failed

[ https://issues.apache.org/jira/browse/FLINK-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252095#comment-17252095 ] Yun Gao commented on FLINK-20476: - It also seems there is always one TaskManager keep it

[jira] [Commented] (FLINK-20476) New File Sink end-to-end test Failed

[ https://issues.apache.org/jira/browse/FLINK-20476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252586#comment-17252586 ] Yun Gao commented on FLINK-20476: - Very thanks [~xintongsong] for investigating the issu

[jira] [Commented] (FLINK-19701) Unaligned Checkpoint might misuse the number of buffers to persist from the previous barrier

[ https://issues.apache.org/jira/browse/FLINK-19701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225034#comment-17225034 ] Yun Gao commented on FLINK-19701: - Hi [~roman_khachatryan] very thanks investigating the

[jira] [Commented] (FLINK-20006) FileSinkITCase.testFileSink: The record 0 should occur 4 times, but only occurs 8time expected:<4> but was:<8>

[ https://issues.apache.org/jira/browse/FLINK-20006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17226803#comment-17226803 ] Yun Gao commented on FLINK-20006: - Very sorry for the inconvenient brought, I'll have a

[jira] [Created] (FLINK-20032) Make FileSink support processing time

Yun Gao created FLINK-20032: --- Summary: Make FileSink support processing time Key: FLINK-20032 URL: https://issues.apache.org/jira/browse/FLINK-20032 Project: Flink Issue Type: Sub-task

[jira] [Commented] (FLINK-19850) Add E2E tests for the new streaming case of the new FileSink

[ https://issues.apache.org/jira/browse/FLINK-19850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227624#comment-17227624 ] Yun Gao commented on FLINK-19850: - Very sorry for future broke the test... :( I'll re-ch

[jira] [Commented] (FLINK-20039) Streaming File Sink end-to-end test is unstable on Azure

[ https://issues.apache.org/jira/browse/FLINK-20039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227824#comment-17227824 ] Yun Gao commented on FLINK-20039: - Very sorry for the inconvenience brought :( The origi

[jira] [Commented] (FLINK-20006) FileSinkITCase.testFileSink: The record 0 should occur 4 times, but only occurs 8time expected:<4> but was:<8>

[ https://issues.apache.org/jira/browse/FLINK-20006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17228325#comment-17228325 ] Yun Gao commented on FLINK-20006: - The latter issue should also get fixed now. > FileSi

[jira] [Commented] (FLINK-20039) Streaming File Sink end-to-end test is unstable on Azure

[ https://issues.apache.org/jira/browse/FLINK-20039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17228420#comment-17228420 ] Yun Gao commented on FLINK-20039: - Yes, the issue has been fixed now. > Streaming File

[jira] [Resolved] (FLINK-20039) Streaming File Sink end-to-end test is unstable on Azure

[ https://issues.apache.org/jira/browse/FLINK-20039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao resolved FLINK-20039. - Resolution: Fixed > Streaming File Sink end-to-end test is unstable on Azure > -

[jira] [Commented] (FLINK-20039) Streaming File Sink end-to-end test is unstable on Azure

[ https://issues.apache.org/jira/browse/FLINK-20039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17228421#comment-17228421 ] Yun Gao commented on FLINK-20039: - I'll then close it.  > Streaming File Sink end-to-en

[jira] [Closed] (FLINK-20039) Streaming File Sink end-to-end test is unstable on Azure

[ https://issues.apache.org/jira/browse/FLINK-20039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao closed FLINK-20039. --- Close this issue, the original bugful PR is reverted and new PR merged as  a6bea224ed012e5594ee755526f54ae7f3b0d

[jira] [Commented] (FLINK-19968) Exception in thread "main" java.lang.IllegalStateException: No ExecutorFactory found to execute the application.

[ https://issues.apache.org/jira/browse/FLINK-19968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17229944#comment-17229944 ] Yun Gao commented on FLINK-19968: - Hi [~GodZ], could you run _unzip -l _ to list the con

[jira] [Commented] (FLINK-20082) Cannot start Flink application due to "cannot assign instance of java.lang.invoke.SerializedLambda to type scala.Function1

[ https://issues.apache.org/jira/browse/FLINK-20082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17229974#comment-17229974 ] Yun Gao commented on FLINK-20082: - [~czchen] Hello, could you also share some more infor

[jira] [Commented] (FLINK-20082) Cannot start Flink application due to "cannot assign instance of java.lang.invoke.SerializedLambda to type scala.Function1

[ https://issues.apache.org/jira/browse/FLINK-20082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17230813#comment-17230813 ] Yun Gao commented on FLINK-20082: - Hi [~czchen] Sorry I tried but I still not yet be abl

[jira] [Created] (FLINK-20172) Unify the behavior for file committers when the source or dest files are not exists

Yun Gao created FLINK-20172: --- Summary: Unify the behavior for file committers when the source or dest files are not exists Key: FLINK-20172 URL: https://issues.apache.org/jira/browse/FLINK-20172 Project: Fl

[jira] [Updated] (FLINK-20172) Unify the behavior for file committers when the source or dest files are not exists

[ https://issues.apache.org/jira/browse/FLINK-20172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-20172: Component/s: Connectors / FileSystem > Unify the behavior for file committers when the source or dest file

[jira] [Created] (FLINK-20180) Translation the FileSink Document into Chinese

Yun Gao created FLINK-20180: --- Summary: Translation the FileSink Document into Chinese Key: FLINK-20180 URL: https://issues.apache.org/jira/browse/FLINK-20180 Project: Flink Issue Type: Sub-task

[jira] [Commented] (FLINK-19398) Hive connector fails with IllegalAccessError if submitted as usercode

[ https://issues.apache.org/jira/browse/FLINK-19398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17233430#comment-17233430 ] Yun Gao commented on FLINK-19398: - Hi I opened a PR for this issue. Currently I leave _

[jira] [Commented] (FLINK-20208) Remove outdated in-progress files in StreamingFileSink

[ https://issues.apache.org/jira/browse/FLINK-20208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17234754#comment-17234754 ] Yun Gao commented on FLINK-20208: - Hi [~trushev], very thanks for bringing this up, and

[jira] [Commented] (FLINK-20208) Remove outdated in-progress files in StreamingFileSink

[ https://issues.apache.org/jira/browse/FLINK-20208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17235430#comment-17235430 ] Yun Gao commented on FLINK-20208: - Hi [~trushev] very thanks for more investigation! I t

[jira] [Comment Edited] (FLINK-20208) Remove outdated in-progress files in StreamingFileSink

[ https://issues.apache.org/jira/browse/FLINK-20208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17235430#comment-17235430 ] Yun Gao edited comment on FLINK-20208 at 11/19/20, 12:51 PM: -

[jira] [Updated] (FLINK-20180) Translation the FileSink Document into Chinese

[ https://issues.apache.org/jira/browse/FLINK-20180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-20180: Fix Version/s: 1.12.0 > Translation the FileSink Document into Chinese > -

[jira] [Created] (FLINK-20291) Optimize the exception message of FileSystemTableSink when missing format dependencies

Yun Gao created FLINK-20291: --- Summary: Optimize the exception message of FileSystemTableSink when missing format dependencies Key: FLINK-20291 URL: https://issues.apache.org/jira/browse/FLINK-20291 Project:

[jira] [Created] (FLINK-20292) Avro format conflicts with Parquet and Orc

Yun Gao created FLINK-20292: --- Summary: Avro format conflicts with Parquet and Orc Key: FLINK-20292 URL: https://issues.apache.org/jira/browse/FLINK-20292 Project: Flink Issue Type: Bug

[jira] [Updated] (FLINK-20292) Avro format conflicts with Parquet and Orc

[ https://issues.apache.org/jira/browse/FLINK-20292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-20292: Description: When testing the Flink 1.12 in a standalone mode cluster, I found that if the user job jar c

[jira] [Updated] (FLINK-20292) Avro format conflicts with Parquet and Orc

[ https://issues.apache.org/jira/browse/FLINK-20292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-20292: Description: When testing the Flink 1.12 in a standalone mode cluster, I found that if the user job jar c

[jira] [Created] (FLINK-20295) File Source lost data when reading from directories created by FileSystemTableSink with JSON format

Yun Gao created FLINK-20295: --- Summary: File Source lost data when reading from directories created by FileSystemTableSink with JSON format Key: FLINK-20295 URL: https://issues.apache.org/jira/browse/FLINK-20295

[jira] [Updated] (FLINK-20295) File Source lost data when reading from directories created by FileSystemTableSink with JSON format

[ https://issues.apache.org/jira/browse/FLINK-20295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-20295: Attachment: compaction.tgz > File Source lost data when reading from directories created by > FileSystemT

[jira] [Commented] (FLINK-20295) File Source lost data when reading from directories created by FileSystemTableSink with JSON format

[ https://issues.apache.org/jira/browse/FLINK-20295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17237766#comment-17237766 ] Yun Gao commented on FLINK-20295: - Ok, no problem, I'll implement a minimal example. >

[jira] [Commented] (FLINK-20292) Avro format conflicts with Parquet and Orc

[ https://issues.apache.org/jira/browse/FLINK-20292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17237832#comment-17237832 ] Yun Gao commented on FLINK-20292: - Very thanks [~lzljs3620320] for the explanation! And

[jira] [Comment Edited] (FLINK-20295) File Source lost data when reading from directories created by FileSystemTableSink with JSON format

[ https://issues.apache.org/jira/browse/FLINK-20295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17237850#comment-17237850 ] Yun Gao edited comment on FLINK-20295 at 11/24/20, 4:20 AM:

[jira] [Commented] (FLINK-20295) File Source lost data when reading from directories created by FileSystemTableSink with JSON format

[ https://issues.apache.org/jira/browse/FLINK-20295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17237850#comment-17237850 ] Yun Gao commented on FLINK-20295: - Hi [~sewen], the minimal example is submitted: [The m

[jira] [Commented] (FLINK-20295) File Source lost data when reading from directories created by FileSystemTableSink with JSON format

[ https://issues.apache.org/jira/browse/FLINK-20295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17237883#comment-17237883 ] Yun Gao commented on FLINK-20295: - Hi [~lzljs3620320] Very thanks for reporting this iss

[jira] [Issue Comment Deleted] (FLINK-20295) File Source lost data when reading from directories created by FileSystemTableSink with JSON format

[ https://issues.apache.org/jira/browse/FLINK-20295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-20295: Comment: was deleted (was: Hi [~lzljs3620320] Very thanks for reporting this issue! But the issue seems t

[jira] [Commented] (FLINK-20295) File Source lost data when reading from directories created by FileSystemTableSink with JSON format

[ https://issues.apache.org/jira/browse/FLINK-20295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17237892#comment-17237892 ] Yun Gao commented on FLINK-20295: - OK, very thanks [~lzljs3620320] and [~liruda] for att

[jira] [Comment Edited] (FLINK-20295) File Source lost data when reading from directories created by FileSystemTableSink with JSON format

[ https://issues.apache.org/jira/browse/FLINK-20295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17237892#comment-17237892 ] Yun Gao edited comment on FLINK-20295 at 11/24/20, 6:26 AM:

[jira] [Commented] (FLINK-20122) Test Small file compaction

[ https://issues.apache.org/jira/browse/FLINK-20122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17237917#comment-17237917 ] Yun Gao commented on FLINK-20122: - I tested the case with a writer task that writes and

[jira] [Comment Edited] (FLINK-20122) Test Small file compaction

[ https://issues.apache.org/jira/browse/FLINK-20122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17237917#comment-17237917 ] Yun Gao edited comment on FLINK-20122 at 11/24/20, 7:12 AM:

[jira] [Comment Edited] (FLINK-20122) Test Small file compaction

[ https://issues.apache.org/jira/browse/FLINK-20122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17237917#comment-17237917 ] Yun Gao edited comment on FLINK-20122 at 11/24/20, 7:21 AM:

[jira] [Created] (FLINK-20315) Optimize the compaction section for the document of table filesystem sink.

Yun Gao created FLINK-20315: --- Summary: Optimize the compaction section for the document of table filesystem sink. Key: FLINK-20315 URL: https://issues.apache.org/jira/browse/FLINK-20315 Project: Flink

[jira] [Commented] (FLINK-20122) Test Small file compaction

[ https://issues.apache.org/jira/browse/FLINK-20122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17237927#comment-17237927 ] Yun Gao commented on FLINK-20122: - [~lzljs3620320]  ok, no problem,  I filed an issue to

[jira] [Commented] (FLINK-10114) Support Orc for StreamingFileSink

[ https://issues.apache.org/jira/browse/FLINK-10114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17069437#comment-17069437 ] Yun Gao commented on FLINK-10114: - [~zenfenan] Very thanks for the doc and PR, I will al

[jira] [Commented] (FLINK-10672) Task stuck while writing output to flink

[ https://issues.apache.org/jira/browse/FLINK-10672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17070745#comment-17070745 ] Yun Gao commented on FLINK-10672: - Hi [~ibzib] I have deploy an environment with Beam 2.

[jira] [Commented] (FLINK-18818) HadoopRenameCommitterHDFSTest.testCommitOneFile[Override: false] failed with "java.io.IOException: The stream is closed"

[ https://issues.apache.org/jira/browse/FLINK-18818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17197616#comment-17197616 ] Yun Gao commented on FLINK-18818: - I'll have a look at this issue. > HadoopRenameCommit

[jira] [Commented] (FLINK-20918) Avoid excessive flush of Hadoop output stream

[ https://issues.apache.org/jira/browse/FLINK-20918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17268505#comment-17268505 ] Yun Gao commented on FLINK-20918: - Hi [~Paul Lin], very thanks for opening the issue! On

[jira] [Created] (FLINK-21066) Refactor the CheckpointCoordinator to compute the tasks to trigger/wait/commit dynamically

Yun Gao created FLINK-21066: --- Summary: Refactor the CheckpointCoordinator to compute the tasks to trigger/wait/commit dynamically Key: FLINK-21066 URL: https://issues.apache.org/jira/browse/FLINK-21066 Proj

[jira] [Created] (FLINK-21067) Modify the logic of computing tasks to trigger/wait/commit to consider finished tasks

Yun Gao created FLINK-21067: --- Summary: Modify the logic of computing tasks to trigger/wait/commit to consider finished tasks Key: FLINK-21067 URL: https://issues.apache.org/jira/browse/FLINK-21067 Project:

[jira] [Created] (FLINK-21080) Identify JobVertex containing legacy source operators and abort checkpoint with legacy source operators partially finished

Yun Gao created FLINK-21080: --- Summary: Identify JobVertex containing legacy source operators and abort checkpoint with legacy source operators partially finished Key: FLINK-21080 URL: https://issues.apache.org/jira/brow

[jira] [Created] (FLINK-21081) Re-compute tasks to trigger when tasks get triggered before finished

Yun Gao created FLINK-21081: --- Summary: Re-compute tasks to trigger when tasks get triggered before finished Key: FLINK-21081 URL: https://issues.apache.org/jira/browse/FLINK-21081 Project: Flink I

[jira] [Created] (FLINK-21084) Allows tasks to report operator subtask finish state

Yun Gao created FLINK-21084: --- Summary: Allows tasks to report operator subtask finish state Key: FLINK-21084 URL: https://issues.apache.org/jira/browse/FLINK-21084 Project: Flink Issue Type: Sub-ta

  1   2   3   4   5   6   7   8   9   10   >