[jira] [Created] (FLINK-13531) Do not print log and call release if no requests should be evicted in slot sharing
Yun Gao created FLINK-13531: --- Summary: Do not print log and call release if no requests should be evicted in slot sharing Key: FLINK-13531 URL: https://issues.apache.org/jira/browse/FLINK-13531 Project: Flink Issue Type: Bug Components: Runtime / Coordination Affects Versions: 1.9.0 Reporter: Yun Gao After adding the logic to bookkeeping the resource used in the shared slots, the resource requests will be recorded inside the MultiTaskSlot and when the underlying slot is allocated, all the resource requests will be checked if there is over-subscription, if so, some requests will be failed. In the current implementation, the code does not check the amount to fail before printing the over-allocated debug log and tries to fail them. This should not cause actual errors, but it will # Print a debug log saying some requests will be failed even if no one to fail. # If the total number of requests is 0 (This is possible if there already AllocatedSlot before the first request), the _release_ method will be called. Although it will do nothing with the current implementation (the slot is still being created and not added to any other data structure), it may cause error if the release logic changes in the future. To fix this issue, we should add a explicit check on the number of requests to fail. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Created] (FLINK-13752) TaskDeploymentDescriptor cannot be recycled by GC due to referenced by an anonymous function
Yun Gao created FLINK-13752: --- Summary: TaskDeploymentDescriptor cannot be recycled by GC due to referenced by an anonymous function Key: FLINK-13752 URL: https://issues.apache.org/jira/browse/FLINK-13752 Project: Flink Issue Type: Bug Components: Runtime / Coordination Affects Versions: 1.9.0 Reporter: Yun Gao When comparing the 1.8 and 1.9.0-rc2 on a test streaming job, we found that the performance on 1.9.0-rc2 is much lower than that of 1.8. By comparing the two versions, we found that the count of Full GC on 1.9.0-rc2 is much more than that on 1.8. A further analysis found that the difference is due to in TaskExecutor#setupResultPartitionBookkeeping, the anonymous function in taskTermimationWithResourceCleanFuture has referenced the TaskDeploymentDescriptor, since this function will be kept till the task is terminated, TaskDeploymentDescriptor will also be kept referenced in the closure and cannot be recycled by GC. In this job, TaskDeploymentDescriptor of some tasks are as large as 10M, and the total heap is about 113M, thus the kept TaskDeploymentDescriptors will cause relatively large impact on GC and performance. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Created] (FLINK-16009) Native support for the Variable-length and Zig-zag Variable-length integers
Yun Gao created FLINK-16009: --- Summary: Native support for the Variable-length and Zig-zag Variable-length integers Key: FLINK-16009 URL: https://issues.apache.org/jira/browse/FLINK-16009 Project: Flink Issue Type: Improvement Components: API / Type Serialization System Reporter: Yun Gao Currently Flink only support fixed-length integers. However, in many cases the values of the integer fields tend to be small, and we could reduce the size of serialized values by using [Variable length encoding|https://developers.google.com/protocol-buffers/docs/encoding#varints] and [Zig-zag variable-length encoding|https://developers.google.com/protocol-buffers/docs/encoding#signed-integers]. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-16137) Translate all DataStream API related pages into Chinese
Yun Gao created FLINK-16137: --- Summary: Translate all DataStream API related pages into Chinese Key: FLINK-16137 URL: https://issues.apache.org/jira/browse/FLINK-16137 Project: Flink Issue Type: Improvement Components: chinese-translation, Documentation Reporter: Yun Gao Fix For: 1.11.0 Translate data stream related pages into Chinese, including the pages under the section "Application Development/Streaming(DataStream API)" in the document site. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-16138) Translate "Overview" page of "DataStream API" into Chinese
Yun Gao created FLINK-16138: --- Summary: Translate "Overview" page of "DataStream API" into Chinese Key: FLINK-16138 URL: https://issues.apache.org/jira/browse/FLINK-16138 Project: Flink Issue Type: Improvement Components: chinese-translation, Documentation Reporter: Yun Gao Fix For: 1.11.0 The page is located at _flink/docs/dev/datastream_api.md_ -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-16151) Translate "Event-time/Pre-defined Timestamp Extractors / Watermark Emitters" into Chinese
Yun Gao created FLINK-16151: --- Summary: Translate "Event-time/Pre-defined Timestamp Extractors / Watermark Emitters" into Chinese Key: FLINK-16151 URL: https://issues.apache.org/jira/browse/FLINK-16151 Project: Flink Issue Type: Sub-task Components: chinese-translation, Documentation Reporter: Yun Gao Fix For: 1.11.0 The page is _docs/dev/event_timestamp_extractors.zh.md ._ -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-16152) Translate "Operator/index" into Chinese
Yun Gao created FLINK-16152: --- Summary: Translate "Operator/index" into Chinese Key: FLINK-16152 URL: https://issues.apache.org/jira/browse/FLINK-16152 Project: Flink Issue Type: Sub-task Components: chinese-translation, Documentation Reporter: Yun Gao Fix For: 1.11.0 The page is located at _docs/dev/stream/operators/index.zh.md_ -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-16153) Translate "Operator/windows" into Chinese
Yun Gao created FLINK-16153: --- Summary: Translate "Operator/windows" into Chinese Key: FLINK-16153 URL: https://issues.apache.org/jira/browse/FLINK-16153 Project: Flink Issue Type: Sub-task Components: chinese-translation, Documentation Reporter: Yun Gao Fix For: 1.11.0 The page is located at _"docs/dev/stream/operators/windows.zh.md"_ -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-16155) Translate "Operator/Process Function" into Chinese
Yun Gao created FLINK-16155: --- Summary: Translate "Operator/Process Function" into Chinese Key: FLINK-16155 URL: https://issues.apache.org/jira/browse/FLINK-16155 Project: Flink Issue Type: Sub-task Components: chinese-translation, Documentation Reporter: Yun Gao Fix For: 1.11.0 The page is located at _"docs/dev/stream/operators/process_function.zh.md"_ -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-16154) Translate "Operator/Join" into Chinese
Yun Gao created FLINK-16154: --- Summary: Translate "Operator/Join" into Chinese Key: FLINK-16154 URL: https://issues.apache.org/jira/browse/FLINK-16154 Project: Flink Issue Type: Sub-task Components: chinese-translation, Documentation Reporter: Yun Gao Fix For: 1.11.0 The page is located at _"docs/dev/stream/operators/joining.zh.md"_ -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-16582) NettyBufferPoolTest may have warns on NettyBuffer leak
Yun Gao created FLINK-16582: --- Summary: NettyBufferPoolTest may have warns on NettyBuffer leak Key: FLINK-16582 URL: https://issues.apache.org/jira/browse/FLINK-16582 Project: Flink Issue Type: Bug Components: Runtime / Network, Tests Reporter: Yun Gao {code:java} 4749 [Flink Netty Client (50072) Thread 0] ERROR org.apache.flink.shaded.netty4.io.netty.util.ResourceLeakDetector [] - LEAK: ByteBuf.release() was not called before it's garbage-collected. See https://netty.io/wiki/reference-counted-objects.html for more information. Recent access records: Created at: org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator.newDirectBuffer(PooledByteBufAllocator.java:349) org.apache.flink.shaded.netty4.io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:187) org.apache.flink.shaded.netty4.io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:178) org.apache.flink.shaded.netty4.io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:115) org.apache.flink.runtime.io.network.netty.NettyBufferPoolTest.testNoHeapAllocations(NettyBufferPoolTest.java:38) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:498) org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) org.junit.runners.ParentRunner.run(ParentRunner.java:363) org.junit.runners.Suite.runChild(Suite.java:128) org.junit.runners.Suite.runChild(Suite.java:27) org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) org.junit.runners.ParentRunner.run(ParentRunner.java:363) org.junit.runner.JUnitCore.run(JUnitCore.java:137) com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:68) com.intellij.rt.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:33) com.intellij.rt.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:230) com.intellij.rt.junit.JUnitStarter.main(JUnitStarter.java:58) Test ignored. Process finished with exit code 0 {code} We should released the allocated buffers in the tests. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-14521) CoLocationGroup is not set into JobVertex if the stream node chained with others
Yun Gao created FLINK-14521: --- Summary: CoLocationGroup is not set into JobVertex if the stream node chained with others Key: FLINK-14521 URL: https://issues.apache.org/jira/browse/FLINK-14521 Project: Flink Issue Type: Bug Components: API / DataStream Affects Versions: 1.9.1, 1.9.0 Reporter: Yun Gao StreamingJobGraphGenerator.isChainable dose not consider the coLocationGroup, if A -> B is chained, the coLocationGroup of the corresponding JobVertex will be set with that of the head node, namely A. Therefore, if B has declared coLocationGroup but A does not, then the coLocationGroup of B will be ignored. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-15664) Flink plan visualizer does not show operators information completely when there are line wrap
Yun Gao created FLINK-15664: --- Summary: Flink plan visualizer does not show operators information completely when there are line wrap Key: FLINK-15664 URL: https://issues.apache.org/jira/browse/FLINK-15664 Project: Flink Issue Type: Bug Components: Project Website Affects Versions: 1.9.1, 1.9.0 Reporter: Yun Gao Attachments: bad_display.png When there are line wrap in the diagram created by ([flink plan visualizer|[https://flink.apache.org/visualizer/]]), the operator information will not be shown completely, as shown in the attached image. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-15701) Allows transfer.sh to retry when fails to uploads logs.
Yun Gao created FLINK-15701: --- Summary: Allows transfer.sh to retry when fails to uploads logs. Key: FLINK-15701 URL: https://issues.apache.org/jira/browse/FLINK-15701 Project: Flink Issue Type: Improvement Components: Travis Affects Versions: 1.10.0 Reporter: Yun Gao Occasionally we met with the error {code:java} COMPRESSING build artifacts. build_info container.log mvn-1.log mvn-2.log mvn.out Uploading to transfer.sh Could not save metadata {code} when the travis uploading logs to transfer.sh. This makes many fail tests cannot be analyzed due to lack of detail logs. To amend this situation, we should allow uploading to retry when the uploading fails. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-10469) FileChannel may not write the whole buffer in a single call to FileChannel.write(Buffer buffer)
Yun Gao created FLINK-10469: --- Summary: FileChannel may not write the whole buffer in a single call to FileChannel.write(Buffer buffer) Key: FLINK-10469 URL: https://issues.apache.org/jira/browse/FLINK-10469 Project: Flink Issue Type: Bug Components: Core Affects Versions: 1.5.4, 1.6.1, 1.6.0, 1.5.3, 1.4.2, 1.4.1, 1.7.0, 1.6.2 Reporter: Yun Gao Currently all the calls to _FileChannel.write(ByteBuffer src)_ assumes that this method will not return before the whole buffer is written, like the one in _AsynchronousFileIOChannel.write()._ However, this assumption may not be right for all the environments. We have encountered the case that only part of a buffer was written on a cluster with a high IO load, and the target file got messy. To fix this issue, I think we should add a utility method in the org.apache.flink.util.IOUtils to ensure the whole buffer is written with a loop,and replace all the calls to _FileChannel.write(ByteBuffer)_ with this new method. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-10981) Add or modify metrics to show the maximum usage of InputBufferPool/OutputBufferPool to help debugging back pressure
Yun Gao created FLINK-10981: --- Summary: Add or modify metrics to show the maximum usage of InputBufferPool/OutputBufferPool to help debugging back pressure Key: FLINK-10981 URL: https://issues.apache.org/jira/browse/FLINK-10981 Project: Flink Issue Type: Improvement Components: Metrics, Network Reporter: Yun Gao Assignee: Yun Gao Currently the network layer has provided two metrics items, namely _InputBufferPoolUsageGauge_ and _OutputBufferPoolUsageGauge_ to show the usage of input buffer pool and output buffer pool. When there are multiple inputs(SingleInputGate) or __ outputs(ResultPartition), the two metrics items show their average usage. However, we found that the maximum usage of all the InputBufferPool or OutputBufferPool is also useful in debugging back pressure. Suppose we have a job with the following job graph: {code:java} F \ \ _\/ A ---> B > C ---> D \ \ \-> E {code} Besides, also suppose D is very slow and thus cause back pressure, but E is very fast and F outputs few records, thus the usage of the corresponding input/output buffer pool is almost 0. Then the average input/output buffer usage of each task will be: {code:java} A(100%) --> (100%) B (50%) --> (50%) C (100%) --> (100%) D {code} But the maximum input/output buffer usage of each task will be: {code:java} A(100%) --> (100%) B (100%) --> (100%) C (100%) --> (100%) D {code} Users will be able to find the slowest task by finding the first task whose input buffer usage is 100% but output usage is less than 100%. If it is reasonable to show the maximum input/output buffer usage, I think there may be three options: # Modify the current computation logic of _InputBufferPoolUsageGauge_ and _OutputBufferPoolUsageGauge._ # Add two __ new metrics items I_nputBufferPoolMaxUsageGauge and OutputBufferPoolUsageGauge._ # Try to show distinct usage for each input/output buffer pool. and I think maybe the second option is the most preferred. How do you think about that? -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-12171) The network buffer memory size should not be checked against the heap size on the TM side
Yun Gao created FLINK-12171: --- Summary: The network buffer memory size should not be checked against the heap size on the TM side Key: FLINK-12171 URL: https://issues.apache.org/jira/browse/FLINK-12171 Project: Flink Issue Type: Bug Components: Runtime / Configuration, Runtime / Network Affects Versions: 1.8.0, 1.7.2 Environment: I tested with Flink-1.7.2 with computed network buffer size = 5G and taskmanager.heap.mb=6114, and the exception about checking is triggered. Yarn Session mode, Yarn single job mode and standalone mode are all tested. I haven't tested on Flink-1.8 yet, but the logic seems to be not changed to me after reading the corresponding source code. Reporter: Yun Gao Currently when computing the network buffer memory size on the TM side in _TaskManagerService#calculateNetworkBufferMemory_`(version 1.8 or 1.7) or _NetworkEnvironmentConfiguration#calculateNewNetworkBufferMemory_(master), the computed network buffer memory size is checked to be less than `maxJvmHeapMemory`. However, in TM side, _maxJvmHeapMemory_ stores the maximum heap memory (namely -Xmx) . With the above process, when TM starts, -Xmx is computed in RM or in _taskmanager.sh_ with (container memory - network buffer memory - managed memory), thus the above checking implies that the heap memory of the TM must be larger than the network memory, which seems to be not necessary. Therefore, I think the network buffer memory size also need to be checked against the total memory instead of the heap memory on the TM side: # Checks that networkBufFraction < 1.0. # Compute the total memory by ( jvmHeapNoNet / (1 - networkBufFraction)). # Compare the network buffer memory with the total memory. This checking is also consistent with the similar one done on the RM side. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-12852) Deadlock occurs when requiring exclusive buffer for RemoteInputChannel
Yun Gao created FLINK-12852: --- Summary: Deadlock occurs when requiring exclusive buffer for RemoteInputChannel Key: FLINK-12852 URL: https://issues.apache.org/jira/browse/FLINK-12852 Project: Flink Issue Type: Bug Affects Versions: 1.9.0 Reporter: Yun Gao Assignee: Yun Gao When running tests with an upstream vertex and downstream vertex, deadlock occurs when submitting the job: {code:java} "Sink: Unnamed (3/500)" #136 prio=5 os_prio=0 tid=0x7f2cca81b000 nid=0x38845 waiting on condition [0x7f2cbe9fe000] java.lang.Thread.State: TIMED_WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for <0x00073ed6b6f0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:233) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:418) at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.requestMemorySegments(NetworkBufferPool.java:180) at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.requestMemorySegments(NetworkBufferPool.java:54) at org.apache.flink.runtime.io.network.partition.consumer.RemoteInputChannel.assignExclusiveSegments(RemoteInputChannel.java:139) at org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.assignExclusiveSegments(SingleInputGate.java:312) - locked <0x00073fbc81f0> (a java.lang.Object) at org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.setup(SingleInputGate.java:220) at org.apache.flink.runtime.taskmanager.Task.setupPartionsAndGates(Task.java:836) at org.apache.flink.runtime.taskmanager.Task.run(Task.java:598) at java.lang.Thread.run(Thread.java:834) {code} This is due to the required and max of local buffer pool is not the same and there may be over-allocation, when assignExclusiveSegments there are no available memory. The detail of the scenarios is as follows: The parallelism of both upstream vertex and downstream vertex are 1000 and 500 respectively. There are 200 TM and each TM has 10696 buffers( in total and has 10 slots. For a TM that runs 9 upstream tasks and 1 downstream task, the 9 upstream tasks start first with local buffer pool \{required = 500, max = 2 * 500 + 8 = 1008}, it produces data quickly and each occupy about 990 buffers. Then the DownStream task starts and try to assigning exclusive buffers for 1500 -9 = 1491 InputChannels. It requires 2981 buffers but only 1786 left. Since not all downstream tasks can start, the job will be blocked finally and no buffer can be released, and the deadlock finally occurred. I think although increasing the network memory solves the problem, the deadlock may not be acceptable. Fined grained resource management [Flink-12761|https://issues.apache.org/jira/browse/FLINK-12761] can solve this problem, but AFAIK in 1.9 it will not include the network memory into the ResourceProfile. I think the possible solution currently may be one of # Make the required and max equal for the local buffer pool. # Add max retrying for allocating exclusive buffers. When exceeding the maximum retrying times, the task will fail and throw an exception that tells users to increase the network memory. I think the second one may be better. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-12865) State inconsistency between RM and TM on the slot status
Yun Gao created FLINK-12865: --- Summary: State inconsistency between RM and TM on the slot status Key: FLINK-12865 URL: https://issues.apache.org/jira/browse/FLINK-12865 Project: Flink Issue Type: Bug Components: Runtime / Coordination Reporter: Yun Gao Assignee: Yun Gao There may be state inconsistency between TM and RM due to race condition and message loss: # When TM sends heartbeat, it retrieve SlotReport in the main thread, but sends the heartbeat in another thread. There may be cases that the slot on TM is FREE initially and SlotReport read the FREE state, then RM requests slot and mark the slot as allocated, and the SlotReport finally override the allocated status at the RM side wrongly. # When RM requests slot, TM received the requests but the acknowledge message get lot. Then RM will think this slot is free and assigned it to other request. Add a version to the slot may solves this problem. # Add a SYNCING status in the RM side. SYNCING means request is sent to TM but not knowing the result of the request. A slot with SYNCING status cannot be allocated to others. # RM and TM maintains a version for each slot, and the version starts from 0. # Whenever RM requests slot, it add the version by 1, and send the requests to TM. TM will only do allocation when RM's version > TM's version. # TM will also attach the version in the HeartBeat and RM will only accept the slot status when the TM's version >= RM's version. The version method is a simplified solution of the full vector clock based state management. In the full vector-clock design, the version should be a vector represents (RM's version, TM's version). Whenever RM modify the slot's status (requestSlot) and TM modify the slot's status (freeSlot), It need to first increase the corresponding component and send the sync messages, and the messages can only be accepted when the vector version >= messages' vector version. However, since for the status of slot TM will only modify its status when freeing slots, we can ignore the component of TM's side will only cause a freed slot be marked as allocated, this will not cause error, and the free status can be finally updated to RM with Heartbeat message. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-19653) HiveCatalogITCase fails on azure
Yun Gao created FLINK-19653: --- Summary: HiveCatalogITCase fails on azure Key: FLINK-19653 URL: https://issues.apache.org/jira/browse/FLINK-19653 Project: Flink Issue Type: Improvement Components: Connectors / Hive Affects Versions: 1.12.0 Reporter: Yun Gao https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=7628&view=logs&j=fc5181b0-e452-5c8f-68de-1097947f6483&t=62110053-334f-5295-a0ab-80dd7e2babbf {code:java} 2020-10-14T17:28:27.3065932Z [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 10.396 s <<< FAILURE! - in org.apache.flink.table.catalog.hive.HiveCatalogITCase 2020-10-14T17:28:27.3066739Z [ERROR] org.apache.flink.table.catalog.hive.HiveCatalogITCase Time elapsed: 10.396 s <<< ERROR! 2020-10-14T17:28:27.3067248Z java.lang.IllegalStateException: Failed to create HiveServer :Failed to get metastore connection 2020-10-14T17:28:27.3067925Zat com.klarna.hiverunner.HiveServerContainer.init(HiveServerContainer.java:101) 2020-10-14T17:28:27.3068360Zat com.klarna.hiverunner.builder.HiveShellBase.start(HiveShellBase.java:165) 2020-10-14T17:28:27.3068886Zat org.apache.flink.connectors.hive.FlinkStandaloneHiveRunner.createHiveServerContainer(FlinkStandaloneHiveRunner.java:217) 2020-10-14T17:28:27.3069678Zat org.apache.flink.connectors.hive.FlinkStandaloneHiveRunner.access$600(FlinkStandaloneHiveRunner.java:92) 2020-10-14T17:28:27.3070290Zat org.apache.flink.connectors.hive.FlinkStandaloneHiveRunner$2.before(FlinkStandaloneHiveRunner.java:131) 2020-10-14T17:28:27.3070763Zat org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:46) 2020-10-14T17:28:27.3071177Zat org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) 2020-10-14T17:28:27.3071576Zat org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) 2020-10-14T17:28:27.3071961Zat org.junit.rules.RunRules.evaluate(RunRules.java:20) 2020-10-14T17:28:27.3072432Zat org.junit.runners.ParentRunner.run(ParentRunner.java:363) 2020-10-14T17:28:27.3072852Zat org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) 2020-10-14T17:28:27.3073316Zat org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273) 2020-10-14T17:28:27.3073810Zat org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238) 2020-10-14T17:28:27.3074287Zat org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) 2020-10-14T17:28:27.3074768Zat org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384) 2020-10-14T17:28:27.3075281Zat org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345) 2020-10-14T17:28:27.3075798Zat org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126) 2020-10-14T17:28:27.3076239Zat org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418) 2020-10-14T17:28:27.3076648Z Caused by: java.lang.RuntimeException: Failed to get metastore connection 2020-10-14T17:28:27.3077099Zat org.apache.hive.service.server.HiveServer2.init(HiveServer2.java:169) 2020-10-14T17:28:27.3077650Zat com.klarna.hiverunner.HiveServerContainer.init(HiveServerContainer.java:84) 2020-10-14T17:28:27.3077947Z... 17 more 2020-10-14T17:28:27.3078655Z Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient 2020-10-14T17:28:27.3079236Zat org.apache.hadoop.hive.ql.metadata.Hive.registerAllFunctionsOnce(Hive.java:236) 2020-10-14T17:28:27.3079655Zat org.apache.hadoop.hive.ql.metadata.Hive.(Hive.java:388) 2020-10-14T17:28:27.3080038Zat org.apache.hadoop.hive.ql.metadata.Hive.create(Hive.java:332) 2020-10-14T17:28:27.3080610Zat org.apache.hadoop.hive.ql.metadata.Hive.getInternal(Hive.java:312) 2020-10-14T17:28:27.3081099Zat org.apache.hadoop.hive.ql.metadata.Hive.get(Hive.java:288) 2020-10-14T17:28:27.3081501Zat org.apache.hive.service.server.HiveServer2.init(HiveServer2.java:166) 2020-10-14T17:28:27.3081784Z... 18 more 2020-10-14T17:28:27.3082140Z Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient 2020-10-14T17:28:27.3082720Zat org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1708) 2020-10-14T17:28:27.3083344Zat org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.(RetryingMetaStoreClient.java:83) 2020-10-14T17:28:27.3083870Zat org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:133) 2020-10-14T17:28:27.3084379Zat org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(
[jira] [Created] (FLINK-19701) Unaligned Checkpoint might misuse the number of buffers to persist from the previous barrier
Yun Gao created FLINK-19701: --- Summary: Unaligned Checkpoint might misuse the number of buffers to persist from the previous barrier Key: FLINK-19701 URL: https://issues.apache.org/jira/browse/FLINK-19701 Project: Flink Issue Type: Bug Components: Runtime / Checkpointing Affects Versions: 1.12.0 Reporter: Yun Gao Current CheckpointUnaligner interacts with RemoteInputChannel to persisting the input buffers. However, based the current implementation it seems if we have the following case: {code:java} 1. There are 3 input channels. 2. Input channel 0 received barrier 1, and processed barrier 1 to start checkpoint 1. 3. Input channel 1 received barrier 1, and processed barrier 1. Now the state of input channel persister becomes BARRIER_RECEIVED and numBuffersOvertaken(channel 1) = n_1. 4. However, input 2 received nothing and the checkpoint expired, new checkpoint is trigger. 5. Input channel 0 received barrier 2, checkpoint 1 is deserted and checkpoint 2 is started. However, in this case the state of the input channels are not cleared. Thus now channel 1 is still BARRIER_RECEIVED and numBuffersOvertaken(channel 1) = n_1. Then channel 1 would only persist n_1 buffers in the channel. {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-19758) Implement a new unified File Sink based on the new Sink API
Yun Gao created FLINK-19758: --- Summary: Implement a new unified File Sink based on the new Sink API Key: FLINK-19758 URL: https://issues.apache.org/jira/browse/FLINK-19758 Project: Flink Issue Type: Sub-task Components: API / DataStream, Connectors / FileSystem Affects Versions: 1.12.0 Reporter: Yun Gao Fix For: 1.12.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-19850) Add E2E tests for the new streaming case of the new FileSink
Yun Gao created FLINK-19850: --- Summary: Add E2E tests for the new streaming case of the new FileSink Key: FLINK-19850 URL: https://issues.apache.org/jira/browse/FLINK-19850 Project: Flink Issue Type: Sub-task Reporter: Yun Gao -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-20032) Make FileSink support processing time
Yun Gao created FLINK-20032: --- Summary: Make FileSink support processing time Key: FLINK-20032 URL: https://issues.apache.org/jira/browse/FLINK-20032 Project: Flink Issue Type: Sub-task Reporter: Yun Gao Based on the ProcessingTimeService supported added to Sink API in https://issues.apache.org/jira/browse/FLINK-19963 , we also make FileSink support the process time so that it could support rolling on processing time. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-20172) Unify the behavior for file committers when the source or dest files are not exists
Yun Gao created FLINK-20172: --- Summary: Unify the behavior for file committers when the source or dest files are not exists Key: FLINK-20172 URL: https://issues.apache.org/jira/browse/FLINK-20172 Project: Flink Issue Type: Improvement Reporter: Yun Gao As discussed in https://github.com/apache/flink/pull/14061#discussion_r523923047, currently for `StreamingFileSink` or `FileSink`, the behavior is not consistency when restored from staled checkpoints / savepoints, some would ignore the missed files while others might throw exceptions. Therefore, we might unify the behavior for the different committers. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-20180) Translation the FileSink Document into Chinese
Yun Gao created FLINK-20180: --- Summary: Translation the FileSink Document into Chinese Key: FLINK-20180 URL: https://issues.apache.org/jira/browse/FLINK-20180 Project: Flink Issue Type: Sub-task Components: chinese-translation, Connectors / FileSystem Reporter: Yun Gao Translate the newly added FileSink documentation into Chinese -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-20291) Optimize the exception message of FileSystemTableSink when missing format dependencies
Yun Gao created FLINK-20291: --- Summary: Optimize the exception message of FileSystemTableSink when missing format dependencies Key: FLINK-20291 URL: https://issues.apache.org/jira/browse/FLINK-20291 Project: Flink Issue Type: Bug Reporter: Yun Gao Fix For: 1.12.0 Current when the format factory failed to load, the following exception would be thrown: {code:java} Exception in thread "main" org.apache.flink.table.api.ValidationException: Unable to create a sink for writing table 'default_catalog.default_database.sink'. Table options are: 'auto-compaction'='true' 'connector'='filesystem' 'format'='csv' 'path'='file:///tmp/compaction' at org.apache.flink.table.factories.FactoryUtil.createTableSink(FactoryUtil.java:166) at org.apache.flink.table.planner.delegation.PlannerBase.getTableSink(PlannerBase.scala:362) at org.apache.flink.table.planner.delegation.PlannerBase.translateToRel(PlannerBase.scala:220) at org.apache.flink.table.planner.delegation.PlannerBase$$anonfun$1.apply(PlannerBase.scala:164) at org.apache.flink.table.planner.delegation.PlannerBase$$anonfun$1.apply(PlannerBase.scala:164) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) at scala.collection.Iterator$class.foreach(Iterator.scala:891) at scala.collection.AbstractIterator.foreach(Iterator.scala:1334) at scala.collection.IterableLike$class.foreach(IterableLike.scala:72) at scala.collection.AbstractIterable.foreach(Iterable.scala:54) at scala.collection.TraversableLike$class.map(TraversableLike.scala:234) at scala.collection.AbstractTraversable.map(Traversable.scala:104) at org.apache.flink.table.planner.delegation.PlannerBase.translate(PlannerBase.scala:164) at org.apache.flink.table.api.internal.TableEnvironmentImpl.translate(TableEnvironmentImpl.java:1261) at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:674) at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeOperation(TableEnvironmentImpl.java:757) at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeSql(TableEnvironmentImpl.java:664) at FileCompactionTest.main(FileCompactionTest.java:147) Caused by: org.apache.flink.table.api.ValidationException: Please implement at least one of the following formats: BulkWriter.Factory, SerializationSchema, FileSystemFormatFactory. at org.apache.flink.table.filesystem.FileSystemTableSink.(FileSystemTableSink.java:124) at org.apache.flink.table.filesystem.FileSystemTableFactory.createDynamicTableSink(FileSystemTableFactory.java:83) at org.apache.flink.table.factories.FactoryUtil.createTableSink(FactoryUtil.java:163) ... 18 more {code} We might directly advice users to check if the format dependency is added or if there are package conflicts so that users would fix this issue faster. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-20292) Avro format conflicts with Parquet and Orc
Yun Gao created FLINK-20292: --- Summary: Avro format conflicts with Parquet and Orc Key: FLINK-20292 URL: https://issues.apache.org/jira/browse/FLINK-20292 Project: Flink Issue Type: Bug Reporter: Yun Gao Fix For: 1.12.0 When testing the Flink 1.12 in a standalone mode cluster, I found that if the user job jar contains both _flink-avro_ and _flink-parquet/flink-orc_, the FileSystemTableSink would not be able to load the corresponding format factory correctly. But if only one format is dependent it works. The test project located in [here|https://github.com/gaoyunhaii/flink1.12test] and the test class is [FileCompactionTest|https://github.com/gaoyunhaii/flink1.12test/blob/main/src/main/java/FileCompactionTest.java]. The conflict does not seem to affect the local runner, but only has problem when submitted to the standalone cluster. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-20295) File Source lost data when reading from directories created by FileSystemTableSink with JSON format
Yun Gao created FLINK-20295: --- Summary: File Source lost data when reading from directories created by FileSystemTableSink with JSON format Key: FLINK-20295 URL: https://issues.apache.org/jira/browse/FLINK-20295 Project: Flink Issue Type: Bug Reporter: Yun Gao Fix For: 1.12.0 Attachments: compaction.tgz When testing the compaction functionality of the FileSystemTableSink, I found that when using json format, the produced directories could not be read correctly by the file source, namely only a part of records are read. By checking the produced directories, the number of the records in it is the same as expected, thus it seems to be the issue of the source side. The issue only exists for JSON format. The data is produced by [FileCompactionTest|https://github.com/gaoyunhaii/flink1.12test/blob/main/src/main/java/FileCompactionTest.java] and read by [FileCompactionCheckTest|https://github.com/gaoyunhaii/flink1.12test/blob/main/src/main/java/FileCompactionCheckTest.java] . An example directories tar file of 8000 records are also attached. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-20315) Optimize the compaction section for the document of table filesystem sink.
Yun Gao created FLINK-20315: --- Summary: Optimize the compaction section for the document of table filesystem sink. Key: FLINK-20315 URL: https://issues.apache.org/jira/browse/FLINK-20315 Project: Flink Issue Type: Improvement Components: Connectors / FileSystem, Documentation Affects Versions: 1.12.0 Reporter: Yun Gao Fix For: 1.12.0 Since if the files are big and the compaction use too much time, it will backpressure the job and also extend the time period of checkpoint, we might explicitly warns users about the possibility of this case to avoid perplexity. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-20888) ContinuousFileReaderOperator should not close the output on close()
Yun Gao created FLINK-20888: --- Summary: ContinuousFileReaderOperator should not close the output on close() Key: FLINK-20888 URL: https://issues.apache.org/jira/browse/FLINK-20888 Project: Flink Issue Type: Bug Components: Connectors / FileSystem Affects Versions: 1.12.0 Reporter: Yun Gao Currently ContinuousFileReaderOperator would close the output on close(), if it is chained with more operators, it would close the following operators before their endOfInput() is called (by default, we would call op1.endInput(), op1.close(), op2.endInput(), op2.close()... in order). This might cause some problems like in https://lists.apache.org/thread.html/r50a94aaea4fe25f3927a4274ea8272e6b76ecec8f3fe48d2566689bd%40%3Cuser.flink.apache.org%3E -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-30877) Add support for @Before / @After for JUnit 4 and 5
Yun Gao created FLINK-30877: --- Summary: Add support for @Before / @After for JUnit 4 and 5 Key: FLINK-30877 URL: https://issues.apache.org/jira/browse/FLINK-30877 Project: Flink Issue Type: Sub-task Components: Test Infrastructure Reporter: Yun Gao Based on the new migration tests infrastructure, we might also support @Before / @After for both junit 4 and 5. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-30906) TwoInputStreamTask passes wrong configuration object when creating input processor
Yun Gao created FLINK-30906: --- Summary: TwoInputStreamTask passes wrong configuration object when creating input processor Key: FLINK-30906 URL: https://issues.apache.org/jira/browse/FLINK-30906 Project: Flink Issue Type: Bug Affects Versions: 1.16.1, 1.17.0 Reporter: Yun Gao It seems _StreamTwoInputProcessorFactory.create_ is passed with wrong configuration object: the taskManagerConfiguration should be __ _getEnvironment().getTaskManagerInfo().getConfiguration()._ And in the following logic, it seems to indeed try to load taskmanager options from this configuration object, like state-backend and taskmanager.memory.managed.consumer-weights [1]https://github.com/apache/flink/blob/111342f37bdc0d582d3f7af458d9869f0548299f/flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/TwoInputStreamTask.java#L98 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-26566) FlinkKafkaProducerITCase.testFailAndRecoverSameCheckpointTwice failed on azure
Yun Gao created FLINK-26566: --- Summary: FlinkKafkaProducerITCase.testFailAndRecoverSameCheckpointTwice failed on azure Key: FLINK-26566 URL: https://issues.apache.org/jira/browse/FLINK-26566 Project: Flink Issue Type: Bug Components: Connectors / Kafka Affects Versions: 1.14.3 Reporter: Yun Gao {code:java} Mar 09 20:11:28 [ERROR] Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 274.396 s <<< FAILURE! - in org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerITCase Mar 09 20:11:28 [ERROR] testFailAndRecoverSameCheckpointTwice Time elapsed: 74.511 s <<< FAILURE! Mar 09 20:11:28 java.lang.AssertionError: Expected elements: <[42, 43]>, but was: elements: <[42, 43, 42, 43, 42, 43, 42, 43]> Mar 09 20:11:28 at org.junit.Assert.fail(Assert.java:89) Mar 09 20:11:28 at org.apache.flink.streaming.connectors.kafka.KafkaTestBase.assertExactlyOnceForTopic(KafkaTestBase.java:331) Mar 09 20:11:28 at org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerITCase.testFailAndRecoverSameCheckpointTwice(FlinkKafkaProducerITCase.java:316) Mar 09 20:11:28 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Mar 09 20:11:28 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Mar 09 20:11:28 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Mar 09 20:11:28 at java.lang.reflect.Method.invoke(Method.java:498) Mar 09 20:11:28 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) Mar 09 20:11:28 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) Mar 09 20:11:28 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) Mar 09 20:11:28 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) Mar 09 20:11:28 at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) Mar 09 20:11:28 at org.apache.flink.testutils.junit.RetryRule$RetryOnFailureStatement.evaluate(RetryRule.java:135) Mar 09 20:11:28 at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45) Mar 09 20:11:28 at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) Mar 09 20:11:28 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) Mar 09 20:11:28 at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) Mar 09 20:11:28 at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) Mar 09 20:11:28 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) Mar 09 20:11:28 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) Mar 09 20:11:28 at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) Mar 09 20:11:28 at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) Mar 09 20:11:28 at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) Mar 09 20:11:28 at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) Mar 09 20:11:28 at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) Mar 09 20:11:28 at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) Mar 09 20:11:28 at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) {code} https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=32778&view=logs&j=c5f0071e-1851-543e-9a45-9ac140befc32&t=15a22db7-8faa-5b34-3920-d33c9f0ca23c&l=7412 -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-26573) ChangelogPeriodicMaterializationRescaleITCase.testRescaleIn failed on azure
Yun Gao created FLINK-26573: --- Summary: ChangelogPeriodicMaterializationRescaleITCase.testRescaleIn failed on azure Key: FLINK-26573 URL: https://issues.apache.org/jira/browse/FLINK-26573 Project: Flink Issue Type: Bug Components: Runtime / State Backends Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} Mar 09 18:27:45 [INFO] Running org.apache.flink.test.checkpointing.ChangelogPeriodicMaterializationRescaleITCase Mar 09 18:27:58 [ERROR] Tests run: 6, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 12.81 s <<< FAILURE! - in org.apache.flink.test.checkpointing.ChangelogPeriodicMaterializationRescaleITCase Mar 09 18:27:58 [ERROR] ChangelogPeriodicMaterializationRescaleITCase.testRescaleIn Time elapsed: 5.292 s <<< ERROR! Mar 09 18:27:58 org.apache.flink.runtime.JobException: Recovery is suppressed by FixedDelayRestartBackoffTimeStrategy(maxNumberRestartAttempts=0, backoffTimeMS=0) Mar 09 18:27:58 at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138) Mar 09 18:27:58 at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82) Mar 09 18:27:58 at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:301) Mar 09 18:27:58 at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291) Mar 09 18:27:58 at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282) Mar 09 18:27:58 at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739) Mar 09 18:27:58 at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78) Mar 09 18:27:58 at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443) Mar 09 18:27:58 at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) Mar 09 18:27:58 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Mar 09 18:27:58 at java.lang.reflect.Method.invoke(Method.java:498) Mar 09 18:27:58 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304) Mar 09 18:27:58 at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83) Mar 09 18:27:58 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302) Mar 09 18:27:58 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217) Mar 09 18:27:58 at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78) Mar 09 18:27:58 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163) Mar 09 18:27:58 at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) Mar 09 18:27:58 at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) Mar 09 18:27:58 at scala.PartialFunction.applyOrElse(PartialFunction.scala:123) Mar 09 18:27:58 at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122) Mar 09 18:27:58 at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) Mar 09 18:27:58 at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) Mar 09 18:27:58 at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) Mar 09 18:27:58 at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) Mar 09 18:27:58 at akka.actor.Actor.aroundReceive(Actor.scala:537) Mar 09 18:27:58 at akka.actor.Actor.aroundReceive$(Actor.scala:535) Mar 09 18:27:58 at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220) Mar 09 18:27:58 at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580) Mar 09 18:27:58 at akka.actor.ActorCell.invoke(ActorCell.scala:548) Mar 09 18:27:58 at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) Mar 09 18:27:58 at akka.dispatch.Mailbox.run(Mailbox.scala:231) Mar 09 18:27:58 at akka.dispatch.Mailbox.exec(Mailbox.scala:243) Mar 09 18:27:58 at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) Mar 09 18:27:58 at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) {code} https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=32774&view=logs&j=5c8e7682-d68f-54d1-16a2-a09310218a49&t=86f654fa-ab48-5c1a-25f4-7e7f6afb9bba&l=5593 -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-26596) ZooKeeperLeaderRetrievalConnectionHandlingTest.testNewLeaderAfterReconnectTriggersListenerNotification failed on azure
Yun Gao created FLINK-26596: --- Summary: ZooKeeperLeaderRetrievalConnectionHandlingTest.testNewLeaderAfterReconnectTriggersListenerNotification failed on azure Key: FLINK-26596 URL: https://issues.apache.org/jira/browse/FLINK-26596 Project: Flink Issue Type: Bug Components: Runtime / Coordination Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} Mar 10 09:16:30 [ERROR] org.apache.flink.runtime.leaderretrieval.ZooKeeperLeaderRetrievalConnectionHandlingTest.testNewLeaderAfterReconnectTriggersListenerNotification Time elapsed: 20.752 s <<< ERROR! Mar 10 09:16:30 java.lang.NullPointerException Mar 10 09:16:30 at org.apache.flink.runtime.leaderretrieval.ZooKeeperLeaderRetrievalConnectionHandlingTest.lambda$null$9(ZooKeeperLeaderRetrievalConnectionHandlingTest.java:292) Mar 10 09:16:30 at org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:161) Mar 10 09:16:30 at org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:145) Mar 10 09:16:30 at org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:137) Mar 10 09:16:30 at org.apache.flink.runtime.leaderretrieval.ZooKeeperLeaderRetrievalConnectionHandlingTest.lambda$testNewLeaderAfterReconnectTriggersListenerNotification$10(ZooKeeperLeaderRetrievalConnectionHandlingTest.java:288) Mar 10 09:16:30 at org.apache.flink.runtime.leaderretrieval.ZooKeeperLeaderRetrievalConnectionHandlingTest.testWithQueueLeaderElectionListener(ZooKeeperLeaderRetrievalConnectionHandlingTest.java:313) Mar 10 09:16:30 at org.apache.flink.runtime.leaderretrieval.ZooKeeperLeaderRetrievalConnectionHandlingTest.testNewLeaderAfterReconnectTriggersListenerNotification(ZooKeeperLeaderRetrievalConnectionHandlingTest.java:250) Mar 10 09:16:30 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Mar 10 09:16:30 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Mar 10 09:16:30 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Mar 10 09:16:30 at java.lang.reflect.Method.invoke(Method.java:498) Mar 10 09:16:30 at org.junit.platform.commons.util.ReflectionUtils.invokeMethod(ReflectionUtils.java:725) Mar 10 09:16:30 at org.junit.jupiter.engine.execution.MethodInvocation.proceed(MethodInvocation.java:60) Mar 10 09:16:30 at org.junit.jupiter.engine.execution.InvocationInterceptorChain$ValidatingInvocation.proceed(InvocationInterceptorChain.java:131) Mar 10 09:16:30 at org.junit.jupiter.engine.extension.TimeoutExtension.intercept(TimeoutExtension.java:149) Mar 10 09:16:30 at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestableMethod(TimeoutExtension.java:140) Mar 10 09:16:30 at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestMethod(TimeoutExtension.java:84) Mar 10 09:16:30 at org.junit.jupiter.engine.execution.ExecutableInvoker$ReflectiveInterceptorCall.lambda$ofVoidMethod$0(ExecutableInvoker.java:115) Mar 10 09:16:30 at org.junit.jupiter.engine.execution.ExecutableInvoker.lambda$invoke$0(ExecutableInvoker.java:105) Mar 10 09:16:30 at org.junit.jupiter.engine.execution.InvocationInterceptorChain$InterceptedInvocation.proceed(InvocationInterceptorChain.java:106) Mar 10 09:16:30 at org.junit.jupiter.engine.execution.InvocationInterceptorChain.proceed(InvocationInterceptorChain.java:64) Mar 10 09:16:30 at org.junit.jupiter.engine.execution.InvocationInterceptorChain.chainAndInvoke(InvocationInterceptorChain.java:45) Mar 10 09:16:30 at org.junit.jupiter.engine.execution.InvocationInterceptorChain.invoke(InvocationInterceptorChain.java:37) Mar 10 09:16:30 at org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:104) Mar 10 09:16:30 at org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:98) Mar 10 09:16:30 at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.lambda$invokeTestMethod$7(TestMethodTestDescriptor.java:214) Mar 10 09:16:30 at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) Mar 10 09:16:30 at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.invokeTestMethod(TestMethodTestDescriptor.java:210) Mar 10 09:16:30 at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:135) Mar 10 09:16:30 at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:66) Mar 10 09:16:30 at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeT
[jira] [Created] (FLINK-26597) OracleTableSinkITCase failed on azure due to container failed to startup
Yun Gao created FLINK-26597: --- Summary: OracleTableSinkITCase failed on azure due to container failed to startup Key: FLINK-26597 URL: https://issues.apache.org/jira/browse/FLINK-26597 Project: Flink Issue Type: Bug Components: Connectors / JDBC Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} 2022-03-11T02:31:04.2072037Z Mar 11 02:31:04 [ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 263.981 s <<< FAILURE! - in org.apache.flink.connector.jdbc.dialect.oracle.OracleTableSinkITCase 2022-03-11T02:31:04.2171609Z Mar 11 02:31:04 [ERROR] org.apache.flink.connector.jdbc.dialect.oracle.OracleTableSinkITCase Time elapsed: 263.981 s <<< FAILURE! 2022-03-11T02:31:04.2173200Z Mar 11 02:31:04 org.opentest4j.MultipleFailuresError: 2022-03-11T02:31:04.2176044Z Mar 11 02:31:04 Multiple Failures (2 failures) 2022-03-11T02:31:04.2176669Z Mar 11 02:31:04 org.testcontainers.containers.ContainerLaunchException: Container startup failed 2022-03-11T02:31:04.2177257Z Mar 11 02:31:04java.sql.SQLException: The url cannot be null 2022-03-11T02:31:04.2177927Z Mar 11 02:31:04at org.junit.vintage.engine.execution.TestRun.getStoredResultOrSuccessful(TestRun.java:196) 2022-03-11T02:31:04.2178740Z Mar 11 02:31:04at org.junit.vintage.engine.execution.RunListenerAdapter.fireExecutionFinished(RunListenerAdapter.java:226) 2022-03-11T02:31:04.2179576Z Mar 11 02:31:04at org.junit.vintage.engine.execution.RunListenerAdapter.testRunFinished(RunListenerAdapter.java:93) 2022-03-11T02:31:04.2180710Z Mar 11 02:31:04at org.junit.runner.notification.SynchronizedRunListener.testRunFinished(SynchronizedRunListener.java:42) 2022-03-11T02:31:04.2181538Z Mar 11 02:31:04at org.junit.runner.notification.RunNotifier$2.notifyListener(RunNotifier.java:103) 2022-03-11T02:31:04.2182254Z Mar 11 02:31:04at org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) 2022-03-11T02:31:04.2182990Z Mar 11 02:31:04at org.junit.runner.notification.RunNotifier.fireTestRunFinished(RunNotifier.java:100) 2022-03-11T02:31:04.2640543Z Mar 11 02:31:04at org.junit.runner.JUnitCore.run(JUnitCore.java:138) 2022-03-11T02:31:04.2641130Z Mar 11 02:31:04at org.junit.runner.JUnitCore.run(JUnitCore.java:115) 2022-03-11T02:31:04.2641982Z Mar 11 02:31:04at org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:42) 2022-03-11T02:31:04.2642709Z Mar 11 02:31:04at org.junit.vintage.engine.VintageTestEngine.executeAllChildren(VintageTestEngine.java:80) 2022-03-11T02:31:04.3102739Z Mar 11 02:31:04at org.junit.vintage.engine.VintageTestEngine.execute(VintageTestEngine.java:72) 2022-03-11T02:31:04.3103584Z Mar 11 02:31:04at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:107) 2022-03-11T02:31:04.3104431Z Mar 11 02:31:04at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:88) 2022-03-11T02:31:04.3105311Z Mar 11 02:31:04at org.junit.platform.launcher.core.EngineExecutionOrchestrator.lambda$execute$0(EngineExecutionOrchestrator.java:54) 2022-03-11T02:31:04.3106260Z Mar 11 02:31:04at org.junit.platform.launcher.core.EngineExecutionOrchestrator.withInterceptedStreams(EngineExecutionOrchestrator.java:67) 2022-03-11T02:31:04.3107149Z Mar 11 02:31:04at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:52) 2022-03-11T02:31:04.3107938Z Mar 11 02:31:04at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:114) 2022-03-11T02:31:04.3108678Z Mar 11 02:31:04at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:86) 2022-03-11T02:31:04.3109488Z Mar 11 02:31:04at org.junit.platform.launcher.core.DefaultLauncherSession$DelegatingLauncher.execute(DefaultLauncherSession.java:86) 2022-03-11T02:31:04.3110543Z Mar 11 02:31:04at org.junit.platform.launcher.core.SessionPerRequestLauncher.execute(SessionPerRequestLauncher.java:53) 2022-03-11T02:31:04.3111372Z Mar 11 02:31:04at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.execute(JUnitPlatformProvider.java:188) 2022-03-11T02:31:04.3112234Z Mar 11 02:31:04at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invokeAllTests(JUnitPlatformProvider.java:154) 2022-03-11T02:31:04.3113070Z Mar 11 02:31:04at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invoke(JUnitPlatformProvider.java:124) 2022-03-11T02:31:04.3113862Z Mar 11 02:31:04at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:428) 2022-03-11T02:31:04.3114601Z Mar 11 02:31:04at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:162) 2022-03-11T02:31:04.3115298Z Mar 11 02:31:04
[jira] [Created] (FLINK-26598) OracleTableSinkITCase failed on azure due to container failed to startup
Yun Gao created FLINK-26598: --- Summary: OracleTableSinkITCase failed on azure due to container failed to startup Key: FLINK-26598 URL: https://issues.apache.org/jira/browse/FLINK-26598 Project: Flink Issue Type: Bug Components: Connectors / JDBC Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} 2022-03-11T02:31:04.2072037Z Mar 11 02:31:04 [ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 263.981 s <<< FAILURE! - in org.apache.flink.connector.jdbc.dialect.oracle.OracleTableSinkITCase 2022-03-11T02:31:04.2171609Z Mar 11 02:31:04 [ERROR] org.apache.flink.connector.jdbc.dialect.oracle.OracleTableSinkITCase Time elapsed: 263.981 s <<< FAILURE! 2022-03-11T02:31:04.2173200Z Mar 11 02:31:04 org.opentest4j.MultipleFailuresError: 2022-03-11T02:31:04.2176044Z Mar 11 02:31:04 Multiple Failures (2 failures) 2022-03-11T02:31:04.2176669Z Mar 11 02:31:04 org.testcontainers.containers.ContainerLaunchException: Container startup failed 2022-03-11T02:31:04.2177257Z Mar 11 02:31:04java.sql.SQLException: The url cannot be null 2022-03-11T02:31:04.2177927Z Mar 11 02:31:04at org.junit.vintage.engine.execution.TestRun.getStoredResultOrSuccessful(TestRun.java:196) 2022-03-11T02:31:04.2178740Z Mar 11 02:31:04at org.junit.vintage.engine.execution.RunListenerAdapter.fireExecutionFinished(RunListenerAdapter.java:226) 2022-03-11T02:31:04.2179576Z Mar 11 02:31:04at org.junit.vintage.engine.execution.RunListenerAdapter.testRunFinished(RunListenerAdapter.java:93) 2022-03-11T02:31:04.2180710Z Mar 11 02:31:04at org.junit.runner.notification.SynchronizedRunListener.testRunFinished(SynchronizedRunListener.java:42) 2022-03-11T02:31:04.2181538Z Mar 11 02:31:04at org.junit.runner.notification.RunNotifier$2.notifyListener(RunNotifier.java:103) 2022-03-11T02:31:04.2182254Z Mar 11 02:31:04at org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) 2022-03-11T02:31:04.2182990Z Mar 11 02:31:04at org.junit.runner.notification.RunNotifier.fireTestRunFinished(RunNotifier.java:100) 2022-03-11T02:31:04.2640543Z Mar 11 02:31:04at org.junit.runner.JUnitCore.run(JUnitCore.java:138) 2022-03-11T02:31:04.2641130Z Mar 11 02:31:04at org.junit.runner.JUnitCore.run(JUnitCore.java:115) 2022-03-11T02:31:04.2641982Z Mar 11 02:31:04at org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:42) 2022-03-11T02:31:04.2642709Z Mar 11 02:31:04at org.junit.vintage.engine.VintageTestEngine.executeAllChildren(VintageTestEngine.java:80) 2022-03-11T02:31:04.3102739Z Mar 11 02:31:04at org.junit.vintage.engine.VintageTestEngine.execute(VintageTestEngine.java:72) 2022-03-11T02:31:04.3103584Z Mar 11 02:31:04at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:107) 2022-03-11T02:31:04.3104431Z Mar 11 02:31:04at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:88) 2022-03-11T02:31:04.3105311Z Mar 11 02:31:04at org.junit.platform.launcher.core.EngineExecutionOrchestrator.lambda$execute$0(EngineExecutionOrchestrator.java:54) 2022-03-11T02:31:04.3106260Z Mar 11 02:31:04at org.junit.platform.launcher.core.EngineExecutionOrchestrator.withInterceptedStreams(EngineExecutionOrchestrator.java:67) 2022-03-11T02:31:04.3107149Z Mar 11 02:31:04at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:52) 2022-03-11T02:31:04.3107938Z Mar 11 02:31:04at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:114) 2022-03-11T02:31:04.3108678Z Mar 11 02:31:04at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:86) 2022-03-11T02:31:04.3109488Z Mar 11 02:31:04at org.junit.platform.launcher.core.DefaultLauncherSession$DelegatingLauncher.execute(DefaultLauncherSession.java:86) 2022-03-11T02:31:04.3110543Z Mar 11 02:31:04at org.junit.platform.launcher.core.SessionPerRequestLauncher.execute(SessionPerRequestLauncher.java:53) 2022-03-11T02:31:04.3111372Z Mar 11 02:31:04at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.execute(JUnitPlatformProvider.java:188) 2022-03-11T02:31:04.3112234Z Mar 11 02:31:04at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invokeAllTests(JUnitPlatformProvider.java:154) 2022-03-11T02:31:04.3113070Z Mar 11 02:31:04at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invoke(JUnitPlatformProvider.java:124) 2022-03-11T02:31:04.3113862Z Mar 11 02:31:04at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:428) 2022-03-11T02:31:04.3114601Z Mar 11 02:31:04at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:162) 2022-03-11T02:31:04.3115298Z Mar 11 02:31:04
[jira] [Created] (FLINK-26599) CheckpointCoordinatorTest.testMinCheckpointPause failed on azure
Yun Gao created FLINK-26599: --- Summary: CheckpointCoordinatorTest.testMinCheckpointPause failed on azure Key: FLINK-26599 URL: https://issues.apache.org/jira/browse/FLINK-26599 Project: Flink Issue Type: Bug Components: Runtime / Checkpointing Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} Mar 11 02:22:37 [ERROR] Tests run: 49, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 5.528 s <<< FAILURE! - in org.apache.flink.runtime.checkpoint.CheckpointCoordinatorTest Mar 11 02:22:37 [ERROR] org.apache.flink.runtime.checkpoint.CheckpointCoordinatorTest.testMinCheckpointPause Time elapsed: 0.03 s <<< ERROR! Mar 11 02:22:37 org.apache.flink.runtime.checkpoint.CheckpointException: Could not finalize the pending checkpoint 1. Failure reason: Failure to finalize checkpoint. Mar 11 02:22:37 at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.finalizeCheckpoint(CheckpointCoordinator.java:1354) Mar 11 02:22:37 at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.completePendingCheckpoint(CheckpointCoordinator.java:1241) Mar 11 02:22:37 at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.receiveAcknowledgeMessage(CheckpointCoordinator.java:1133) Mar 11 02:22:37 at org.apache.flink.runtime.checkpoint.CheckpointCoordinatorTest.testMinCheckpointPause(CheckpointCoordinatorTest.java:395) Mar 11 02:22:37 at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Mar 11 02:22:37 at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Mar 11 02:22:37 at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Mar 11 02:22:37 at java.base/java.lang.reflect.Method.invoke(Method.java:566) Mar 11 02:22:37 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) Mar 11 02:22:37 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) Mar 11 02:22:37 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) Mar 11 02:22:37 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) Mar 11 02:22:37 at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) Mar 11 02:22:37 at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54) Mar 11 02:22:37 at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45) Mar 11 02:22:37 at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) Mar 11 02:22:37 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) Mar 11 02:22:37 at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) Mar 11 02:22:37 at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) Mar 11 02:22:37 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) Mar 11 02:22:37 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) Mar 11 02:22:37 at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) Mar 11 02:22:37 at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) Mar 11 02:22:37 at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) Mar 11 02:22:37 at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) Mar 11 02:22:37 at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) Mar 11 02:22:37 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) Mar 11 02:22:37 at org.junit.runners.ParentRunner.run(ParentRunner.java:413) Mar 11 02:22:37 at org.junit.runner.JUnitCore.run(JUnitCore.java:137) Mar 11 02:22:37 at org.junit.runner.JUnitCore.run(JUnitCore.java:115) Mar 11 02:22:37 at org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:42) Mar 11 02:22:37 at org.junit.vintage.engine.VintageTestEngine.executeAllChildren(VintageTestEngine.java:80) Mar 11 02:22:37 at org.junit.vintage.engine.VintageTestEngine.execute(VintageTestEngine.java:72) Mar 11 02:22:37 at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:107) Mar 11 02:22:37 at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:88) {code} https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=32877&view=logs&j=b0a398c0-685b-599c-eb57-c8c2a771138e&t=747432ad-a576-5911-1e2a-68c6bedc248a&l=9267 -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-26600) PerJobMiniClusterFactoryTest.testJobClientSavepoint failed on azure
Yun Gao created FLINK-26600: --- Summary: PerJobMiniClusterFactoryTest.testJobClientSavepoint failed on azure Key: FLINK-26600 URL: https://issues.apache.org/jira/browse/FLINK-26600 Project: Flink Issue Type: Bug Components: Test Infrastructure Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} Mar 11 02:32:21 java.lang.AssertionError: Mar 11 02:32:21 Mar 11 02:32:21 Expected: a string containing "is not a streaming job." Mar 11 02:32:21 but: was "org.apache.flink.runtime.checkpoint.CheckpointException: The Flink job is currently not executing. Failure reason: Trigger checkpoint failure." Mar 11 02:32:21 at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20) Mar 11 02:32:21 at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:8) Mar 11 02:32:21 at org.apache.flink.core.testutils.CommonTestUtils.assertThrows(CommonTestUtils.java:184) Mar 11 02:32:21 at org.apache.flink.client.program.PerJobMiniClusterFactoryTest.testJobClientSavepoint(PerJobMiniClusterFactoryTest.java:105) Mar 11 02:32:21 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Mar 11 02:32:21 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Mar 11 02:32:21 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Mar 11 02:32:21 at java.lang.reflect.Method.invoke(Method.java:498) Mar 11 02:32:21 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) Mar 11 02:32:21 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) Mar 11 02:32:21 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) Mar 11 02:32:21 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) Mar 11 02:32:21 at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) Mar 11 02:32:21 at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45) Mar 11 02:32:21 at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) Mar 11 02:32:21 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) Mar 11 02:32:21 at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) Mar 11 02:32:21 at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) Mar 11 02:32:21 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) Mar 11 02:32:21 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) Mar 11 02:32:21 at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) Mar 11 02:32:21 at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) Mar 11 02:32:21 at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) Mar 11 02:32:21 at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) Mar 11 02:32:21 at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) Mar 11 02:32:21 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) Mar 11 02:32:21 at org.junit.runners.ParentRunner.run(ParentRunner.java:413) Mar 11 02:32:21 at org.junit.runner.JUnitCore.run(JUnitCore.java:137) Mar 11 02:32:21 at org.junit.runner.JUnitCore.run(JUnitCore.java:115) Mar 11 02:32:21 at org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:42) Mar 11 02:32:21 at org.junit.vintage.engine.VintageTestEngine.executeAllChildren(VintageTestEngine.java:80) Mar 11 02:32:21 at org.junit.vintage.engine.VintageTestEngine.execute(VintageTestEngine.java:72) {code} https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=32877&view=logs&j=0e7be18f-84f2-53f0-a32d-4a5e4a174679&t=7c1d86e3-35bd-5fd5-3b7c-30c126a78702&l=10833 -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-26621) flink-tests failed on azure due to Error occurred in starting fork
Yun Gao created FLINK-26621: --- Summary: flink-tests failed on azure due to Error occurred in starting fork Key: FLINK-26621 URL: https://issues.apache.org/jira/browse/FLINK-26621 Project: Flink Issue Type: Bug Components: Build System / Azure Pipelines Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} 2022-03-11T16:20:12.6929558Z Mar 11 16:20:12 [WARNING] The requested profile "skip-webui-build" could not be activated because it does not exist. 2022-03-11T16:20:12.6939269Z Mar 11 16:20:12 [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:3.0.0-M5:test (integration-tests) on project flink-tests: There are test failures. 2022-03-11T16:20:12.6940062Z Mar 11 16:20:12 [ERROR] 2022-03-11T16:20:12.6940954Z Mar 11 16:20:12 [ERROR] Please refer to /__w/2/s/flink-tests/target/surefire-reports for the individual test results. 2022-03-11T16:20:12.6941875Z Mar 11 16:20:12 [ERROR] Please refer to dump files (if any exist) [date].dump, [date]-jvmRun[N].dump and [date].dumpstream. 2022-03-11T16:20:12.6942966Z Mar 11 16:20:12 [ERROR] ExecutionException Error occurred in starting fork, check output in log 2022-03-11T16:20:12.6943919Z Mar 11 16:20:12 [ERROR] org.apache.maven.surefire.booter.SurefireBooterForkException: ExecutionException Error occurred in starting fork, check output in log 2022-03-11T16:20:12.6945023Z Mar 11 16:20:12 [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.awaitResultsDone(ForkStarter.java:532) 2022-03-11T16:20:12.6945878Z Mar 11 16:20:12 [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.runSuitesForkPerTestSet(ForkStarter.java:479) 2022-03-11T16:20:12.6946761Z Mar 11 16:20:12 [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:322) 2022-03-11T16:20:12.6947532Z Mar 11 16:20:12 [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:266) 2022-03-11T16:20:12.6953051Z Mar 11 16:20:12 [ERROR] at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1314) 2022-03-11T16:20:12.6954035Z Mar 11 16:20:12 [ERROR] at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1159) 2022-03-11T16:20:12.6954917Z Mar 11 16:20:12 [ERROR] at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:932) 2022-03-11T16:20:12.6955749Z Mar 11 16:20:12 [ERROR] at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132) 2022-03-11T16:20:12.6956542Z Mar 11 16:20:12 [ERROR] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208) 2022-03-11T16:20:12.6957456Z Mar 11 16:20:12 [ERROR] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) 2022-03-11T16:20:12.6958232Z Mar 11 16:20:12 [ERROR] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) 2022-03-11T16:20:12.6959038Z Mar 11 16:20:12 [ERROR] at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116) 2022-03-11T16:20:12.6960553Z Mar 11 16:20:12 [ERROR] at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80) 2022-03-11T16:20:12.6962116Z Mar 11 16:20:12 [ERROR] at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51) 2022-03-11T16:20:12.6963009Z Mar 11 16:20:12 [ERROR] at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120) 2022-03-11T16:20:12.6963737Z Mar 11 16:20:12 [ERROR] at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:355) 2022-03-11T16:20:12.6964644Z Mar 11 16:20:12 [ERROR] at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155) 2022-03-11T16:20:12.6965647Z Mar 11 16:20:12 [ERROR] at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584) 2022-03-11T16:20:12.6966732Z Mar 11 16:20:12 [ERROR] at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:216) 2022-03-11T16:20:12.6967818Z Mar 11 16:20:12 [ERROR] at org.apache.maven.cli.MavenCli.main(MavenCli.java:160) 2022-03-11T16:20:12.6968857Z Mar 11 16:20:12 [ERROR] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 2022-03-11T16:20:12.6969986Z Mar 11 16:20:12 [ERROR] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2022-03-11T16:20:12.6971491Z Mar 11 16:20:12 [ERROR] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 2022-03-11T16:20:12.6972207Z Mar 11 16:20:12 [ERROR] at java.lang.reflect.Method.invoke(Method.java:498) 2022-03-11T16:20:12.6973134Z Mar 11 16:20:12 [ERROR] at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289) 2022-03-11T16:20:12.69740
[jira] [Created] (FLINK-26622) Azure failed due to Connection timed out
Yun Gao created FLINK-26622: --- Summary: Azure failed due to Connection timed out Key: FLINK-26622 URL: https://issues.apache.org/jira/browse/FLINK-26622 Project: Flink Issue Type: Bug Components: Build System / Azure Pipelines Affects Versions: 1.14.4 Reporter: Yun Gao {code:java} [ERROR] Failed to execute goal on project flink-connector-hive_2.12: Could not resolve dependencies for project org.apache.flink:flink-connector-hive_2.12:jar:1.14-SNAPSHOT: Failed to collect dependencies at org.apache.hive.hcatalog:hive-hcatalog-core:jar:1.2.1 -> org.apache.hive:hive-cli:jar:1.2.1: Failed to read artifact descriptor for org.apache.hive:hive-cli:jar:1.2.1: Could not transfer artifact org.apache.hive:hive-cli:pom:1.2.1 from/to google-maven-central (https://maven-central-eu.storage-download.googleapis.com/maven2/): Connect to maven-central-eu.storage-download.googleapis.com:443 [maven-central-eu.storage-download.googleapis.com/74.125.193.128] failed: Connection timed out (Connection timed out) -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn -rf :flink-connector-hive_2.12 {code} https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=32959&view=logs&j=08866332-78f7-59e4-4f7e-49a56faa3179&t=7f606211-1454-543c-70ab-c7a028a1ce8c&l=10112 -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-26623) BlobsCleanupITCase failed on azure
Yun Gao created FLINK-26623: --- Summary: BlobsCleanupITCase failed on azure Key: FLINK-26623 URL: https://issues.apache.org/jira/browse/FLINK-26623 Project: Flink Issue Type: Bug Components: Runtime / Coordination Affects Versions: 1.13.6 Reporter: Yun Gao {code:java} Mar 13 04:57:26 [ERROR] Tests run: 4, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 305.482 s <<< FAILURE! - in org.apache.flink.runtime.jobmanager.BlobsCleanupITCase Mar 13 04:57:26 [ERROR] testBlobServerCleanupFinishedJob(org.apache.flink.runtime.jobmanager.BlobsCleanupITCase) Time elapsed: 300.037 s <<< FAILURE! Mar 13 04:57:26 java.lang.AssertionError: Timeout while waiting for /tmp/junit381117489606603854/junit1195803545281590915/blobStore-ac2a81d0-0b74-416a-a7b2-de5f8bfa8d81 to become empty. Current contents: [job_] Mar 13 04:57:26 at org.junit.Assert.fail(Assert.java:88) Mar 13 04:57:26 at org.apache.flink.runtime.jobmanager.BlobsCleanupITCase.waitForEmptyBlobDir(BlobsCleanupITCase.java:282) Mar 13 04:57:26 at org.apache.flink.runtime.jobmanager.BlobsCleanupITCase.testBlobServerCleanup(BlobsCleanupITCase.java:237) Mar 13 04:57:26 at org.apache.flink.runtime.jobmanager.BlobsCleanupITCase.testBlobServerCleanupFinishedJob(BlobsCleanupITCase.java:129) Mar 13 04:57:26 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Mar 13 04:57:26 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Mar 13 04:57:26 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Mar 13 04:57:26 at java.lang.reflect.Method.invoke(Method.java:498) Mar 13 04:57:26 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) Mar 13 04:57:26 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) Mar 13 04:57:26 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) Mar 13 04:57:26 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) Mar 13 04:57:26 at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45) Mar 13 04:57:26 at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) Mar 13 04:57:26 at org.junit.rules.RunRules.evaluate(RunRules.java:20) Mar 13 04:57:26 at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) Mar 13 04:57:26 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) Mar 13 04:57:26 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) Mar 13 04:57:26 at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) Mar 13 04:57:26 at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) Mar 13 04:57:26 at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) Mar 13 04:57:26 at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) Mar 13 04:57:26 at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) Mar 13 04:57:26 at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) Mar 13 04:57:26 at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) Mar 13 04:57:26 at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) Mar 13 04:57:26 at org.junit.rules.RunRules.evaluate(RunRules.java:20) Mar 13 04:57:26 at org.junit.runners.ParentRunner.run(ParentRunner.java:363) Mar 13 04:57:26 at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) Mar 13 04:57:26 at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273) Mar 13 04:57:26 at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238) Mar 13 04:57:26 at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) Mar 13 04:57:26 at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384) Mar 13 04:57:26 at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345) Mar 13 04:57:26 at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126) {code} https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=32960&view=logs&j=59c257d0-c525-593b-261d-e96a86f1926b&t=b93980e3-753f-5433-6a19-13747adae66a&l=7169 -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-26624) Running HA (hashmap, async) end-to-end test failed on azure due to unable to find master logs
Yun Gao created FLINK-26624: --- Summary: Running HA (hashmap, async) end-to-end test failed on azure due to unable to find master logs Key: FLINK-26624 URL: https://issues.apache.org/jira/browse/FLINK-26624 Project: Flink Issue Type: Bug Components: Runtime / Coordination Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} Mar 12 04:31:15 Waiting for text Completed checkpoint [1-9]* for job 699ebf9bdcb51a9fe76db5463027d34c to appear 2 of times in logs... grep: /home/vsts/work/_temp/debug_files/flink-logs/*standalonesession-1*.log*: No such file or directory Mar 12 04:31:16 Starting standalonesession daemon on host fv-az302-918. grep: /home/vsts/work/_temp/debug_files/flink-logs/*standalonesession-1*.log*: No such file or directory Mar 12 04:41:23 A timeout occurred waiting for Completed checkpoint [1-9]* for job 699ebf9bdcb51a9fe76db5463027d34c to appear 2 of times in logs. Mar 12 04:41:23 Stopping job timeout watchdog (with pid=272045) Mar 12 04:41:23 Killing JM watchdog @ 273681 Mar 12 04:41:23 Killing TM watchdog @ 274268 Mar 12 04:41:23 [FAIL] Test script contains errors. Mar 12 04:41:23 Checking of logs skipped. Mar 12 04:41:23 Mar 12 04:41:23 [FAIL] 'Running HA (hashmap, async) end-to-end test' failed after 10 minutes and 31 seconds! Test exited with exit code 1 Mar 12 04:41:23 04:41:23 ##[group]Environment Information Mar 12 04:41:24 Searching for .dump, .dumpstream and related files in '/home/vsts/work/1/s' dmesg: read kernel buffer failed: Operation not permitted Mar 12 04:41:28 Stopping taskexecutor daemon (pid: 272837) on host fv-az302-918. Mar 12 04:41:29 Stopping standalonesession daemon (pid: 274590) on host fv-az302-918. Mar 12 04:41:35 Stopping zookeeper... Mar 12 04:41:36 Stopping zookeeper daemon (pid: 272248) on host fv-az302-918. The STDIO streams did not close within 10 seconds of the exit event from process '/usr/bin/bash'. This may indicate a child process inherited the STDIO streams and has not yet exited. ##[error]Bash exited with code '1'. {code} https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=32945&view=logs&j=bea52777-eaf8-5663-8482-18fbc3630e81&t=b2642e3a-5b86-574d-4c8a-f7e2842bfb14 -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-26625) KinesisFirehoseSinkITCase failed on azure due to Could not find a valid Docker environment
Yun Gao created FLINK-26625: --- Summary: KinesisFirehoseSinkITCase failed on azure due to Could not find a valid Docker environment Key: FLINK-26625 URL: https://issues.apache.org/jira/browse/FLINK-26625 Project: Flink Issue Type: Bug Components: Build System / Azure Pipelines Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} Mar 12 03:04:48 [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 11.946 s <<< FAILURE! - in org.apache.flink.connector.firehose.sink.KinesisFirehoseSinkITCase Mar 12 03:04:48 [ERROR] org.apache.flink.connector.firehose.sink.KinesisFirehoseSinkITCase Time elapsed: 11.946 s <<< ERROR! Mar 12 03:04:48 java.lang.IllegalStateException: Could not find a valid Docker environment. Please see logs and check configuration Mar 12 03:04:48 at org.testcontainers.dockerclient.DockerClientProviderStrategy.lambda$getFirstValidStrategy$4(DockerClientProviderStrategy.java:156) Mar 12 03:04:48 at java.util.Optional.orElseThrow(Optional.java:290) Mar 12 03:04:48 at org.testcontainers.dockerclient.DockerClientProviderStrategy.getFirstValidStrategy(DockerClientProviderStrategy.java:148) Mar 12 03:04:48 at org.testcontainers.DockerClientFactory.getOrInitializeStrategy(DockerClientFactory.java:146) Mar 12 03:04:48 at org.testcontainers.DockerClientFactory.client(DockerClientFactory.java:188) Mar 12 03:04:48 at org.testcontainers.DockerClientFactory$1.getDockerClient(DockerClientFactory.java:101) Mar 12 03:04:48 at com.github.dockerjava.api.DockerClientDelegate.authConfig(DockerClientDelegate.java:107) Mar 12 03:04:48 at org.testcontainers.containers.GenericContainer.start(GenericContainer.java:316) Mar 12 03:04:48 at org.testcontainers.containers.GenericContainer.starting(GenericContainer.java:1066) Mar 12 03:04:48 at org.testcontainers.containers.FailureDetectingExternalResource$1.evaluate(FailureDetectingExternalResource.java:29) Mar 12 03:04:48 at org.junit.rules.RunRules.evaluate(RunRules.java:20) Mar 12 03:04:48 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) Mar 12 03:04:48 at org.junit.runners.ParentRunner.run(ParentRunner.java:413) Mar 12 03:04:48 at org.junit.runner.JUnitCore.run(JUnitCore.java:137) Mar 12 03:04:48 at org.junit.runner.JUnitCore.run(JUnitCore.java:115) Mar 12 03:04:48 at org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:42) Mar 12 03:04:48 at org.junit.vintage.engine.VintageTestEngine.executeAllChildren(VintageTestEngine.java:80) Mar 12 03:04:48 at org.junit.vintage.engine.VintageTestEngine.execute(VintageTestEngine.java:72) Mar 12 03:04:48 at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:107) Mar 12 03:04:48 at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:88) Mar 12 03:04:48 at org.junit.platform.launcher.core.EngineExecutionOrchestrator.lambda$execute$0(EngineExecutionOrchestrator.java:54) Mar 12 03:04:48 at org.junit.platform.launcher.core.EngineExecutionOrchestrator.withInterceptedStreams(EngineExecutionOrchestrator.java:67) Mar 12 03:04:48 at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:52) Mar 12 03:04:48 at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:114) Mar 12 03:04:48 at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:86) Mar 12 03:04:48 at org.junit.platform.launcher.core.DefaultLauncherSession$DelegatingLauncher.execute(DefaultLauncherSession.java:86) Mar 12 03:04:48 at org.junit.platform.launcher.core.SessionPerRequestLauncher.execute(SessionPerRequestLauncher.java:53) Mar 12 03:04:48 at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.execute(JUnitPlatformProvider.java:188) Mar 12 03:04:48 at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invokeAllTests(JUnitPlatformProvider.java:154) Mar 12 03:04:48 at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invoke(JUnitPlatformProvider.java:124) Mar 12 03:04:48 at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:428) Mar 12 03:04:48 at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:162) Mar 12 03:04:48 at org.apache.maven.surefire.booter.ForkedBooter.run(ForkedBooter.java:562) Mar 12 03:04:48 at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:548) {code} https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=32945&view=logs&j=d44f43ce-542c-597d-bf94-b0718
[jira] [Created] (FLINK-26644) python StreamExecutionEnvironmentTests.test_generate_stream_graph_with_dependencies failed on azure
Yun Gao created FLINK-26644: --- Summary: python StreamExecutionEnvironmentTests.test_generate_stream_graph_with_dependencies failed on azure Key: FLINK-26644 URL: https://issues.apache.org/jira/browse/FLINK-26644 Project: Flink Issue Type: Bug Components: API / Python Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} 2022-03-14T18:50:24.6842853Z Mar 14 18:50:24 === FAILURES === 2022-03-14T18:50:24.6844089Z Mar 14 18:50:24 _ StreamExecutionEnvironmentTests.test_generate_stream_graph_with_dependencies _ 2022-03-14T18:50:24.6844846Z Mar 14 18:50:24 2022-03-14T18:50:24.6846063Z Mar 14 18:50:24 self = 2022-03-14T18:50:24.6847104Z Mar 14 18:50:24 2022-03-14T18:50:24.6847766Z Mar 14 18:50:24 def test_generate_stream_graph_with_dependencies(self): 2022-03-14T18:50:24.6848677Z Mar 14 18:50:24 python_file_dir = os.path.join(self.tempdir, "python_file_dir_" + str(uuid.uuid4())) 2022-03-14T18:50:24.6849833Z Mar 14 18:50:24 os.mkdir(python_file_dir) 2022-03-14T18:50:24.6850729Z Mar 14 18:50:24 python_file_path = os.path.join(python_file_dir, "test_stream_dependency_manage_lib.py") 2022-03-14T18:50:24.6852679Z Mar 14 18:50:24 with open(python_file_path, 'w') as f: 2022-03-14T18:50:24.6853646Z Mar 14 18:50:24 f.write("def add_two(a):\nreturn a + 2") 2022-03-14T18:50:24.6854394Z Mar 14 18:50:24 env = self.env 2022-03-14T18:50:24.6855019Z Mar 14 18:50:24 env.add_python_file(python_file_path) 2022-03-14T18:50:24.6855519Z Mar 14 18:50:24 2022-03-14T18:50:24.6856254Z Mar 14 18:50:24 def plus_two_map(value): 2022-03-14T18:50:24.6857045Z Mar 14 18:50:24 from test_stream_dependency_manage_lib import add_two 2022-03-14T18:50:24.6857865Z Mar 14 18:50:24 return value[0], add_two(value[1]) 2022-03-14T18:50:24.6858466Z Mar 14 18:50:24 2022-03-14T18:50:24.6858924Z Mar 14 18:50:24 def add_from_file(i): 2022-03-14T18:50:24.6859806Z Mar 14 18:50:24 with open("data/data.txt", 'r') as f: 2022-03-14T18:50:24.6860266Z Mar 14 18:50:24 return i[0], i[1] + int(f.read()) 2022-03-14T18:50:24.6860879Z Mar 14 18:50:24 2022-03-14T18:50:24.6862022Z Mar 14 18:50:24 from_collection_source = env.from_collection([('a', 0), ('b', 0), ('c', 1), ('d', 1), 2022-03-14T18:50:24.6863259Z Mar 14 18:50:24 ('e', 2)], 2022-03-14T18:50:24.6864057Z Mar 14 18:50:24 type_info=Types.ROW([Types.STRING(), 2022-03-14T18:50:24.6864651Z Mar 14 18:50:24 Types.INT()])) 2022-03-14T18:50:24.6865150Z Mar 14 18:50:24 from_collection_source.name("From Collection") 2022-03-14T18:50:24.6866212Z Mar 14 18:50:24 keyed_stream = from_collection_source.key_by(lambda x: x[1], key_type=Types.INT()) 2022-03-14T18:50:24.6867083Z Mar 14 18:50:24 2022-03-14T18:50:24.6867793Z Mar 14 18:50:24 plus_two_map_stream = keyed_stream.map(plus_two_map).name("Plus Two Map").set_parallelism(3) 2022-03-14T18:50:24.6868620Z Mar 14 18:50:24 2022-03-14T18:50:24.6869412Z Mar 14 18:50:24 add_from_file_map = plus_two_map_stream.map(add_from_file).name("Add From File Map") 2022-03-14T18:50:24.6870239Z Mar 14 18:50:24 2022-03-14T18:50:24.6870883Z Mar 14 18:50:24 test_stream_sink = add_from_file_map.add_sink(self.test_sink).name("Test Sink") 2022-03-14T18:50:24.6871803Z Mar 14 18:50:24 test_stream_sink.set_parallelism(4) 2022-03-14T18:50:24.6872291Z Mar 14 18:50:24 2022-03-14T18:50:24.6872756Z Mar 14 18:50:24 archive_dir_path = os.path.join(self.tempdir, "archive_" + str(uuid.uuid4())) 2022-03-14T18:50:24.6873557Z Mar 14 18:50:24 os.mkdir(archive_dir_path) 2022-03-14T18:50:24.6874817Z Mar 14 18:50:24 with open(os.path.join(archive_dir_path, "data.txt"), 'w') as f: 2022-03-14T18:50:24.6875414Z Mar 14 18:50:24 f.write("3") 2022-03-14T18:50:24.6875906Z Mar 14 18:50:24 archive_file_path = \ 2022-03-14T18:50:24.6876788Z Mar 14 18:50:24 > shutil.make_archive(os.path.dirname(archive_dir_path), 'zip', archive_dir_path) 2022-03-14T18:50:24.6877599Z Mar 14 18:50:24 2022-03-14T18:50:24.6878576Z Mar 14 18:50:24 /__w/1/s/flink-python/pyflink/datastream/tests/test_stream_execution_environment.py:655: 2022-03-14T18:50:24.6879569Z Mar 14 18:50:24 _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2022-03-14T18:50:24.6880151Z Mar 14 18:50:24 2022-03-14T18:50:24.6880751Z Mar 14 18:50:24 base_name = '/tmp/tmpk5wkf97b', format = 'zip' 2022-03-14T18:50:24.6881482Z Mar 14 18:50:24 root_dir = '/tmp/tmpk5wkf97b/archive_2dcc7
[jira] [Created] (FLINK-26674) flink-tests module exit with code 137
Yun Gao created FLINK-26674: --- Summary: flink-tests module exit with code 137 Key: FLINK-26674 URL: https://issues.apache.org/jira/browse/FLINK-26674 Project: Flink Issue Type: Bug Components: Build System / Azure Pipelines Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} Mar 15 11:59:15 [INFO] Running org.apache.flink.test.checkpointing.UdfStreamOperatorCheckpointingITCase ##[error]Exit code 137 returned from process: file name '/bin/docker', arguments 'exec -i -u 1002 -w /home/agent03_azpcontainer 2998dd55645fe5abba702fb33ae8a4b2d3aefa731c72647dca2c35ca56aa8446 /__a/externals/node/bin/node /__w/_temp/containerHandlerInvoker.js'. Finishing: Test - finegrained_resource_management {code} https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=33094&view=logs&j=a57e0635-3fad-5b08-57c7-a4142d7d6fa9&t=2ef0effc-1da1-50e5-c2bd-aab434b1c5b7&l=12376 -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-26721) PulsarSourceITCase.testSavepoint failed on azure pipeline
Yun Gao created FLINK-26721: --- Summary: PulsarSourceITCase.testSavepoint failed on azure pipeline Key: FLINK-26721 URL: https://issues.apache.org/jira/browse/FLINK-26721 Project: Flink Issue Type: Bug Components: Connectors / Pulsar Affects Versions: 1.16.0 Reporter: Yun Gao {code:java} Mar 18 05:49:52 [ERROR] Tests run: 12, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 315.581 s <<< FAILURE! - in org.apache.flink.connector.pulsar.source.PulsarSourceITCase Mar 18 05:49:52 [ERROR] org.apache.flink.connector.pulsar.source.PulsarSourceITCase.testSavepoint(TestEnvironment, DataStreamSourceExternalContext, CheckpointingMode)[1] Time elapsed: 140.803 s <<< FAILURE! Mar 18 05:49:52 java.lang.AssertionError: Mar 18 05:49:52 Mar 18 05:49:52 Expecting Mar 18 05:49:52 Mar 18 05:49:52 to be completed within 2M. Mar 18 05:49:52 Mar 18 05:49:52 exception caught while trying to get the future result: java.util.concurrent.TimeoutException Mar 18 05:49:52 at java.util.concurrent.CompletableFuture.timedGet(CompletableFuture.java:1784) Mar 18 05:49:52 at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1928) Mar 18 05:49:52 at org.assertj.core.internal.Futures.assertSucceededWithin(Futures.java:109) Mar 18 05:49:52 at org.assertj.core.api.AbstractCompletableFutureAssert.internalSucceedsWithin(AbstractCompletableFutureAssert.java:400) Mar 18 05:49:52 at org.assertj.core.api.AbstractCompletableFutureAssert.succeedsWithin(AbstractCompletableFutureAssert.java:396) Mar 18 05:49:52 at org.apache.flink.connector.testframe.testsuites.SourceTestSuiteBase.checkResultWithSemantic(SourceTestSuiteBase.java:766) Mar 18 05:49:52 at org.apache.flink.connector.testframe.testsuites.SourceTestSuiteBase.restartFromSavepoint(SourceTestSuiteBase.java:399) Mar 18 05:49:52 at org.apache.flink.connector.testframe.testsuites.SourceTestSuiteBase.testSavepoint(SourceTestSuiteBase.java:241) Mar 18 05:49:52 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Mar 18 05:49:52 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Mar 18 05:49:52 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Mar 18 05:49:52 at java.lang.reflect.Method.invoke(Method.java:498) Mar 18 05:49:52 at org.junit.platform.commons.util.ReflectionUtils.invokeMethod(ReflectionUtils.java:725) Mar 18 05:49:52 at org.junit.jupiter.engine.execution.MethodInvocation.proceed(MethodInvocation.java:60) Mar 18 05:49:52 at org.junit.jupiter.engine.execution.InvocationInterceptorChain$ValidatingInvocation.proceed(InvocationInterceptorChain.java:131) Mar 18 05:49:52 at org.junit.jupiter.engine.extension.TimeoutExtension.intercept(TimeoutExtension.java:149) Mar 18 05:49:52 at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestableMethod(TimeoutExtension.java:140) Mar 18 05:49:52 at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestTemplateMethod(TimeoutExtension.java:92) Mar 18 05:49:52 at org.junit.jupiter.engine.execution.ExecutableInvoker$ReflectiveInterceptorCall.lambda$ofVoidMethod$0(ExecutableInvoker.java:115) Mar 18 05:49:52 at org.junit.jupiter.engine.execution.ExecutableInvoker.lambda$invoke$0(ExecutableInvoker.java:105) Mar 18 05:49:52 at org.junit.jupiter.engine.execution.InvocationInterceptorChain$InterceptedInvocation.proceed(InvocationInterceptorChain.java:106) Mar 18 05:49:52 at org.junit.jupiter.engine.execution.InvocationInterceptorChain.proceed(InvocationInterceptorChain.java:64) Mar 18 05:49:52 at org.junit.jupiter.engine.execution.InvocationInterceptorChain.chainAndInvoke(InvocationInterceptorChain.java:45) Mar 18 05:49:52 at org.junit.jupiter.engine.execution.InvocationInterceptorChain.invoke(InvocationInterceptorChain.java:37) Mar 18 05:49:52 at org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:104) Mar 18 05:49:52 at org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:98) Mar 18 05:49:52 at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.lambda$invokeTestMethod$7(TestMethodTestDescriptor.java:214) Mar 18 05:49:52 at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) {code} https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=33282&view=logs&j=fc5181b0-e452-5c8f-68de-1097947f6483&t=995c650b-6573-581c-9ce6-7ad4cc038461&l=26498 -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-26724) FlinkKafkaProducerMigrationOperatorTest.testRestoreProducer failed on azure due to Container startup failed
Yun Gao created FLINK-26724: --- Summary: FlinkKafkaProducerMigrationOperatorTest.testRestoreProducer failed on azure due to Container startup failed Key: FLINK-26724 URL: https://issues.apache.org/jira/browse/FLINK-26724 Project: Flink Issue Type: Bug Components: Connectors / Kafka Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} 2022-03-17T10:27:56.1372771Z Mar 17 10:27:56 org.testcontainers.containers.ContainerLaunchException: Container startup failed 2022-03-17T10:27:56.1373469Z Mar 17 10:27:56at org.testcontainers.containers.GenericContainer.doStart(GenericContainer.java:336) 2022-03-17T10:27:56.1376022Z Mar 17 10:27:56at org.testcontainers.containers.GenericContainer.start(GenericContainer.java:317) 2022-03-17T10:27:56.1376901Z Mar 17 10:27:56at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183) 2022-03-17T10:27:56.1377769Z Mar 17 10:27:56at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384) 2022-03-17T10:27:56.1378489Z Mar 17 10:27:56at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) 2022-03-17T10:27:56.1379198Z Mar 17 10:27:56at java.util.stream.ForEachOps$ForEachTask.compute(ForEachOps.java:290) 2022-03-17T10:27:56.1379892Z Mar 17 10:27:56at java.util.concurrent.CountedCompleter.exec(CountedCompleter.java:731) 2022-03-17T10:27:56.1380595Z Mar 17 10:27:56at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) 2022-03-17T10:27:56.1381267Z Mar 17 10:27:56at java.util.concurrent.ForkJoinTask.doInvoke(ForkJoinTask.java:401) 2022-03-17T10:27:56.1381934Z Mar 17 10:27:56at java.util.concurrent.ForkJoinTask.invoke(ForkJoinTask.java:734) 2022-03-17T10:27:56.1382658Z Mar 17 10:27:56at java.util.stream.ForEachOps$ForEachOp.evaluateParallel(ForEachOps.java:159) 2022-03-17T10:27:56.1383409Z Mar 17 10:27:56at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateParallel(ForEachOps.java:173) 2022-03-17T10:27:56.1384358Z Mar 17 10:27:56at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:233) 2022-03-17T10:27:56.1385680Z Mar 17 10:27:56at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:485) 2022-03-17T10:27:56.1386625Z Mar 17 10:27:56at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:650) 2022-03-17T10:27:56.1387496Z Mar 17 10:27:56at org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironmentImpl.startKafkaContainerCluster(KafkaTestEnvironmentImpl.java:410) 2022-03-17T10:27:56.1388721Z Mar 17 10:27:56at org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironmentImpl.prepare(KafkaTestEnvironmentImpl.java:106) 2022-03-17T10:27:56.1389705Z Mar 17 10:27:56at org.apache.flink.streaming.connectors.kafka.KafkaTestBase.startClusters(KafkaTestBase.java:159) 2022-03-17T10:27:56.1390910Z Mar 17 10:27:56at org.apache.flink.streaming.connectors.kafka.KafkaTestBase.startClusters(KafkaTestBase.java:142) 2022-03-17T10:27:56.1392365Z Mar 17 10:27:56at org.apache.flink.streaming.connectors.kafka.KafkaMigrationTestBase.testRestoreProducer(KafkaMigrationTestBase.java:134) 2022-03-17T10:27:56.1393179Z Mar 17 10:27:56at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 2022-03-17T10:27:56.1393963Z Mar 17 10:27:56at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2022-03-17T10:27:56.1394714Z Mar 17 10:27:56at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 2022-03-17T10:27:56.1395908Z Mar 17 10:27:56at java.lang.reflect.Method.invoke(Method.java:498) 2022-03-17T10:27:56.1397053Z Mar 17 10:27:56at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) 2022-03-17T10:27:56.1398364Z Mar 17 10:27:56at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) 2022-03-17T10:27:56.1399604Z Mar 17 10:27:56at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) 2022-03-17T10:27:56.1400818Z Mar 17 10:27:56at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) 2022-03-17T10:27:56.1402257Z Mar 17 10:27:56at org.apache.flink.testutils.junit.RetryRule$RetryOnFailureStatement.evaluate(RetryRule.java:135) 2022-03-17T10:27:56.1403727Z Mar 17 10:27:56at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45) 2022-03-17T10:27:56.1404878Z Mar 17 10:27:56at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) 2022-03-17T10:27:56.1406161Z Mar 17 10:27:56at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) 2022-03-17T10:27:56.1407430Z Mar 17 10:27:56at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) 2022-03-17T10:27:56.1408678Z Mar 17 10:27:56at
[jira] [Created] (FLINK-26755) Cleanup inprogressfileRecoverable for FileSink on restoring
Yun Gao created FLINK-26755: --- Summary: Cleanup inprogressfileRecoverable for FileSink on restoring Key: FLINK-26755 URL: https://issues.apache.org/jira/browse/FLINK-26755 Project: Flink Issue Type: Bug Components: Connectors / FileSystem Affects Versions: 1.15.0, 1.16.0 Reporter: Yun Gao The FileSink has the similar issue to https://issues.apache.org/jira/browse/FLINK-26151 -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-26794) ChangelogRescalingITCase.test failed on azure due to java.nio.file.NoSuchFileException
Yun Gao created FLINK-26794: --- Summary: ChangelogRescalingITCase.test failed on azure due to java.nio.file.NoSuchFileException Key: FLINK-26794 URL: https://issues.apache.org/jira/browse/FLINK-26794 Project: Flink Issue Type: Bug Components: Runtime / State Backends Affects Versions: 1.16.0 Reporter: Yun Gao {code:java} Mar 21 17:33:56 [ERROR] Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 14.589 s <<< FAILURE! - in org.apache.flink.test.state.ChangelogRescalingITCase Mar 21 17:33:56 [ERROR] ChangelogRescalingITCase.test Time elapsed: 8.392 s <<< ERROR! Mar 21 17:33:56 java.io.UncheckedIOException: java.nio.file.NoSuchFileException: /tmp/junit4908969673123504454/junit6297505939941694356/d832f597d0b0414695fa746ffc400bb2/chk-43 Mar 21 17:33:56 at java.nio.file.FileTreeIterator.fetchNextIfNeeded(FileTreeIterator.java:88) Mar 21 17:33:56 at java.nio.file.FileTreeIterator.hasNext(FileTreeIterator.java:104) Mar 21 17:33:56 at java.util.Iterator.forEachRemaining(Iterator.java:115) Mar 21 17:33:56 at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801) Mar 21 17:33:56 at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) Mar 21 17:33:56 at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) Mar 21 17:33:56 at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) Mar 21 17:33:56 at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) Mar 21 17:33:56 at java.util.stream.ReferencePipeline.reduce(ReferencePipeline.java:546) Mar 21 17:33:56 at java.util.stream.ReferencePipeline.max(ReferencePipeline.java:582) Mar 21 17:33:56 at org.apache.flink.test.util.TestUtils.getMostRecentCompletedCheckpointMaybe(TestUtils.java:114) Mar 21 17:33:56 at org.apache.flink.test.state.ChangelogRescalingITCase.checkpointAndCancel(ChangelogRescalingITCase.java:333) Mar 21 17:33:56 at org.apache.flink.test.state.ChangelogRescalingITCase.test(ChangelogRescalingITCase.java:156) Mar 21 17:33:56 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Mar 21 17:33:56 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Mar 21 17:33:56 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Mar 21 17:33:56 at java.lang.reflect.Method.invoke(Method.java:498) Mar 21 17:33:56 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) Mar 21 17:33:56 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) Mar 21 17:33:56 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) Mar 21 17:33:56 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) Mar 21 17:33:56 at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) Mar 21 17:33:56 at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) Mar 21 17:33:56 at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54) Mar 21 17:33:56 at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45) Mar 21 17:33:56 at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) Mar 21 17:33:56 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) Mar 21 17:33:56 at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) Mar 21 17:33:56 at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) Mar 21 17:33:56 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) Mar 21 17:33:56 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) Mar 21 17:33:56 at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) Mar 21 17:33:56 at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) Mar 21 17:33:56 at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) Mar 21 17:33:56 at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) Mar 21 17:33:56 at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) {code} https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=33515&view=logs&j=5c8e7682-d68f-54d1-16a2-a09310218a49&t=86f654fa-ab48-5c1a-25f4-7e7f6afb9bba&l=5643 -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-26796) TaskManagerProcessFailureStreamingRecoveryITCase.testTaskManagerProcessFailure failed on azure
Yun Gao created FLINK-26796: --- Summary: TaskManagerProcessFailureStreamingRecoveryITCase.testTaskManagerProcessFailure failed on azure Key: FLINK-26796 URL: https://issues.apache.org/jira/browse/FLINK-26796 Project: Flink Issue Type: Bug Components: Runtime / Coordination Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} 2022-03-21T17:04:48.7388935Z Mar 21 17:04:48 [ERROR] TaskManagerProcessFailureStreamingRecoveryITCase>AbstractTaskManagerProcessFailureRecoveryTest.testTaskManagerProcessFailure:201 The program encountered a RestClientException : [org.apache.flink.runtime.rest.handler.RestHandlerException: org.apache.flink.runtime.messages.FlinkJobNotFoundException: Could not find Flink job (e5d2bef6fe1da660c2da45ef89c9acdb) 2022-03-21T17:04:48.7391533Z Mar 21 17:04:48at org.apache.flink.runtime.rest.handler.job.JobExecutionResultHandler.propagateException(JobExecutionResultHandler.java:94) 2022-03-21T17:04:48.7393502Z Mar 21 17:04:48at org.apache.flink.runtime.rest.handler.job.JobExecutionResultHandler.lambda$handleRequest$1(JobExecutionResultHandler.java:84) 2022-03-21T17:04:48.7394967Z Mar 21 17:04:48at java.util.concurrent.CompletableFuture.uniExceptionally(CompletableFuture.java:884) 2022-03-21T17:04:48.7396569Z Mar 21 17:04:48at java.util.concurrent.CompletableFuture$UniExceptionally.tryFire(CompletableFuture.java:866) 2022-03-21T17:04:48.7397895Z Mar 21 17:04:48at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) 2022-03-21T17:04:48.7399156Z Mar 21 17:04:48at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) 2022-03-21T17:04:48.7401447Z Mar 21 17:04:48at org.apache.flink.runtime.rpc.akka.AkkaInvocationHandler.lambda$invokeRpc$1(AkkaInvocationHandler.java:252) 2022-03-21T17:04:48.7402979Z Mar 21 17:04:48at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) 2022-03-21T17:04:48.7403835Z Mar 21 17:04:48at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) 2022-03-21T17:04:48.7404613Z Mar 21 17:04:48at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) 2022-03-21T17:04:48.7405337Z Mar 21 17:04:48at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) 2022-03-21T17:04:48.7406351Z Mar 21 17:04:48at org.apache.flink.util.concurrent.FutureUtils.doForward(FutureUtils.java:1387) 2022-03-21T17:04:48.7407088Z Mar 21 17:04:48at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$null$1(ClassLoadingUtils.java:93) 2022-03-21T17:04:48.7408037Z Mar 21 17:04:48at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68) 2022-03-21T17:04:48.7408971Z Mar 21 17:04:48at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$guardCompletionWithContextClassLoader$2(ClassLoadingUtils.java:92) 2022-03-21T17:04:48.7409816Z Mar 21 17:04:48at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) 2022-03-21T17:04:48.7410621Z Mar 21 17:04:48at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) 2022-03-21T17:04:48.7411616Z Mar 21 17:04:48at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) 2022-03-21T17:04:48.7412463Z Mar 21 17:04:48at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) 2022-03-21T17:04:48.7413295Z Mar 21 17:04:48at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$1.onComplete(AkkaFutureUtils.java:45) 2022-03-21T17:04:48.7413957Z Mar 21 17:04:48at akka.dispatch.OnComplete.internal(Future.scala:299) 2022-03-21T17:04:48.7414636Z Mar 21 17:04:48at akka.dispatch.OnComplete.internal(Future.scala:297) 2022-03-21T17:04:48.7415230Z Mar 21 17:04:48at akka.dispatch.japi$CallbackBridge.apply(Future.scala:224) 2022-03-21T17:04:48.7416123Z Mar 21 17:04:48at akka.dispatch.japi$CallbackBridge.apply(Future.scala:221) 2022-03-21T17:04:48.7416843Z Mar 21 17:04:48at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60) 2022-03-21T17:04:48.7417586Z Mar 21 17:04:48at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$DirectExecutionContext.execute(AkkaFutureUtils.java:65) 2022-03-21T17:04:48.7418360Z Mar 21 17:04:48at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:68) 2022-03-21T17:04:48.7419058Z Mar 21 17:04:48at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1(Promise.scala:284) 2022-03-21T17:04:48.7419820Z Mar 21 17:04:48at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1$adapted(Promise.scala:284) 2022-03-21T17:04:48.7420561Z Mar 21 17:04:48at sca
[jira] [Created] (FLINK-26797) ZKCheckpointIDCounterMultiServersTest.testRecoveredAfterConnectionLoss failed on azure
Yun Gao created FLINK-26797: --- Summary: ZKCheckpointIDCounterMultiServersTest.testRecoveredAfterConnectionLoss failed on azure Key: FLINK-26797 URL: https://issues.apache.org/jira/browse/FLINK-26797 Project: Flink Issue Type: Bug Components: Runtime / Coordination Affects Versions: 1.16.0 Reporter: Yun Gao {code:java} Mar 21 07:39:44 [ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 23.662 s <<< FAILURE! - in org.apache.flink.runtime.checkpoint.ZKCheckpointIDCounterMultiServersTest Mar 21 07:39:44 [ERROR] org.apache.flink.runtime.checkpoint.ZKCheckpointIDCounterMultiServersTest.testRecoveredAfterConnectionLoss Time elapsed: 23.639 s <<< FAILURE! Mar 21 07:39:44 java.lang.AssertionError: Mar 21 07:39:44 ZooKeeperCheckpointIDCounter doesn't properly work after reconnected. Mar 21 07:39:44 Expected: is <2L> Mar 21 07:39:44 but: was <3L> Mar 21 07:39:44 at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20) Mar 21 07:39:44 at org.junit.Assert.assertThat(Assert.java:964) Mar 21 07:39:44 at org.apache.flink.runtime.checkpoint.ZKCheckpointIDCounterMultiServersTest.testRecoveredAfterConnectionLoss(ZKCheckpointIDCounterMultiServersTest.java:86) Mar 21 07:39:44 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Mar 21 07:39:44 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Mar 21 07:39:44 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Mar 21 07:39:44 at java.lang.reflect.Method.invoke(Method.java:498) Mar 21 07:39:44 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) Mar 21 07:39:44 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) Mar 21 07:39:44 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) Mar 21 07:39:44 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) Mar 21 07:39:44 at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54) Mar 21 07:39:44 at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45) Mar 21 07:39:44 at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) Mar 21 07:39:44 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) Mar 21 07:39:44 at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) Mar 21 07:39:44 at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) Mar 21 07:39:44 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) Mar 21 07:39:44 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) Mar 21 07:39:44 at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) Mar 21 07:39:44 at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) Mar 21 07:39:44 at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) Mar 21 07:39:44 at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) Mar 21 07:39:44 at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) Mar 21 07:39:44 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) Mar 21 07:39:44 at org.junit.runners.ParentRunner.run(ParentRunner.java:413) Mar 21 07:39:44 at org.junit.runner.JUnitCore.run(JUnitCore.java:137) Mar 21 07:39:44 at org.junit.runner.JUnitCore.run(JUnitCore.java:115) Mar 21 07:39:44 at org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:42) Mar 21 07:39:44 at org.junit.vintage.engine.VintageTestEngine.executeAllChildren(VintageTestEngine.java:80) Mar 21 07:39:44 at org.junit.vintage.engine.VintageTestEngine.execute(VintageTestEngine.java:72) Mar 21 07:39:44 at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:107) {code} https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=33448&view=logs&j=a57e0635-3fad-5b08-57c7-a4142d7d6fa9&t=2ef0effc-1da1-50e5-c2bd-aab434b1c5b7&l=9173 -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-26835) WordCountSubclassPOJOITCase failed on azure
Yun Gao created FLINK-26835: --- Summary: WordCountSubclassPOJOITCase failed on azure Key: FLINK-26835 URL: https://issues.apache.org/jira/browse/FLINK-26835 Project: Flink Issue Type: Bug Components: API / Type Serialization System Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} 2022-03-23T10:17:21.4299023Z Job execution failed. 2022-03-23T10:17:21.4302519Z org.apache.flink.runtime.client.JobExecutionException: Job execution failed. 2022-03-23T10:17:21.4303977Zat org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:144) 2022-03-23T10:17:21.4305375Zat org.apache.flink.runtime.minicluster.MiniClusterJobClient.lambda$getJobExecutionResult$3(MiniClusterJobClient.java:141) 2022-03-23T10:17:21.4306669Zat java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616) 2022-03-23T10:17:21.4307818Zat java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591) 2022-03-23T10:17:21.4309084Zat java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) 2022-03-23T10:17:21.4310326Zat java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) 2022-03-23T10:17:21.4311773Zat org.apache.flink.runtime.rpc.akka.AkkaInvocationHandler.lambda$invokeRpc$1(AkkaInvocationHandler.java:259) 2022-03-23T10:17:21.4313817Zat java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) 2022-03-23T10:17:21.4314754Zat java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) 2022-03-23T10:17:21.4315516Zat java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) 2022-03-23T10:17:21.4316374Zat java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) 2022-03-23T10:17:21.4317031Zat org.apache.flink.util.concurrent.FutureUtils.doForward(FutureUtils.java:1389) 2022-03-23T10:17:21.4318008Zat org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$null$1(ClassLoadingUtils.java:93) 2022-03-23T10:17:21.4318771Zat org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68) 2022-03-23T10:17:21.4320119Zat org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$guardCompletionWithContextClassLoader$2(ClassLoadingUtils.java:92) 2022-03-23T10:17:21.4321262Zat java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) 2022-03-23T10:17:21.4322370Zat java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) 2022-03-23T10:17:21.4323463Zat java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) 2022-03-23T10:17:21.4324523Zat java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) 2022-03-23T10:17:21.4325464Zat org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$1.onComplete(AkkaFutureUtils.java:47) 2022-03-23T10:17:21.4326700Zat akka.dispatch.OnComplete.internal(Future.scala:300) 2022-03-23T10:17:21.4327381Zat akka.dispatch.OnComplete.internal(Future.scala:297) 2022-03-23T10:17:21.4328048Zat akka.dispatch.japi$CallbackBridge.apply(Future.scala:224) 2022-03-23T10:17:21.4328928Zat akka.dispatch.japi$CallbackBridge.apply(Future.scala:221) 2022-03-23T10:17:21.4329822Zat scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60) 2022-03-23T10:17:21.4330681Zat org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$DirectExecutionContext.execute(AkkaFutureUtils.java:65) 2022-03-23T10:17:21.4331401Zat scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:68) 2022-03-23T10:17:21.4332336Zat scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1(Promise.scala:284) 2022-03-23T10:17:21.425Zat scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1$adapted(Promise.scala:284) 2022-03-23T10:17:21.4334292Zat scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:284) 2022-03-23T10:17:21.4335314Zat akka.pattern.PromiseActorRef.$bang(AskSupport.scala:621) 2022-03-23T10:17:21.4336167Zat akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:24) 2022-03-23T10:17:21.4337330Zat akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:23) 2022-03-23T10:17:21.4338240Zat scala.concurrent.Future.$anonfun$andThen$1(Future.scala:532) 2022-03-23T10:17:21.4339230Zat scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:29) 2022-03-23T10:17:21.4339978Zat scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:29) 2022-03-23T10:17:21.4340703Zat scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60) 2022-03-23T10:17:21.4341316Zat akka.dispatch.Batch
[jira] [Created] (FLINK-26837) KafkaSinkE2ECase.testMetrics failed on azure
Yun Gao created FLINK-26837: --- Summary: KafkaSinkE2ECase.testMetrics failed on azure Key: FLINK-26837 URL: https://issues.apache.org/jira/browse/FLINK-26837 Project: Flink Issue Type: Bug Components: Connectors / Kafka Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} 2022-03-23T11:31:24.8110184Z Mar 23 11:31:24 [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.644 s - in org.apache.flink.tests.util.kafka.SmokeKafkaITCase 2022-03-23T11:31:24.8211872Z Mar 23 11:31:24 [INFO] Running org.apache.flink.tests.util.kafka.KafkaSinkE2ECase 2022-03-23T11:34:19.9737001Z Mar 23 11:34:19 [ERROR] Tests run: 10, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 175.144 s <<< FAILURE! - in org.apache.flink.tests.util.kafka.KafkaSinkE2ECase 2022-03-23T11:34:19.9745550Z Mar 23 11:34:19 [ERROR] org.apache.flink.tests.util.kafka.KafkaSinkE2ECase.testMetrics(TestEnvironment, DataStreamSinkExternalContext, CheckpointingMode)[1] Time elapsed: 33.671 s <<< ERROR! 2022-03-23T11:34:19.9746518Z Mar 23 11:34:19 java.util.concurrent.TimeoutException: Some tasks are not running until timeout 2022-03-23T11:34:19.9747987Z Mar 23 11:34:19at org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:167) 2022-03-23T11:34:19.9748809Z Mar 23 11:34:19at org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:152) 2022-03-23T11:34:19.9749807Z Mar 23 11:34:19at org.apache.flink.runtime.testutils.CommonTestUtils.waitForAllTaskRunning(CommonTestUtils.java:235) 2022-03-23T11:34:19.9761004Z Mar 23 11:34:19at org.apache.flink.connector.testframe.testsuites.SinkTestSuiteBase.testMetrics(SinkTestSuiteBase.java:390) 2022-03-23T11:34:19.9761886Z Mar 23 11:34:19at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 2022-03-23T11:34:19.9762592Z Mar 23 11:34:19at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2022-03-23T11:34:19.9763357Z Mar 23 11:34:19at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 2022-03-23T11:34:19.9764073Z Mar 23 11:34:19at java.lang.reflect.Method.invoke(Method.java:498) 2022-03-23T11:34:19.9764770Z Mar 23 11:34:19at org.junit.platform.commons.util.ReflectionUtils.invokeMethod(ReflectionUtils.java:725) 2022-03-23T11:34:19.9765525Z Mar 23 11:34:19at org.junit.jupiter.engine.execution.MethodInvocation.proceed(MethodInvocation.java:60) 2022-03-23T11:34:19.9766388Z Mar 23 11:34:19at org.junit.jupiter.engine.execution.InvocationInterceptorChain$ValidatingInvocation.proceed(InvocationInterceptorChain.java:131) 2022-03-23T11:34:19.9767243Z Mar 23 11:34:19at org.junit.jupiter.engine.extension.TimeoutExtension.intercept(TimeoutExtension.java:149) 2022-03-23T11:34:19.9768044Z Mar 23 11:34:19at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestableMethod(TimeoutExtension.java:140) 2022-03-23T11:34:19.9768879Z Mar 23 11:34:19at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestTemplateMethod(TimeoutExtension.java:92) 2022-03-23T11:34:19.9769991Z Mar 23 11:34:19at org.junit.jupiter.engine.execution.ExecutableInvoker$ReflectiveInterceptorCall.lambda$ofVoidMethod$0(ExecutableInvoker.java:115) 2022-03-23T11:34:19.9770865Z Mar 23 11:34:19at org.junit.jupiter.engine.execution.ExecutableInvoker.lambda$invoke$0(ExecutableInvoker.java:105) 2022-03-23T11:34:19.9771739Z Mar 23 11:34:19at org.junit.jupiter.engine.execution.InvocationInterceptorChain$InterceptedInvocation.proceed(InvocationInterceptorChain.java:106) 2022-03-23T11:34:19.9772637Z Mar 23 11:34:19at org.junit.jupiter.engine.execution.InvocationInterceptorChain.proceed(InvocationInterceptorChain.java:64) 2022-03-23T11:34:19.9822314Z Mar 23 11:34:19at org.junit.jupiter.engine.execution.InvocationInterceptorChain.chainAndInvoke(InvocationInterceptorChain.java:45) 2022-03-23T11:34:19.9836627Z Mar 23 11:34:19at org.junit.jupiter.engine.execution.InvocationInterceptorChain.invoke(InvocationInterceptorChain.java:37) 2022-03-23T11:34:19.9837324Z Mar 23 11:34:19at org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:104) 2022-03-23T11:34:19.9837957Z Mar 23 11:34:19at org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:98) 2022-03-23T11:34:19.9838631Z Mar 23 11:34:19at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.lambda$invokeTestMethod$7(TestMethodTestDescriptor.java:214) 2022-03-23T11:34:19.9843708Z Mar 23 11:34:19at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) 2022-03-23T11:34:19.9845057Z Mar 23 11:34:19at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.invokeTestMethod(TestMethodTestDescriptor.
[jira] [Created] (FLINK-26838) BatchingStateChangeUploadSchedulerTest.testRetryOnTimeout failed on azure
Yun Gao created FLINK-26838: --- Summary: BatchingStateChangeUploadSchedulerTest.testRetryOnTimeout failed on azure Key: FLINK-26838 URL: https://issues.apache.org/jira/browse/FLINK-26838 Project: Flink Issue Type: Bug Components: Runtime / State Backends Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} Mar 23 05:59:48 [ERROR] org.apache.flink.changelog.fs.BatchingStateChangeUploadSchedulerTest.testRetryOnTimeout Time elapsed: 0.041 s <<< FAILURE! Mar 23 05:59:48 java.lang.AssertionError: expected:<[0]> but was:<[]> Mar 23 05:59:48 at org.junit.Assert.fail(Assert.java:89) Mar 23 05:59:48 at org.junit.Assert.failNotEquals(Assert.java:835) Mar 23 05:59:48 at org.junit.Assert.assertEquals(Assert.java:120) Mar 23 05:59:48 at org.junit.Assert.assertEquals(Assert.java:146) Mar 23 05:59:48 at org.apache.flink.changelog.fs.BatchingStateChangeUploadSchedulerTest.testRetryOnTimeout(BatchingStateChangeUploadSchedulerTest.java:240) Mar 23 05:59:48 at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Mar 23 05:59:48 at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Mar 23 05:59:48 at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Mar 23 05:59:48 at java.base/java.lang.reflect.Method.invoke(Method.java:566) Mar 23 05:59:48 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) Mar 23 05:59:48 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) Mar 23 05:59:48 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) Mar 23 05:59:48 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) Mar 23 05:59:48 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) Mar 23 05:59:48 at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) Mar 23 05:59:48 at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) Mar 23 05:59:48 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) Mar 23 05:59:48 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) Mar 23 05:59:48 at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) Mar 23 05:59:48 at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) Mar 23 05:59:48 at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) Mar 23 05:59:48 at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) Mar 23 05:59:48 at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) Mar 23 05:59:48 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) Mar 23 05:59:48 at org.junit.runners.ParentRunner.run(ParentRunner.java:413) Mar 23 05:59:48 at org.junit.runner.JUnitCore.run(JUnitCore.java:137) Mar 23 05:59:48 at org.junit.runner.JUnitCore.run(JUnitCore.java:115) Mar 23 05:59:48 at org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:42) Mar 23 05:59:48 at org.junit.vintage.engine.VintageTestEngine.executeAllChildren(VintageTestEngine.java:80) Mar 23 05:59:48 at org.junit.vintage.engine.VintageTestEngine.execute(VintageTestEngine.java:72) Mar 23 05:59:48 at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:107) Mar 23 05:59:48 at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:88) Mar 23 05:59:48 at org.junit.platform.launcher.core.EngineExecutionOrchestrator.lambda$execute$0(EngineExecutionOrchestrator.java:54) Mar 23 05:59:48 at org.junit.platform.launcher.core.EngineExecutionOrchestrator.withInterceptedStreams(EngineExecutionOrchestrator.java:67) Mar 23 05:59:48 at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:52) Mar 23 05:59:48 at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:114) {code} https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=33627&view=logs&j=298e20ef-7951-5965-0e79-ea664ddc435e&t=d4c90338-c843-57b0-3232-10ae74f00347&l=25630 -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-26839) SessionDispatcherLeaderProcessTest.recoverJobs_withJobIdRecoveryFailure_failsFatally failed on azures
Yun Gao created FLINK-26839: --- Summary: SessionDispatcherLeaderProcessTest.recoverJobs_withJobIdRecoveryFailure_failsFatally failed on azures Key: FLINK-26839 URL: https://issues.apache.org/jira/browse/FLINK-26839 Project: Flink Issue Type: Bug Components: Runtime / Coordination Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} Mar 24 04:11:15 [ERROR] SessionDispatcherLeaderProcessTest.recoverJobs_withJobIdRecoveryFailure_failsFatally:667->runJobRecoveryFailureTest:677 Mar 24 04:11:15 Expecting Mar 24 04:11:15 Mar 24 04:11:15 to be completed within 100L Millis. Mar 24 04:11:15 Mar 24 04:11:15 exception caught while trying to get the future result: java.util.concurrent.TimeoutException Mar 24 04:11:15 at java.util.concurrent.CompletableFuture.timedGet(CompletableFuture.java:1784) Mar 24 04:11:15 at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1928) Mar 24 04:11:15 at org.assertj.core.internal.Futures.assertSucceededWithin(Futures.java:100) Mar 24 04:11:15 at org.assertj.core.api.AbstractCompletableFutureAssert.internalSucceedsWithin(AbstractCompletableFutureAssert.java:438) Mar 24 04:11:15 at org.assertj.core.api.AbstractCompletableFutureAssert.succeedsWithin(AbstractCompletableFutureAssert.java:434) Mar 24 04:11:15 at org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcessTest.runJobRecoveryFailureTest(SessionDispatcherLeaderProcessTest.java:677) Mar 24 04:11:15 at org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcessTest.recoverJobs_withJobIdRecoveryFailure_failsFatally(SessionDispatcherLeaderProcessTest.java:667) Mar 24 04:11:15 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Mar 24 04:11:15 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Mar 24 04:11:15 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Mar 24 04:11:15 at java.lang.reflect.Method.invoke(Method.java:498) Mar 24 04:11:15 at org.junit.platform.commons.util.ReflectionUtils.invokeMethod(ReflectionUtils.java:725) Mar 24 04:11:15 at org.junit.jupiter.engine.execution.MethodInvocation.proceed(MethodInvocation.java:60) Mar 24 04:11:15 at org.junit.jupiter.engine.execution.InvocationInterceptorChain$ValidatingInvocation.proceed(InvocationInterceptorChain.java:131) Mar 24 04:11:15 at org.junit.jupiter.engine.extension.TimeoutExtension.intercept(TimeoutExtension.java:149) Mar 24 04:11:15 at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestableMethod(TimeoutExtension.java:140) Mar 24 04:11:15 at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestMethod(TimeoutExtension.java:84) Mar 24 04:11:15 at org.junit.jupiter.engine.execution.ExecutableInvoker$ReflectiveInterceptorCall.lambda$ofVoidMethod$0(ExecutableInvoker.java:115) Mar 24 04:11:15 at org.junit.jupiter.engine.execution.ExecutableInvoker.lambda$invoke$0(ExecutableInvoker.java:105) Mar 24 04:11:15 at org.junit.jupiter.engine.execution.InvocationInterceptorChain$InterceptedInvocation.proceed(InvocationInterceptorChain.java:106) Mar 24 04:11:15 at org.junit.jupiter.engine.execution.InvocationInterceptorChain.proceed(InvocationInterceptorChain.java:64) Mar 24 04:11:15 at org.junit.jupiter.engine.execution.InvocationInterceptorChain.chainAndInvoke(InvocationInterceptorChain.java:45) Mar 24 04:11:15 at org.junit.jupiter.engine.execution.InvocationInterceptorChain.invoke(InvocationInterceptorChain.java:37) Mar 24 04:11:15 at org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:104) Mar 24 04:11:15 at org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:98) Mar 24 04:11:15 at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.lambda$invokeTestMethod$7(TestMethodTestDescriptor.java:214) Mar 24 04:11:15 at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) Mar 24 04:11:15 at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.invokeTestMethod(TestMethodTestDescriptor.java:210) Mar 24 04:11:15 at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:135) {code} https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=33672&view=logs&j=a549b384-c55a-52c0-c451-00e0477ab6db&t=eef5922c-08d9-5ba3-7299-8393476594e7&l=9662 -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-26880) PyFlinkStreamUserDefinedFunctionTests.test_udf_in_join_condition failed on azure
Yun Gao created FLINK-26880: --- Summary: PyFlinkStreamUserDefinedFunctionTests.test_udf_in_join_condition failed on azure Key: FLINK-26880 URL: https://issues.apache.org/jira/browse/FLINK-26880 Project: Flink Issue Type: Bug Components: API / Python Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} Mar 26 07:08:21 === FAILURES === Mar 26 07:08:21 ___ PyFlinkStreamUserDefinedFunctionTests.test_udf_in_join_condition ___ Mar 26 07:08:21 Mar 26 07:08:21 self = Mar 26 07:08:21 Mar 26 07:08:21 def test_udf_in_join_condition(self): Mar 26 07:08:21 t1 = self.t_env.from_elements([(2, "Hi")], ['a', 'b']) Mar 26 07:08:21 t2 = self.t_env.from_elements([(2, "Flink")], ['c', 'd']) Mar 26 07:08:21 Mar 26 07:08:21 f = udf(lambda i: i, result_type=DataTypes.BIGINT()) Mar 26 07:08:21 Mar 26 07:08:21 table_sink = source_sink_utils.TestAppendSink( Mar 26 07:08:21 ['a', 'b', 'c', 'd'], Mar 26 07:08:21 [DataTypes.BIGINT(), DataTypes.STRING(), DataTypes.BIGINT(), DataTypes.STRING()]) Mar 26 07:08:21 self.t_env.register_table_sink("Results", table_sink) Mar 26 07:08:21 Mar 26 07:08:21 > t1.join(t2).where(f(t1.a) == t2.c).execute_insert("Results").wait() Mar 26 07:08:21 Mar 26 07:08:21 pyflink/table/tests/test_udf.py:104: Mar 26 07:08:21 _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ Mar 26 07:08:21 pyflink/table/table.py:1083: in execute_insert Mar 26 07:08:21 return TableResult(self._j_table.executeInsert(table_path_or_descriptor, overwrite)) Mar 26 07:08:21 .tox/py38-cython/lib/python3.8/site-packages/py4j/java_gateway.py:1321: in __call__ Mar 26 07:08:21 return_value = get_return_value( Mar 26 07:08:21 pyflink/util/exceptions.py:146: in deco Mar 26 07:08:21 return f(*a, **kw) Mar 26 07:08:21 _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ Mar 26 07:08:21 Mar 26 07:08:21 answer = 'xro22141' Mar 26 07:08:21 gateway_client = Mar 26 07:08:21 target_id = 'o22134', name = 'executeInsert' Mar 26 07:08:21 Mar 26 07:08:21 def get_return_value(answer, gateway_client, target_id=None, name=None): Mar 26 07:08:21 """Converts an answer received from the Java gateway into a Python object. Mar 26 07:08:21 Mar 26 07:08:21 For example, string representation of integers are converted to Python Mar 26 07:08:21 integer, string representation of objects are converted to JavaObject Mar 26 07:08:21 instances, etc. {code} https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=33774&view=logs&j=9cada3cb-c1d3-5621-16da-0f718fb86602&t=c67e71ed-6451-5d26-8920-5a8cf9651901 -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-26907) RMQSourceITCase failed on azure due to ContainerLaunchException: Container startup failed
Yun Gao created FLINK-26907: --- Summary: RMQSourceITCase failed on azure due to ContainerLaunchException: Container startup failed Key: FLINK-26907 URL: https://issues.apache.org/jira/browse/FLINK-26907 Project: Flink Issue Type: Bug Components: Build System, Connectors/ RabbitMQ Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} 2-03-28T09:41:01.3374229Z Mar 28 09:41:01 [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 91.834 s <<< FAILURE! - in org.apache.flink.streaming.connectors.rabbitmq.RMQSourceITCase 2022-03-28T09:41:01.3375722Z Mar 28 09:41:01 [ERROR] org.apache.flink.streaming.connectors.rabbitmq.RMQSourceITCase Time elapsed: 91.834 s <<< ERROR! 2022-03-28T09:41:01.3376743Z Mar 28 09:41:01 org.testcontainers.containers.ContainerLaunchException: Container startup failed 2022-03-28T09:41:01.3378470Z Mar 28 09:41:01at org.testcontainers.containers.GenericContainer.doStart(GenericContainer.java:336) 2022-03-28T09:41:01.3379355Z Mar 28 09:41:01at org.testcontainers.containers.GenericContainer.start(GenericContainer.java:317) 2022-03-28T09:41:01.3380117Z Mar 28 09:41:01at org.testcontainers.containers.GenericContainer.starting(GenericContainer.java:1066) 2022-03-28T09:41:01.3381076Z Mar 28 09:41:01at org.testcontainers.containers.FailureDetectingExternalResource$1.evaluate(FailureDetectingExternalResource.java:29) 2022-03-28T09:41:01.3382198Z Mar 28 09:41:01at org.junit.rules.RunRules.evaluate(RunRules.java:20) 2022-03-28T09:41:01.3383575Z Mar 28 09:41:01at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) 2022-03-28T09:41:01.3384717Z Mar 28 09:41:01at org.junit.runners.ParentRunner.run(ParentRunner.java:413) 2022-03-28T09:41:01.3385671Z Mar 28 09:41:01at org.junit.runner.JUnitCore.run(JUnitCore.java:137) 2022-03-28T09:41:01.3386611Z Mar 28 09:41:01at org.junit.runner.JUnitCore.run(JUnitCore.java:115) 2022-03-28T09:41:01.3387691Z Mar 28 09:41:01at org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:42) 2022-03-28T09:41:01.3388981Z Mar 28 09:41:01at org.junit.vintage.engine.VintageTestEngine.executeAllChildren(VintageTestEngine.java:80) 2022-03-28T09:41:01.3390250Z Mar 28 09:41:01at org.junit.vintage.engine.VintageTestEngine.execute(VintageTestEngine.java:72) 2022-03-28T09:41:01.3391619Z Mar 28 09:41:01at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:107) 2022-03-28T09:41:01.3393437Z Mar 28 09:41:01at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:88) 2022-03-28T09:41:01.3394826Z Mar 28 09:41:01at org.junit.platform.launcher.core.EngineExecutionOrchestrator.lambda$execute$0(EngineExecutionOrchestrator.java:54) 2022-03-28T09:41:01.3396333Z Mar 28 09:41:01at org.junit.platform.launcher.core.EngineExecutionOrchestrator.withInterceptedStreams(EngineExecutionOrchestrator.java:67) 2022-03-28T09:41:01.3397800Z Mar 28 09:41:01at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:52) 2022-03-28T09:41:01.3399166Z Mar 28 09:41:01at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:114) 2022-03-28T09:41:01.3400315Z Mar 28 09:41:01at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:86) 2022-03-28T09:41:01.3401636Z Mar 28 09:41:01at org.junit.platform.launcher.core.DefaultLauncherSession$DelegatingLauncher.execute(DefaultLauncherSession.java:86) 2022-03-28T09:41:01.3403403Z Mar 28 09:41:01at org.junit.platform.launcher.core.SessionPerRequestLauncher.execute(SessionPerRequestLauncher.java:53) 2022-03-28T09:41:01.3404823Z Mar 28 09:41:01at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.execute(JUnitPlatformProvider.java:188) 2022-03-28T09:41:01.3406517Z Mar 28 09:41:01at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invokeAllTests(JUnitPlatformProvider.java:154) 2022-03-28T09:41:01.3407936Z Mar 28 09:41:01at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invoke(JUnitPlatformProvider.java:124) 2022-03-28T09:41:01.3409418Z Mar 28 09:41:01at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:428) 2022-03-28T09:41:01.3410464Z Mar 28 09:41:01at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:162) 2022-03-28T09:41:01.3411498Z Mar 28 09:41:01at org.apache.maven.surefire.booter.ForkedBooter.run(ForkedBooter.java:562) 2022-03-28T09:41:01.3412484Z Mar 28 09:41:01at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:548) 2022-03-28T09:41:01.3413741Z Mar 28 09:41:01 Caused by: org.rnorth.ducttape.RetryCountExceededException: Retry limit hit with exception 2022
[jira] [Created] (FLINK-26921) KafkaSinkE2ECase.testStartFromSavepoint failed on azure
Yun Gao created FLINK-26921: --- Summary: KafkaSinkE2ECase.testStartFromSavepoint failed on azure Key: FLINK-26921 URL: https://issues.apache.org/jira/browse/FLINK-26921 Project: Flink Issue Type: Bug Components: Connectors / Kafka Affects Versions: 1.15.0 Reporter: Yun Gao Fix For: 1.15.0 {code:java} 2022-03-29T08:08:40.8158780Z Mar 29 08:08:40 [ERROR] Tests run: 10, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 181.448 s <<< FAILURE! - in org.apache.flink.tests.util.kafka.KafkaSinkE2ECase 2022-03-29T08:08:40.8164304Z Mar 29 08:08:40 [ERROR] org.apache.flink.tests.util.kafka.KafkaSinkE2ECase.testStartFromSavepoint(TestEnvironment, DataStreamSinkExternalContext, CheckpointingMode)[1] Time elapsed: 40.065 s <<< ERROR! 2022-03-29T08:08:40.8166237Z Mar 29 08:08:40 java.util.concurrent.TimeoutException: Condition was not met in given timeout. 2022-03-29T08:08:40.8167431Z Mar 29 08:08:40at org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:167) 2022-03-29T08:08:40.8168412Z Mar 29 08:08:40at org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:145) 2022-03-29T08:08:40.8169380Z Mar 29 08:08:40at org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:137) 2022-03-29T08:08:40.8170349Z Mar 29 08:08:40at org.apache.flink.runtime.testutils.CommonTestUtils.waitForJobStatus(CommonTestUtils.java:285) 2022-03-29T08:08:40.8171306Z Mar 29 08:08:40at org.apache.flink.connector.testframe.testsuites.SinkTestSuiteBase.killJob(SinkTestSuiteBase.java:565) 2022-03-29T08:08:40.8172594Z Mar 29 08:08:40at org.apache.flink.connector.testframe.testsuites.SinkTestSuiteBase.restartFromSavepoint(SinkTestSuiteBase.java:339) 2022-03-29T08:08:40.8173644Z Mar 29 08:08:40at org.apache.flink.connector.testframe.testsuites.SinkTestSuiteBase.testStartFromSavepoint(SinkTestSuiteBase.java:184) 2022-03-29T08:08:40.8174543Z Mar 29 08:08:40at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 2022-03-29T08:08:40.8175883Z Mar 29 08:08:40at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2022-03-29T08:08:40.8176693Z Mar 29 08:08:40at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 2022-03-29T08:08:40.8177354Z Mar 29 08:08:40at java.lang.reflect.Method.invoke(Method.java:498) 2022-03-29T08:08:40.8182704Z Mar 29 08:08:40at org.junit.platform.commons.util.ReflectionUtils.invokeMethod(ReflectionUtils.java:725) 2022-03-29T08:08:40.8184845Z Mar 29 08:08:40at org.junit.jupiter.engine.execution.MethodInvocation.proceed(MethodInvocation.java:60) 2022-03-29T08:08:40.8185816Z Mar 29 08:08:40at org.junit.jupiter.engine.execution.InvocationInterceptorChain$ValidatingInvocation.proceed(InvocationInterceptorChain.java:131) 2022-03-29T08:08:40.8186862Z Mar 29 08:08:40at org.junit.jupiter.engine.extension.TimeoutExtension.intercept(TimeoutExtension.java:149) 2022-03-29T08:08:40.8187625Z Mar 29 08:08:40at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestableMethod(TimeoutExtension.java:140) 2022-03-29T08:08:40.8188421Z Mar 29 08:08:40at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestTemplateMethod(TimeoutExtension.java:92) 2022-03-29T08:08:40.8189279Z Mar 29 08:08:40at org.junit.jupiter.engine.execution.ExecutableInvoker$ReflectiveInterceptorCall.lambda$ofVoidMethod$0(ExecutableInvoker.java:115) 2022-03-29T08:08:40.8190343Z Mar 29 08:08:40at org.junit.jupiter.engine.execution.ExecutableInvoker.lambda$invoke$0(ExecutableInvoker.java:105) 2022-03-29T08:08:40.8191193Z Mar 29 08:08:40at org.junit.jupiter.engine.execution.InvocationInterceptorChain$InterceptedInvocation.proceed(InvocationInterceptorChain.java:106) 2022-03-29T08:08:40.8192057Z Mar 29 08:08:40at org.junit.jupiter.engine.execution.InvocationInterceptorChain.proceed(InvocationInterceptorChain.java:64) 2022-03-29T08:08:40.8192873Z Mar 29 08:08:40at org.junit.jupiter.engine.execution.InvocationInterceptorChain.chainAndInvoke(InvocationInterceptorChain.java:45) 2022-03-29T08:08:40.8193697Z Mar 29 08:08:40at org.junit.jupiter.engine.execution.InvocationInterceptorChain.invoke(InvocationInterceptorChain.java:37) 2022-03-29T08:08:40.8194844Z Mar 29 08:08:40at org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:104) 2022-03-29T08:08:40.8195781Z Mar 29 08:08:40at org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:98) 2022-03-29T08:08:40.8196588Z Mar 29 08:08:40at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.lambda$invokeTestMethod$7(TestMethodTestDescriptor.java:214) 2022-03-29T08:08:40.8197616Z Mar 29 08:08:40at org.junit.platform.engine.s
[jira] [Created] (FLINK-26922) KafkaSinkITCase.testRecoveryWithExactlyOnceGuaranteeAndConcurrentCheckpoints failed on azure
Yun Gao created FLINK-26922: --- Summary: KafkaSinkITCase.testRecoveryWithExactlyOnceGuaranteeAndConcurrentCheckpoints failed on azure Key: FLINK-26922 URL: https://issues.apache.org/jira/browse/FLINK-26922 Project: Flink Issue Type: Bug Components: Connectors / Kafka Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} 2022-03-29T06:20:18.1760718Z Mar 29 06:20:18 [ERROR] Tests run: 8, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 116.912 s <<< FAILURE! - in org.apache.flink.connector.kafka.sink.KafkaSinkITCase 2022-03-29T06:20:18.1762540Z Mar 29 06:20:18 [ERROR] org.apache.flink.connector.kafka.sink.KafkaSinkITCase.testRecoveryWithExactlyOnceGuaranteeAndConcurrentCheckpoints Time elapsed: 30.087 s <<< FAILURE! 2022-03-29T06:20:18.1763909Z Mar 29 06:20:18 org.opentest4j.MultipleFailuresError: 2022-03-29T06:20:18.1765302Z Mar 29 06:20:18 Multiple Failures (2 failures) 2022-03-29T06:20:18.1766544Z Mar 29 06:20:18 java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.TimeoutException: The request timed out. 2022-03-29T06:20:18.1768163Z Mar 29 06:20:18 java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. 2022-03-29T06:20:18.1769034Z Mar 29 06:20:18at org.junit.vintage.engine.execution.TestRun.getStoredResultOrSuccessful(TestRun.java:196) 2022-03-29T06:20:18.1769850Z Mar 29 06:20:18at org.junit.vintage.engine.execution.RunListenerAdapter.fireExecutionFinished(RunListenerAdapter.java:226) 2022-03-29T06:20:18.1770979Z Mar 29 06:20:18at org.junit.vintage.engine.execution.RunListenerAdapter.testFinished(RunListenerAdapter.java:192) 2022-03-29T06:20:18.1772244Z Mar 29 06:20:18at org.junit.vintage.engine.execution.RunListenerAdapter.testFinished(RunListenerAdapter.java:79) 2022-03-29T06:20:18.1773131Z Mar 29 06:20:18at org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) 2022-03-29T06:20:18.1774252Z Mar 29 06:20:18at org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) 2022-03-29T06:20:18.1775004Z Mar 29 06:20:18at org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) 2022-03-29T06:20:18.1775857Z Mar 29 06:20:18at org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) 2022-03-29T06:20:18.1776826Z Mar 29 06:20:18at org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) 2022-03-29T06:20:18.124Z Mar 29 06:20:18at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) 2022-03-29T06:20:18.1778617Z Mar 29 06:20:18at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) 2022-03-29T06:20:18.1779395Z Mar 29 06:20:18at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) 2022-03-29T06:20:18.1780054Z Mar 29 06:20:18at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) 2022-03-29T06:20:18.1780688Z Mar 29 06:20:18at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) 2022-03-29T06:20:18.1781340Z Mar 29 06:20:18at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) 2022-03-29T06:20:18.1782014Z Mar 29 06:20:18at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) 2022-03-29T06:20:18.1782867Z Mar 29 06:20:18at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) 2022-03-29T06:20:18.1783647Z Mar 29 06:20:18at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) 2022-03-29T06:20:18.1784349Z Mar 29 06:20:18at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) 2022-03-29T06:20:18.1804236Z Mar 29 06:20:18at org.testcontainers.containers.FailureDetectingExternalResource$1.evaluate(FailureDetectingExternalResource.java:30) 2022-03-29T06:20:18.1805948Z Mar 29 06:20:18at org.junit.rules.RunRules.evaluate(RunRules.java:20) 2022-03-29T06:20:18.1807077Z Mar 29 06:20:18at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) 2022-03-29T06:20:18.1808190Z Mar 29 06:20:18at org.junit.runners.ParentRunner.run(ParentRunner.java:413) 2022-03-29T06:20:18.1809730Z Mar 29 06:20:18at org.junit.runner.JUnitCore.run(JUnitCore.java:137) 2022-03-29T06:20:18.1810753Z Mar 29 06:20:18at org.junit.runner.JUnitCore.run(JUnitCore.java:115) 2022-03-29T06:20:18.1812091Z Mar 29 06:20:18at org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:42) 2022-03-29T06:20:18.1813709Z Mar 29 06:20:18at org.junit.vintage.engine.VintageTestEngine.executeAllChildren(VintageTestEngine.java:80) 2022-03-29T06:20:18.1815050Z Mar 29 06:20:18at org.junit.vintage.engine.VintageTestEngine.execute(VintageTestEngin
[jira] [Created] (FLINK-26923) SavepointITCase.testStopWithSavepointFailsOverToSavepoint failed on azure
Yun Gao created FLINK-26923: --- Summary: SavepointITCase.testStopWithSavepointFailsOverToSavepoint failed on azure Key: FLINK-26923 URL: https://issues.apache.org/jira/browse/FLINK-26923 Project: Flink Issue Type: Bug Components: Runtime / Checkpointing Affects Versions: 1.16.0 Reporter: Yun Gao {code:java} 2022-03-29T05:50:18.9604940Z Mar 29 05:50:18 [ERROR] Tests run: 20, Failures: 0, Errors: 1, Skipped: 1, Time elapsed: 28.306 s <<< FAILURE! - in org.apache.flink.test.checkpointing.SavepointITCase 2022-03-29T05:50:18.9609713Z Mar 29 05:50:18 [ERROR] org.apache.flink.test.checkpointing.SavepointITCase.testStopWithSavepointFailsOverToSavepoint Time elapsed: 3.363 s <<< ERROR! 2022-03-29T05:50:18.9611347Z Mar 29 05:50:18 org.apache.flink.util.FlinkException: Stop with savepoint operation could not be completed. 2022-03-29T05:50:18.9613057Z Mar 29 05:50:18at org.apache.flink.runtime.scheduler.adaptive.StopWithSavepoint.onLeave(StopWithSavepoint.java:124) 2022-03-29T05:50:18.9614629Z Mar 29 05:50:18at org.apache.flink.runtime.scheduler.adaptive.AdaptiveScheduler.transitionToState(AdaptiveScheduler.java:1181) 2022-03-29T05:50:18.9616369Z Mar 29 05:50:18at org.apache.flink.runtime.scheduler.adaptive.AdaptiveScheduler.goToRestarting(AdaptiveScheduler.java:858) 2022-03-29T05:50:18.9618273Z Mar 29 05:50:18at org.apache.flink.runtime.scheduler.adaptive.FailureResultUtil.restartOrFail(FailureResultUtil.java:28) 2022-03-29T05:50:18.9619815Z Mar 29 05:50:18at org.apache.flink.runtime.scheduler.adaptive.StopWithSavepoint.onFailure(StopWithSavepoint.java:149) 2022-03-29T05:50:18.9621464Z Mar 29 05:50:18at org.apache.flink.runtime.scheduler.adaptive.StateWithExecutionGraph.updateTaskExecutionState(StateWithExecutionGraph.java:367) 2022-03-29T05:50:18.9623122Z Mar 29 05:50:18at org.apache.flink.runtime.scheduler.adaptive.AdaptiveScheduler.lambda$updateTaskExecutionState$4(AdaptiveScheduler.java:496) 2022-03-29T05:50:18.9624528Z Mar 29 05:50:18at org.apache.flink.runtime.scheduler.adaptive.State.tryCall(State.java:137) 2022-03-29T05:50:18.9626318Z Mar 29 05:50:18at org.apache.flink.runtime.scheduler.adaptive.AdaptiveScheduler.updateTaskExecutionState(AdaptiveScheduler.java:493) 2022-03-29T05:50:18.9627831Z Mar 29 05:50:18at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78) 2022-03-29T05:50:18.9629329Z Mar 29 05:50:18at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443) 2022-03-29T05:50:18.9630643Z Mar 29 05:50:18at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) 2022-03-29T05:50:18.9632127Z Mar 29 05:50:18at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 2022-03-29T05:50:18.9633394Z Mar 29 05:50:18at java.lang.reflect.Method.invoke(Method.java:498) 2022-03-29T05:50:18.9634943Z Mar 29 05:50:18at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304) 2022-03-29T05:50:18.9636737Z Mar 29 05:50:18at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83) 2022-03-29T05:50:18.9638234Z Mar 29 05:50:18at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302) 2022-03-29T05:50:18.9639920Z Mar 29 05:50:18at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217) 2022-03-29T05:50:18.9641506Z Mar 29 05:50:18at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78) 2022-03-29T05:50:18.9643007Z Mar 29 05:50:18at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163) 2022-03-29T05:50:18.9644379Z Mar 29 05:50:18at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) 2022-03-29T05:50:18.9645829Z Mar 29 05:50:18at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) 2022-03-29T05:50:18.9647316Z Mar 29 05:50:18at scala.PartialFunction.applyOrElse(PartialFunction.scala:123) 2022-03-29T05:50:18.9648648Z Mar 29 05:50:18at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122) 2022-03-29T05:50:18.9650044Z Mar 29 05:50:18at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) 2022-03-29T05:50:18.9651437Z Mar 29 05:50:18at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) 2022-03-29T05:50:18.9652830Z Mar 29 05:50:18at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) 2022-03-29T05:50:18.9654205Z Mar 29 05:50:18at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) 2022-03-29T05:50:18.9655489Z Mar 29 05:50:18at akka.actor.Actor.aroundReceive(Actor.scala:537) 2022-03-29T05:50:18.9656976Z Mar 29 05:50:18at akka.a
[jira] [Created] (FLINK-26974) Python EmbeddedThreadDependencyTests.test_add_python_file failed on azure
Yun Gao created FLINK-26974: --- Summary: Python EmbeddedThreadDependencyTests.test_add_python_file failed on azure Key: FLINK-26974 URL: https://issues.apache.org/jira/browse/FLINK-26974 Project: Flink Issue Type: Bug Components: API / Python Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} Mar 31 10:49:17 === FAILURES === Mar 31 10:49:17 __ EmbeddedThreadDependencyTests.test_add_python_file __ Mar 31 10:49:17 Mar 31 10:49:17 self = Mar 31 10:49:17 Mar 31 10:49:17 def test_add_python_file(self): Mar 31 10:49:17 python_file_dir = os.path.join(self.tempdir, "python_file_dir_" + str(uuid.uuid4())) Mar 31 10:49:17 os.mkdir(python_file_dir) Mar 31 10:49:17 python_file_path = os.path.join(python_file_dir, "test_dependency_manage_lib.py") Mar 31 10:49:17 with open(python_file_path, 'w') as f: Mar 31 10:49:17 f.write("def add_two(a):\nraise Exception('This function should not be called!')") Mar 31 10:49:17 self.t_env.add_python_file(python_file_path) Mar 31 10:49:17 Mar 31 10:49:17 python_file_dir_with_higher_priority = os.path.join( Mar 31 10:49:17 self.tempdir, "python_file_dir_" + str(uuid.uuid4())) Mar 31 10:49:17 os.mkdir(python_file_dir_with_higher_priority) Mar 31 10:49:17 python_file_path_higher_priority = os.path.join(python_file_dir_with_higher_priority, Mar 31 10:49:17 "test_dependency_manage_lib.py") Mar 31 10:49:17 with open(python_file_path_higher_priority, 'w') as f: Mar 31 10:49:17 f.write("def add_two(a):\nreturn a + 2") Mar 31 10:49:17 self.t_env.add_python_file(python_file_path_higher_priority) Mar 31 10:49:17 Mar 31 10:49:17 def plus_two(i): Mar 31 10:49:17 from test_dependency_manage_lib import add_two Mar 31 10:49:17 return add_two(i) Mar 31 10:49:17 Mar 31 10:49:17 self.t_env.create_temporary_system_function( Mar 31 10:49:17 "add_two", udf(plus_two, DataTypes.BIGINT(), DataTypes.BIGINT())) Mar 31 10:49:17 table_sink = source_sink_utils.TestAppendSink( Mar 31 10:49:17 ['a', 'b'], [DataTypes.BIGINT(), DataTypes.BIGINT()]) Mar 31 10:49:17 self.t_env.register_table_sink("Results", table_sink) Mar 31 10:49:17 t = self.t_env.from_elements([(1, 2), (2, 5), (3, 1)], ['a', 'b']) Mar 31 10:49:17 > t.select(expr.call("add_two", t.a), t.a).execute_insert("Results").wait() Mar 31 10:49:17 Mar 31 10:49:17 pyflink/table/tests/test_dependency.py:63: Mar 31 10:49:17 _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ Mar 31 10:49:17 pyflink/table/table_result.py:76: in wait Mar 31 10:49:17 get_method(self._j_table_result, "await")() Mar 31 10:49:17 .tox/py38-cython/lib/python3.8/site-packages/py4j/java_gateway.py:1321: in __call__ {code} https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=34001&view=logs&j=821b528f-1eed-5598-a3b4-7f748b13f261&t=6bb545dd-772d-5d8c-f258-f5085fba3295&l=27239 -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-26977) JobMasterStopWithSavepointITCase.throwingExceptionOnCallbackWithRestartsShouldSimplyRestartInTerminate failed on azure
Yun Gao created FLINK-26977: --- Summary: JobMasterStopWithSavepointITCase.throwingExceptionOnCallbackWithRestartsShouldSimplyRestartInTerminate failed on azure Key: FLINK-26977 URL: https://issues.apache.org/jira/browse/FLINK-26977 Project: Flink Issue Type: Bug Components: Runtime / Checkpointing Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} 2022-03-31T06:11:52.2333685Z Mar 31 06:11:52 [ERROR] Tests run: 5, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 35.288 s <<< FAILURE! - in org.apache.flink.runtime.jobmaster.JobMasterStopWithSavepointITCase 2022-03-31T06:11:52.2336004Z Mar 31 06:11:52 [ERROR] org.apache.flink.runtime.jobmaster.JobMasterStopWithSavepointITCase.throwingExceptionOnCallbackWithRestartsShouldSimplyRestartInTerminate Time elapsed: 15.008 s <<< FAILURE! 2022-03-31T06:11:52.2336907Z Mar 31 06:11:52 java.lang.AssertionError 2022-03-31T06:11:52.2337353Z Mar 31 06:11:52at org.junit.Assert.fail(Assert.java:87) 2022-03-31T06:11:52.2337876Z Mar 31 06:11:52at org.junit.Assert.assertTrue(Assert.java:42) 2022-03-31T06:11:52.2338631Z Mar 31 06:11:52at org.junit.Assert.assertTrue(Assert.java:53) 2022-03-31T06:11:52.2339436Z Mar 31 06:11:52at org.apache.flink.runtime.jobmaster.JobMasterStopWithSavepointITCase.throwingExceptionOnCallbackWithRestartsHelper(JobMasterStopWithSavepointITCase.java:159) 2022-03-31T06:11:52.2340599Z Mar 31 06:11:52at org.apache.flink.runtime.jobmaster.JobMasterStopWithSavepointITCase.throwingExceptionOnCallbackWithRestartsShouldSimplyRestartInTerminate(JobMasterStopWithSavepointITCase.java:136) 2022-03-31T06:11:52.2342251Z Mar 31 06:11:52at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 2022-03-31T06:11:52.2342896Z Mar 31 06:11:52at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2022-03-31T06:11:52.2343608Z Mar 31 06:11:52at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 2022-03-31T06:11:52.2344234Z Mar 31 06:11:52at java.lang.reflect.Method.invoke(Method.java:498) 2022-03-31T06:11:52.2344873Z Mar 31 06:11:52at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) 2022-03-31T06:11:52.2345590Z Mar 31 06:11:52at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) 2022-03-31T06:11:52.2346498Z Mar 31 06:11:52at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) 2022-03-31T06:11:52.2347221Z Mar 31 06:11:52at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) 2022-03-31T06:11:52.2347922Z Mar 31 06:11:52at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) 2022-03-31T06:11:52.2348580Z Mar 31 06:11:52at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54) 2022-03-31T06:11:52.2349222Z Mar 31 06:11:52at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45) 2022-03-31T06:11:52.2349860Z Mar 31 06:11:52at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) 2022-03-31T06:11:52.2350502Z Mar 31 06:11:52at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) 2022-03-31T06:11:52.2351172Z Mar 31 06:11:52at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) 2022-03-31T06:11:52.2352095Z Mar 31 06:11:52at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) 2022-03-31T06:11:52.2352949Z Mar 31 06:11:52at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) 2022-03-31T06:11:52.2353643Z Mar 31 06:11:52at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) 2022-03-31T06:11:52.2354298Z Mar 31 06:11:52at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) 2022-03-31T06:11:52.2354909Z Mar 31 06:11:52at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) 2022-03-31T06:11:52.2355535Z Mar 31 06:11:52at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) 2022-03-31T06:11:52.2356505Z Mar 31 06:11:52at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) 2022-03-31T06:11:52.2357142Z Mar 31 06:11:52at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) 2022-03-31T06:11:52.2357771Z Mar 31 06:11:52at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54) 2022-03-31T06:11:52.2358400Z Mar 31 06:11:52at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54) 2022-03-31T06:11:52.2359014Z Mar 31 06:11:52at org.junit.rules.RunRules.evaluate(RunRules.java:20) 2022-03-31T06:11:52.2359614Z Mar 31 06:11:52at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) 2022-03-31T06:11:52.2360221Z Mar 31 06:11:52at org.junit.runners.ParentRunne
[jira] [Created] (FLINK-26979) JsonFunctionsITCase.test failed on azure
Yun Gao created FLINK-26979: --- Summary: JsonFunctionsITCase.test failed on azure Key: FLINK-26979 URL: https://issues.apache.org/jira/browse/FLINK-26979 Project: Flink Issue Type: Bug Components: Table SQL / Planner Affects Versions: 1.16.0 Reporter: Yun Gao {code:java} Mar 31 04:38:37 [ERROR] Tests run: 140, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 11.301 s <<< FAILURE! - in org.apache.flink.table.planner.functions.JsonFunctionsITCase Mar 31 04:38:37 [ERROR] org.apache.flink.table.planner.functions.JsonFunctionsITCase.test(TestCase)[64] Time elapsed: 0.738 s <<< ERROR! Mar 31 04:38:37 java.lang.RuntimeException: Duplicate vertexID 452 Mar 31 04:38:37 at org.apache.flink.streaming.api.graph.StreamGraph.addNode(StreamGraph.java:504) Mar 31 04:38:37 at org.apache.flink.streaming.api.graph.StreamGraph.addOperator(StreamGraph.java:403) Mar 31 04:38:37 at org.apache.flink.streaming.api.graph.StreamGraph.addOperator(StreamGraph.java:382) Mar 31 04:38:37 at org.apache.flink.streaming.runtime.translators.AbstractOneInputTransformationTranslator.translateInternal(AbstractOneInputTransformationTranslator.java:63) Mar 31 04:38:37 at org.apache.flink.streaming.runtime.translators.OneInputTransformationTranslator.translateForStreamingInternal(OneInputTransformationTranslator.java:65) Mar 31 04:38:37 at org.apache.flink.streaming.runtime.translators.OneInputTransformationTranslator.translateForStreamingInternal(OneInputTransformationTranslator.java:37) Mar 31 04:38:37 at org.apache.flink.streaming.api.graph.SimpleTransformationTranslator.translateForStreaming(SimpleTransformationTranslator.java:62) Mar 31 04:38:37 at org.apache.flink.streaming.api.graph.StreamGraphGenerator.translate(StreamGraphGenerator.java:825) Mar 31 04:38:37 at org.apache.flink.streaming.api.graph.StreamGraphGenerator.transform(StreamGraphGenerator.java:555) Mar 31 04:38:37 at org.apache.flink.streaming.api.graph.StreamGraphGenerator.getParentInputIds(StreamGraphGenerator.java:846) Mar 31 04:38:37 at org.apache.flink.streaming.api.graph.StreamGraphGenerator.translate(StreamGraphGenerator.java:804) Mar 31 04:38:37 at org.apache.flink.streaming.api.graph.StreamGraphGenerator.transform(StreamGraphGenerator.java:555) Mar 31 04:38:37 at org.apache.flink.streaming.api.graph.StreamGraphGenerator.generate(StreamGraphGenerator.java:316) Mar 31 04:38:37 at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.generateStreamGraph(StreamExecutionEnvironment.java:2153) Mar 31 04:38:37 at org.apache.flink.table.planner.delegation.DefaultExecutor.createPipeline(DefaultExecutor.java:83) Mar 31 04:38:37 at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeQueryOperation(TableEnvironmentImpl.java:832) Mar 31 04:38:37 at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:1317) Mar 31 04:38:37 at org.apache.flink.table.api.internal.TableImpl.execute(TableImpl.java:475) Mar 31 04:38:37 at org.apache.flink.table.planner.functions.BuiltInFunctionTestBase$ResultTestItem.test(BuiltInFunctionTestBase.java:354) Mar 31 04:38:37 at org.apache.flink.table.planner.functions.BuiltInFunctionTestBase$TestSetSpec.lambda$getTestCase$4(BuiltInFunctionTestBase.java:320) Mar 31 04:38:37 at org.apache.flink.table.planner.functions.BuiltInFunctionTestBase$TestCase.execute(BuiltInFunctionTestBase.java:113) Mar 31 04:38:37 at org.apache.flink.table.planner.functions.BuiltInFunctionTestBase.test(BuiltInFunctionTestBase.java:93) Mar 31 04:38:37 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Mar 31 04:38:37 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Mar 31 04:38:37 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Mar 31 04:38:37 at java.lang.reflect.Method.invoke(Method.java:498) Mar 31 04:38:37 at org.junit.platform.commons.util.ReflectionUtils.invokeMethod(ReflectionUtils.java:725) Mar 31 04:38:37 at org.junit.jupiter.engine.execution.MethodInvocation.proceed(MethodInvocation.java:60) Mar 31 04:38:37 at org.junit.jupiter.engine.execution.InvocationInterceptorChain$ValidatingInvocation.proceed(InvocationInterceptorChain.java:131) Mar 31 04:38:37 at org.junit.jupiter.engine.extension.TimeoutExtension.intercept(TimeoutExtension.java:149) Mar 31 04:38:37 at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestableMethod(TimeoutExtension.java:140) Mar 31 04:38:37 at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestTemplateMethod(TimeoutExtension.java:92) Mar 31 04:38:37
[jira] [Created] (FLINK-26980) PulsarUnorderedSourceReaderTest hang on azure
Yun Gao created FLINK-26980: --- Summary: PulsarUnorderedSourceReaderTest hang on azure Key: FLINK-26980 URL: https://issues.apache.org/jira/browse/FLINK-26980 Project: Flink Issue Type: Bug Components: Connectors / Pulsar Affects Versions: 1.16.0 Reporter: Yun Gao {code:java} 2022-03-30T13:04:22.7440894Z "main" #1 prio=5 os_prio=0 tid=0x7ff99000b000 nid=0x207d waiting on condition [0x7ff9991d3000] 2022-03-30T13:04:22.7441395Zjava.lang.Thread.State: WAITING (parking) 2022-03-30T13:04:22.7441786Zat sun.misc.Unsafe.park(Native Method) 2022-03-30T13:04:22.7442444Z- parking to wait for <0xf7173b40> (a java.util.concurrent.CompletableFuture$Signaller) 2022-03-30T13:04:22.7443345Zat java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) 2022-03-30T13:04:22.7443991Zat java.util.concurrent.CompletableFuture$Signaller.block(CompletableFuture.java:1707) 2022-03-30T13:04:22.7444607Zat java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3323) 2022-03-30T13:04:22.7445207Zat java.util.concurrent.CompletableFuture.waitingGet(CompletableFuture.java:1742) 2022-03-30T13:04:22.7445802Zat java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908) 2022-03-30T13:04:22.7446435Zat org.apache.pulsar.broker.systopic.SystemTopicClientBase.close(SystemTopicClientBase.java:100) 2022-03-30T13:04:22.7447212Zat org.apache.pulsar.broker.service.SystemTopicBaseTxnBufferSnapshotService.close(SystemTopicBaseTxnBufferSnapshotService.java:83) 2022-03-30T13:04:22.7447938Zat org.apache.pulsar.broker.PulsarService.closeAsync(PulsarService.java:449) 2022-03-30T13:04:22.7448501Zat org.apache.pulsar.broker.PulsarService.close(PulsarService.java:350) 2022-03-30T13:04:22.7449168Zat org.apache.flink.connector.pulsar.testutils.runtime.mock.PulsarMockRuntime.tearDown(PulsarMockRuntime.java:67) 2022-03-30T13:04:22.7449932Zat org.apache.flink.connector.pulsar.testutils.PulsarTestEnvironment.afterAll(PulsarTestEnvironment.java:102) 2022-03-30T13:04:22.7450729Zat org.junit.jupiter.engine.descriptor.ClassBasedTestDescriptor.lambda$invokeAfterAllCallbacks$16(ClassBasedTestDescriptor.java:447) 2022-03-30T13:04:22.7451485Zat org.junit.jupiter.engine.descriptor.ClassBasedTestDescriptor$$Lambda$1403/485877014.execute(Unknown Source) 2022-03-30T13:04:22.7452178Zat org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) 2022-03-30T13:04:22.7453169Zat org.junit.jupiter.engine.descriptor.ClassBasedTestDescriptor.lambda$invokeAfterAllCallbacks$17(ClassBasedTestDescriptor.java:447) 2022-03-30T13:04:22.7453937Zat org.junit.jupiter.engine.descriptor.ClassBasedTestDescriptor$$Lambda$459/1334008558.accept(Unknown Source) 2022-03-30T13:04:22.7454508Zat java.util.ArrayList.forEach(ArrayList.java:1259) 2022-03-30T13:04:22.7455157Zat org.junit.jupiter.engine.descriptor.ClassBasedTestDescriptor.invokeAfterAllCallbacks(ClassBasedTestDescriptor.java:447) 2022-03-30T13:04:22.7455928Zat org.junit.jupiter.engine.descriptor.ClassBasedTestDescriptor.after(ClassBasedTestDescriptor.java:229) 2022-03-30T13:04:22.7456645Zat org.junit.jupiter.engine.descriptor.ClassBasedTestDescriptor.after(ClassBasedTestDescriptor.java:80) 2022-03-30T13:04:22.7457386Zat org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$7(NodeTestTask.java:161) 2022-03-30T13:04:22.7458173Zat org.junit.platform.engine.support.hierarchical.NodeTestTask$$Lambda$319/1589876871.execute(Unknown Source) 2022-03-30T13:04:22.7458864Zat org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) 2022-03-30T13:04:22.7459604Zat org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:161) 2022-03-30T13:04:22.7460308Zat org.junit.platform.engine.support.hierarchical.NodeTestTask$$Lambda$306/2123533871.invoke(Unknown Source) 2022-03-30T13:04:22.7460995Zat org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137) 2022-03-30T13:04:22.7461674Zat org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139) 2022-03-30T13:04:22.7462377Zat org.junit.platform.engine.support.hierarchical.NodeTestTask$$Lambda$305/1406253491.execute(Unknown Source) 2022-03-30T13:04:22.7463351Zat org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) 2022-03-30T13:04:22.7464091Zat org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:138) 2022-03-30T13:04:22.7464778Zat org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:95) 2022-03-30T13:04:22.7465496Zat o
[jira] [Created] (FLINK-27073) HAQueryableStateFsBackendITCase hangs on azure
Yun Gao created FLINK-27073: --- Summary: HAQueryableStateFsBackendITCase hangs on azure Key: FLINK-27073 URL: https://issues.apache.org/jira/browse/FLINK-27073 Project: Flink Issue Type: Bug Components: Runtime / Queryable State Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} Apr 05 06:31:37 "main" #1 prio=5 os_prio=0 tid=0x7f434000b800 nid=0x2523 waiting on condition [0x7f4349133000] Apr 05 06:31:37java.lang.Thread.State: WAITING (parking) Apr 05 06:31:37 at sun.misc.Unsafe.park(Native Method) Apr 05 06:31:37 - parking to wait for <0x8b223b18> (a java.util.concurrent.CompletableFuture$Signaller) Apr 05 06:31:37 at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) Apr 05 06:31:37 at java.util.concurrent.CompletableFuture$Signaller.block(CompletableFuture.java:1707) Apr 05 06:31:37 at java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3323) Apr 05 06:31:37 at java.util.concurrent.CompletableFuture.waitingGet(CompletableFuture.java:1742) Apr 05 06:31:37 at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908) Apr 05 06:31:37 at org.apache.flink.queryablestate.itcases.AbstractQueryableStateTestBase.testListState(AbstractQueryableStateTestBase.java:973) Apr 05 06:31:37 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Apr 05 06:31:37 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Apr 05 06:31:37 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Apr 05 06:31:37 at java.lang.reflect.Method.invoke(Method.java:498) Apr 05 06:31:37 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) Apr 05 06:31:37 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) Apr 05 06:31:37 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) Apr 05 06:31:37 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) Apr 05 06:31:37 at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) Apr 05 06:31:37 at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45) Apr 05 06:31:37 at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) Apr 05 06:31:37 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) Apr 05 06:31:37 at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) Apr 05 06:31:37 at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) Apr 05 06:31:37 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) Apr 05 06:31:37 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) Apr 05 06:31:37 at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) Apr 05 06:31:37 at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) Apr 05 06:31:37 at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) Apr 05 06:31:37 at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) Apr 05 06:31:37 at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) Apr 05 06:31:37 at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) Apr 05 06:31:37 at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) Apr 05 06:31:37 at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54) Apr 05 06:31:37 at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54) Apr 05 06:31:37 at org.junit.rules.RunRules.evaluate(RunRules.java:20) Apr 05 06:31:37 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) {code} https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=34243&view=logs&j=c91190b6-40ae-57b2-5999-31b869b0a7c1&t=41463ccd-0694-5d4d-220d-8f771e7d098b&l=46086 -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-27083) SavepointITCase.testStopWithSavepointFailingAfterSnapshotCreation failed on azure
Yun Gao created FLINK-27083: --- Summary: SavepointITCase.testStopWithSavepointFailingAfterSnapshotCreation failed on azure Key: FLINK-27083 URL: https://issues.apache.org/jira/browse/FLINK-27083 Project: Flink Issue Type: Bug Components: Runtime / Checkpointing Affects Versions: 1.16.0 Environment: Reporter: Yun Gao {code:java} Apr 05 04:09:45 [ERROR] Tests run: 20, Failures: 0, Errors: 1, Skipped: 1, Time elapsed: 23.89 s <<< FAILURE! - in org.apache.flink.test.checkpointing.SavepointITCase Apr 05 04:09:45 [ERROR] org.apache.flink.test.checkpointing.SavepointITCase.testStopWithSavepointFailingAfterSnapshotCreation Time elapsed: 0.139 s <<< ERROR! Apr 05 04:09:45 java.util.concurrent.ExecutionException: org.apache.flink.runtime.scheduler.stopwithsavepoint.StopWithSavepointStoppingException: A savepoint has been created at: file:/tmp/junit4406725947107631997/junit5730835490671962066/savepoint-902c72-01f9662051f2, but the corresponding job 902c72291e9d3f8c4905e6730763116a failed during stopping. The savepoint is consistent, but might have uncommitted transactions. If you want to commit the transaction please restart a job from this savepoint. Apr 05 04:09:45 at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357) Apr 05 04:09:45 at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908) Apr 05 04:09:45 at org.apache.flink.test.checkpointing.SavepointITCase.testStopWithFailingSourceInOnePipeline(SavepointITCase.java:1202) Apr 05 04:09:45 at org.apache.flink.test.checkpointing.SavepointITCase.testStopWithSavepointFailingAfterSnapshotCreation(SavepointITCase.java:1013) Apr 05 04:09:45 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Apr 05 04:09:45 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Apr 05 04:09:45 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Apr 05 04:09:45 at java.lang.reflect.Method.invoke(Method.java:498) Apr 05 04:09:45 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) Apr 05 04:09:45 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) Apr 05 04:09:45 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) Apr 05 04:09:45 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) Apr 05 04:09:45 at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) Apr 05 04:09:45 at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54) Apr 05 04:09:45 at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54) Apr 05 04:09:45 at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45) Apr 05 04:09:45 at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) Apr 05 04:09:45 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) Apr 05 04:09:45 at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) Apr 05 04:09:45 at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) Apr 05 04:09:45 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) Apr 05 04:09:45 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) Apr 05 04:09:45 at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) Apr 05 04:09:45 at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) Apr 05 04:09:45 at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) Apr 05 04:09:45 at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) Apr 05 04:09:45 at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) Apr 05 04:09:45 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) Apr 05 04:09:45 at org.junit.runners.ParentRunner.run(ParentRunner.java:413) Apr 05 04:09:45 at org.junit.runner.JUnitCore.run(JUnitCore.java:137) Apr 05 04:09:45 at org.junit.runner.JUnitCore.run(JUnitCore.java:115) Apr 05 04:09:45 at org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:42) Apr 05 04:09:45 at org.junit.vintage.engine.VintageTestEngine.executeAllChildren(VintageTestEngine.java:80) Apr 05 04:09:45 at org.junit.vintage.engine.VintageTestEngine.execute(VintageTestEngine.java:72) Apr 05 04:09:45 at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:107) {code} https://dev.azure.com/apache-flink/apache-flink/_build/results?buil
[jira] [Created] (FLINK-27118) Flink on Yarned failed with the default flink-conf
Yun Gao created FLINK-27118: --- Summary: Flink on Yarned failed with the default flink-conf Key: FLINK-27118 URL: https://issues.apache.org/jira/browse/FLINK-27118 Project: Flink Issue Type: Bug Components: Runtime / Coordination Affects Versions: 1.15.0, 1.16.0 Reporter: Yun Gao We changed the default bind-host of TaskManager to localhost in https://issues.apache.org/jira/browse/FLINK-24474. For one part, in the PR we want to remove this configuration for the Yarn mode so that the Yarn mode does not be affected, however, it seems the removing not work properly. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-27131) CastFunctionITCase.test failed on azure
Yun Gao created FLINK-27131: --- Summary: CastFunctionITCase.test failed on azure Key: FLINK-27131 URL: https://issues.apache.org/jira/browse/FLINK-27131 Project: Flink Issue Type: Bug Components: Table SQL / Planner Affects Versions: 1.16.0 Reporter: Yun Gao {code:java} Apr 07 20:09:45 [ERROR] Tests run: 513, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 13.125 s <<< FAILURE! - in org.apache.flink.table.planner.functions.CastFunctionITCase Apr 07 20:09:45 [ERROR] org.apache.flink.table.planner.functions.CastFunctionITCase.test(TestCase)[342] Time elapsed: 0.008 s <<< ERROR! Apr 07 20:09:45 org.apache.flink.api.common.InvalidProgramException: The LocalStreamEnvironment cannot be used when submitting a program through a client, or running in a TestEnvironment context. Apr 07 20:09:45 at org.apache.flink.streaming.api.environment.LocalStreamEnvironment.validateAndGetConfiguration(LocalStreamEnvironment.java:56) Apr 07 20:09:45 at org.apache.flink.streaming.api.environment.LocalStreamEnvironment.(LocalStreamEnvironment.java:51) Apr 07 20:09:45 at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.createLocalEnvironment(StreamExecutionEnvironment.java:2320) Apr 07 20:09:45 at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.lambda$getExecutionEnvironment$15(StreamExecutionEnvironment.java:2262) Apr 07 20:09:45 at java.util.Optional.orElseGet(Optional.java:267) Apr 07 20:09:45 at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.getExecutionEnvironment(StreamExecutionEnvironment.java:2262) Apr 07 20:09:45 at org.apache.flink.table.planner.delegation.DefaultExecutorFactory.create(DefaultExecutorFactory.java:48) Apr 07 20:09:45 at org.apache.flink.table.api.internal.TableEnvironmentImpl.create(TableEnvironmentImpl.java:278) Apr 07 20:09:45 at org.apache.flink.table.api.TableEnvironment.create(TableEnvironment.java:93) Apr 07 20:09:45 at org.apache.flink.table.planner.functions.BuiltInFunctionTestBase$TestSetSpec.lambda$getTestCase$4(BuiltInFunctionTestBase.java:299) Apr 07 20:09:45 at org.apache.flink.table.planner.functions.BuiltInFunctionTestBase$TestCase.execute(BuiltInFunctionTestBase.java:113) Apr 07 20:09:45 at org.apache.flink.table.planner.functions.BuiltInFunctionTestBase.test(BuiltInFunctionTestBase.java:93) Apr 07 20:09:45 at sun.reflect.GeneratedMethodAccessor107.invoke(Unknown Source) Apr 07 20:09:45 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Apr 07 20:09:45 at java.lang.reflect.Method.invoke(Method.java:498) Apr 07 20:09:45 at org.junit.platform.commons.util.ReflectionUtils.invokeMethod(ReflectionUtils.java:725) Apr 07 20:09:45 at org.junit.jupiter.engine.execution.MethodInvocation.proceed(MethodInvocation.java:60) Apr 07 20:09:45 at org.junit.jupiter.engine.execution.InvocationInterceptorChain$ValidatingInvocation.proceed(InvocationInterceptorChain.java:131) Apr 07 20:09:45 at org.junit.jupiter.engine.extension.TimeoutExtension.intercept(TimeoutExtension.java:149) Apr 07 20:09:45 at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestableMethod(TimeoutExtension.java:140) Apr 07 20:09:45 at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestTemplateMethod(TimeoutExtension.java:92) Apr 07 20:09:45 at org.junit.jupiter.engine.execution.ExecutableInvoker$ReflectiveInterceptorCall.lambda$ofVoidMethod$0(ExecutableInvoker.java:115) Apr 07 20:09:45 at org.junit.jupiter.engine.execution.ExecutableInvoker.lambda$invoke$0(ExecutableInvoker.java:105) Apr 07 20:09:45 at org.junit.jupiter.engine.execution.InvocationInterceptorChain$InterceptedInvocation.proceed(InvocationInterceptorChain.java:106) Apr 07 20:09:45 at org.junit.jupiter.engine.execution.InvocationInterceptorChain.proceed(InvocationInterceptorChain.java:64) Apr 07 20:09:45 at org.junit.jupiter.engine.execution.InvocationInterceptorChain.chainAndInvoke(InvocationInterceptorChain.java:45) Apr 07 20:09:45 at org.junit.jupiter.engine.execution.InvocationInterceptorChain.invoke(InvocationInterceptorChain.java:37) Apr 07 20:09:45 at org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:104) Apr 07 20:09:45 at org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:98) Apr 07 20:09:45 at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.lambda$invokeTestMethod$7(TestMethodTestDescriptor.java:214) Apr 07 20:09:45 at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) Apr 07 20:09:45 at org.juni
[jira] [Created] (FLINK-27162) RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState failed on azure
Yun Gao created FLINK-27162: --- Summary: RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState failed on azure Key: FLINK-27162 URL: https://issues.apache.org/jira/browse/FLINK-27162 Project: Flink Issue Type: Bug Components: Runtime / Checkpointing Affects Versions: 1.16.0 Reporter: Yun Gao {code:java} 2022-04-08T16:21:37.7382295Z Apr 08 16:21:37 [ERROR] Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 19.21 s <<< FAILURE! - in org.apache.flink.test.checkpointing.RescaleCheckpointManuallyITCase 2022-04-08T16:21:37.7383825Z Apr 08 16:21:37 [ERROR] org.apache.flink.test.checkpointing.RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState Time elapsed: 9.642 s <<< ERROR! 2022-04-08T16:21:37.7385362Z Apr 08 16:21:37 java.util.concurrent.ExecutionException: org.apache.flink.runtime.checkpoint.CheckpointException: Checkpoint was canceled because a barrier from newer checkpoint was received. 2022-04-08T16:21:37.7386479Z Apr 08 16:21:37at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357) 2022-04-08T16:21:37.7387206Z Apr 08 16:21:37at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908) 2022-04-08T16:21:37.7388026Z Apr 08 16:21:37at org.apache.flink.test.checkpointing.RescaleCheckpointManuallyITCase.runJobAndGetCheckpoint(RescaleCheckpointManuallyITCase.java:196) 2022-04-08T16:21:37.7389054Z Apr 08 16:21:37at org.apache.flink.test.checkpointing.RescaleCheckpointManuallyITCase.testCheckpointRescalingKeyedState(RescaleCheckpointManuallyITCase.java:137) 2022-04-08T16:21:37.7390072Z Apr 08 16:21:37at org.apache.flink.test.checkpointing.RescaleCheckpointManuallyITCase.testCheckpointRescalingInKeyedState(RescaleCheckpointManuallyITCase.java:115) 2022-04-08T16:21:37.7391320Z Apr 08 16:21:37at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 2022-04-08T16:21:37.7392401Z Apr 08 16:21:37at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2022-04-08T16:21:37.7393916Z Apr 08 16:21:37at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 2022-04-08T16:21:37.7394662Z Apr 08 16:21:37at java.lang.reflect.Method.invoke(Method.java:498) 2022-04-08T16:21:37.7395293Z Apr 08 16:21:37at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) 2022-04-08T16:21:37.7396038Z Apr 08 16:21:37at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) 2022-04-08T16:21:37.7396749Z Apr 08 16:21:37at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) 2022-04-08T16:21:37.7397458Z Apr 08 16:21:37at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) 2022-04-08T16:21:37.7398164Z Apr 08 16:21:37at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) 2022-04-08T16:21:37.7398844Z Apr 08 16:21:37at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) 2022-04-08T16:21:37.7399505Z Apr 08 16:21:37at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45) 2022-04-08T16:21:37.7400182Z Apr 08 16:21:37at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) 2022-04-08T16:21:37.7400804Z Apr 08 16:21:37at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) 2022-04-08T16:21:37.7401492Z Apr 08 16:21:37at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) 2022-04-08T16:21:37.7402605Z Apr 08 16:21:37at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) 2022-04-08T16:21:37.7403783Z Apr 08 16:21:37at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) 2022-04-08T16:21:37.7404514Z Apr 08 16:21:37at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) 2022-04-08T16:21:37.7405180Z Apr 08 16:21:37at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) 2022-04-08T16:21:37.7405784Z Apr 08 16:21:37at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) 2022-04-08T16:21:37.7406537Z Apr 08 16:21:37at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) 2022-04-08T16:21:37.7407256Z Apr 08 16:21:37at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) 2022-04-08T16:21:37.7407889Z Apr 08 16:21:37at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) 2022-04-08T16:21:37.7408752Z Apr 08 16:21:37at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54) 2022-04-08T16:21:37.7409367Z Apr 08 16:21:37at org.junit.rules.RunRules.evaluate(RunRules.java:20) 2022-04-08T16:21:37.7409948Z Apr 08 16:21:37at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) 2022-0
[jira] [Created] (FLINK-27164) ResumeCheckpointManuallyITCase.testExternalizedFSCheckpointsWithLocalRecoveryZookeeper failed on azure
Yun Gao created FLINK-27164: --- Summary: ResumeCheckpointManuallyITCase.testExternalizedFSCheckpointsWithLocalRecoveryZookeeper failed on azure Key: FLINK-27164 URL: https://issues.apache.org/jira/browse/FLINK-27164 Project: Flink Issue Type: Bug Components: Runtime / Checkpointing, Runtime / Coordination Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} 2022-04-10T04:58:10.3690089Z Apr 10 04:58:10 [ERROR] Tests run: 36, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 344.79 s <<< FAILURE! - in org.apache.flink.test.checkpointing.ResumeCheckpointManuallyITCase 2022-04-10T04:58:10.3691728Z Apr 10 04:58:10 [ERROR] ResumeCheckpointManuallyITCase.testExternalizedFSCheckpointsWithLocalRecoveryZookeeper Time elapsed: 20.179 s <<< ERROR! 2022-04-10T04:58:10.3693629Z Apr 10 04:58:10 java.util.concurrent.ExecutionException: org.apache.flink.runtime.rpc.exceptions.RecipientUnreachableException: Could not send message [LocalRpcInvocation(RestfulGateway.requestJob(JobID, Time))] from sender [unknown] to recipient [akka://flink/user/rpc/dispatcher_171], because the recipient is unreachable. This can either mean that the recipient has been terminated or that the remote RpcService is currently not reachable. 2022-04-10T04:58:10.3695051Z Apr 10 04:58:10at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357) 2022-04-10T04:58:10.3696009Z Apr 10 04:58:10at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908) 2022-04-10T04:58:10.3697290Z Apr 10 04:58:10at org.apache.flink.runtime.testutils.CommonTestUtils.lambda$waitForCheckpoint$13(CommonTestUtils.java:373) 2022-04-10T04:58:10.3698540Z Apr 10 04:58:10at org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:166) 2022-04-10T04:58:10.3699709Z Apr 10 04:58:10at org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:150) 2022-04-10T04:58:10.3700886Z Apr 10 04:58:10at org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:142) 2022-04-10T04:58:10.3702047Z Apr 10 04:58:10at org.apache.flink.runtime.testutils.CommonTestUtils.waitForCheckpoint(CommonTestUtils.java:371) 2022-04-10T04:58:10.3703031Z Apr 10 04:58:10at org.apache.flink.test.checkpointing.ResumeCheckpointManuallyITCase.runJobAndGetExternalizedCheckpoint(ResumeCheckpointManuallyITCase.java:351) 2022-04-10T04:58:10.3704551Z Apr 10 04:58:10at org.apache.flink.test.checkpointing.ResumeCheckpointManuallyITCase.testExternalizedCheckpoints(ResumeCheckpointManuallyITCase.java:312) 2022-04-10T04:58:10.3706643Z Apr 10 04:58:10at org.apache.flink.test.checkpointing.ResumeCheckpointManuallyITCase.testExternalizedFSCheckpointsWithLocalRecoveryZookeeper(ResumeCheckpointManuallyITCase.java:247) 2022-04-10T04:58:10.3708169Z Apr 10 04:58:10at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 2022-04-10T04:58:10.3708780Z Apr 10 04:58:10at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2022-04-10T04:58:10.3709498Z Apr 10 04:58:10at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 2022-04-10T04:58:10.3710144Z Apr 10 04:58:10at java.lang.reflect.Method.invoke(Method.java:498) 2022-04-10T04:58:10.3710782Z Apr 10 04:58:10at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) 2022-04-10T04:58:10.3711494Z Apr 10 04:58:10at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) 2022-04-10T04:58:10.3712201Z Apr 10 04:58:10at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) 2022-04-10T04:58:10.3712907Z Apr 10 04:58:10at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) 2022-04-10T04:58:10.3713579Z Apr 10 04:58:10at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45) 2022-04-10T04:58:10.3714214Z Apr 10 04:58:10at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) 2022-04-10T04:58:10.3714923Z Apr 10 04:58:10at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) 2022-04-10T04:58:10.3715755Z Apr 10 04:58:10at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) 2022-04-10T04:58:10.3716427Z Apr 10 04:58:10at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) 2022-04-10T04:58:10.3717083Z Apr 10 04:58:10at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) 2022-04-10T04:58:10.3717783Z Apr 10 04:58:10at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) 2022-04-10T04:58:10.3718420Z Apr 10 04:58:10at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) 2022-04-10T04:58:10.3719
[jira] [Created] (FLINK-27167) Deploying master snapshot failed due to generating javadoc failed
Yun Gao created FLINK-27167: --- Summary: Deploying master snapshot failed due to generating javadoc failed Key: FLINK-27167 URL: https://issues.apache.org/jira/browse/FLINK-27167 Project: Flink Issue Type: Bug Components: Build System / Azure Pipelines Affects Versions: 1.16.0 Reporter: Yun Gao {code:java} [ERROR] Failed to execute goal org.apache.maven.plugins:maven-javadoc-plugin:2.9.1:jar (attach-javadocs) on project flink-architecture-tests-production: MavenReportException: Error while creating archive: [ERROR] Exit code: 1 - javadoc: error - class file for org.junit.platform.commons.annotation.Testable not found [ERROR] [ERROR] Command line was: /usr/lib/jvm/java-8-openjdk-amd64/jre/../bin/javadoc -Xdoclint:none @options @packages [ERROR] [ERROR] Refer to the generated Javadoc files in '/__w/1/s/flink-architecture-tests/flink-architecture-tests-production/target/apidocs' dir. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn -rf :flink-architecture-tests-production ##[error]Bash exited with code '1'. Finishing: Deploy maven snapshot {code} https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=34493&view=logs&j=eca6b3a6-1600-56cc-916a-c549b3cde3ff&t=e9844b5e-5aa3-546b-6c3e-5395c7c0cac7&l=13852 -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-27169) PartiallyFinishedSourcesITCase.test hangs on azure
Yun Gao created FLINK-27169: --- Summary: PartiallyFinishedSourcesITCase.test hangs on azure Key: FLINK-27169 URL: https://issues.apache.org/jira/browse/FLINK-27169 Project: Flink Issue Type: Bug Components: Runtime / Checkpointing Affects Versions: 1.16.0 Reporter: Yun Gao {code:java} Apr 10 08:32:18 "main" #1 prio=5 os_prio=0 tid=0x7f553400b800 nid=0x8345 waiting on condition [0x7f553be6] Apr 10 08:32:18java.lang.Thread.State: TIMED_WAITING (sleeping) Apr 10 08:32:18 at java.lang.Thread.sleep(Native Method) Apr 10 08:32:18 at org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:145) Apr 10 08:32:18 at org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:138) Apr 10 08:32:18 at org.apache.flink.runtime.testutils.CommonTestUtils.waitForSubtasksToFinish(CommonTestUtils.java:291) Apr 10 08:32:18 at org.apache.flink.runtime.operators.lifecycle.TestJobExecutor.waitForSubtasksToFinish(TestJobExecutor.java:226) Apr 10 08:32:18 at org.apache.flink.runtime.operators.lifecycle.PartiallyFinishedSourcesITCase.test(PartiallyFinishedSourcesITCase.java:138) Apr 10 08:32:18 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Apr 10 08:32:18 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Apr 10 08:32:18 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Apr 10 08:32:18 at java.lang.reflect.Method.invoke(Method.java:498) Apr 10 08:32:18 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) Apr 10 08:32:18 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) Apr 10 08:32:18 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) Apr 10 08:32:18 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) Apr 10 08:32:18 at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) Apr 10 08:32:18 at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) Apr 10 08:32:18 at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54) Apr 10 08:32:18 at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45) Apr 10 08:32:18 at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) Apr 10 08:32:18 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) Apr 10 08:32:18 at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) Apr 10 08:32:18 at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) Apr 10 08:32:18 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) Apr 10 08:32:18 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) Apr 10 08:32:18 at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) Apr 10 08:32:18 at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) Apr 10 08:32:18 at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) Apr 10 08:32:18 at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) Apr 10 08:32:18 at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) Apr 10 08:32:18 at org.junit.runners.ParentRunner.run(ParentRunner.java:413) Apr 10 08:32:18 at org.junit.runners.Suite.runChild(Suite.java:128) Apr 10 08:32:18 at org.junit.runners.Suite.runChild(Suite.java:27) Apr 10 08:32:18 at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) {code} https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=34484&view=logs&j=39d5b1d5-3b41-54dc-6458-1e2ddd1cdcf3&t=0c010d0c-3dec-5bf1-d408-7b18988b1b2b&l=6757 -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-27216) CheckpointCoordinatorTest.testMinCheckpointPause failed on azure
Yun Gao created FLINK-27216: --- Summary: CheckpointCoordinatorTest.testMinCheckpointPause failed on azure Key: FLINK-27216 URL: https://issues.apache.org/jira/browse/FLINK-27216 Project: Flink Issue Type: Bug Components: Runtime / Checkpointing Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} 2022-04-12T04:36:26.8490051Z Apr 12 04:36:26 [ERROR] Tests run: 49, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 4.912 s <<< FAILURE! - in org.apache.flink.runtime.checkpoint.CheckpointCoordinatorTest 2022-04-12T04:36:26.8491666Z Apr 12 04:36:26 [ERROR] org.apache.flink.runtime.checkpoint.CheckpointCoordinatorTest.testMinCheckpointPause Time elapsed: 0.053 s <<< ERROR! 2022-04-12T04:36:26.8493295Z Apr 12 04:36:26 org.apache.flink.runtime.checkpoint.CheckpointException: Could not finalize the pending checkpoint 1. Failure reason: Failure to finalize checkpoint. 2022-04-12T04:36:26.8494208Z Apr 12 04:36:26at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.finalizeCheckpoint(CheckpointCoordinator.java:1354) 2022-04-12T04:36:26.8495074Z Apr 12 04:36:26at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.completePendingCheckpoint(CheckpointCoordinator.java:1241) 2022-04-12T04:36:26.8496598Z Apr 12 04:36:26at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.receiveAcknowledgeMessage(CheckpointCoordinator.java:1133) 2022-04-12T04:36:26.8497813Z Apr 12 04:36:26at org.apache.flink.runtime.checkpoint.CheckpointCoordinatorTest.testMinCheckpointPause(CheckpointCoordinatorTest.java:396) 2022-04-12T04:36:26.8498560Z Apr 12 04:36:26at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 2022-04-12T04:36:26.8499456Z Apr 12 04:36:26at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2022-04-12T04:36:26.8500181Z Apr 12 04:36:26at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 2022-04-12T04:36:26.8500838Z Apr 12 04:36:26at java.lang.reflect.Method.invoke(Method.java:498) 2022-04-12T04:36:26.8501563Z Apr 12 04:36:26at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) 2022-04-12T04:36:26.8502551Z Apr 12 04:36:26at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) 2022-04-12T04:36:26.8503624Z Apr 12 04:36:26at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) 2022-04-12T04:36:26.8504933Z Apr 12 04:36:26at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) 2022-04-12T04:36:26.8505787Z Apr 12 04:36:26at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) 2022-04-12T04:36:26.8506629Z Apr 12 04:36:26at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54) 2022-04-12T04:36:26.8507691Z Apr 12 04:36:26at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45) 2022-04-12T04:36:26.8508940Z Apr 12 04:36:26at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) 2022-04-12T04:36:26.8509960Z Apr 12 04:36:26at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) 2022-04-12T04:36:26.8511048Z Apr 12 04:36:26at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) 2022-04-12T04:36:26.8512426Z Apr 12 04:36:26at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) 2022-04-12T04:36:26.8513106Z Apr 12 04:36:26at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) 2022-04-12T04:36:26.8513828Z Apr 12 04:36:26at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) 2022-04-12T04:36:26.8514490Z Apr 12 04:36:26at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) 2022-04-12T04:36:26.8515121Z Apr 12 04:36:26at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) 2022-04-12T04:36:26.8515751Z Apr 12 04:36:26at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) 2022-04-12T04:36:26.8516368Z Apr 12 04:36:26at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) 2022-04-12T04:36:26.8516995Z Apr 12 04:36:26at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) 2022-04-12T04:36:26.8517620Z Apr 12 04:36:26at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) 2022-04-12T04:36:26.8518227Z Apr 12 04:36:26at org.junit.runners.ParentRunner.run(ParentRunner.java:413) 2022-04-12T04:36:26.8518804Z Apr 12 04:36:26at org.junit.runner.JUnitCore.run(JUnitCore.java:137) 2022-04-12T04:36:26.8519362Z Apr 12 04:36:26at org.junit.runner.JUnitCore.run(JUnitCore.java:115) 2022-04-12T04:36:26.8519978Z Apr 12 04:36:26at org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:42) 2022-04-12T04:36:2
[jira] [Created] (FLINK-27219) CliClientITCase.testSqlStatements failed on azure with jdk11
Yun Gao created FLINK-27219: --- Summary: CliClientITCase.testSqlStatements failed on azure with jdk11 Key: FLINK-27219 URL: https://issues.apache.org/jira/browse/FLINK-27219 Project: Flink Issue Type: Bug Components: Table SQL / Client Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} Apr 13 04:56:44 [ERROR] Could not execute SQL statement. Reason: Apr 13 04:56:44 java.lang.ClassCastException: class jdk.internal.loader.ClassLoaders$AppClassLoader cannot be cast to class java.net.URLClassLoader (jdk.internal.loader.ClassLoaders$AppClassLoader and java.net.URLClassLoader are in module java.base of loader 'bootstrap') Apr 13 04:56:44 !error Apr 13 04:56:44 Apr 13 04:56:44 # test "ctas" only supported in Hive Dialect Apr 13 04:56:44 CREATE TABLE foo as select 1; Apr 13 04:56:44 [ERROR] Could not execute SQL statement. Reason: Apr 13 04:56:44 java.lang.ClassCastException: class jdk.internal.loader.ClassLoaders$AppClassLoader cannot be cast to class java.net.URLClassLoader (jdk.internal.loader.ClassLoaders$AppClassLoader and java.net.URLClassLoader are in module java.base of loader 'bootstrap') Apr 13 04:56:44 !error Apr 13 04:56:44 Apr 13 04:56:44 # list the configured configuration Apr 13 04:56:44 set; Apr 13 04:56:44 [ERROR] Could not execute SQL statement. Reason: Apr 13 04:56:44 java.lang.ClassCastException: class jdk.internal.loader.ClassLoaders$AppClassLoader cannot be cast to class java.net.URLClassLoader (jdk.internal.loader.ClassLoaders$AppClassLoader and java.net.URLClassLoader are in module java.base of loader 'bootstrap') Apr 13 04:56:44 !error Apr 13 04:56:44 Apr 13 04:56:44 # reset the configuration Apr 13 04:56:44 reset; Apr 13 04:56:44 [ERROR] Could not execute SQL statement. Reason: Apr 13 04:56:44 java.lang.ClassCastException: class jdk.internal.loader.ClassLoaders$AppClassLoader cannot be cast to class java.net.URLClassLoader (jdk.internal.loader.ClassLoaders$AppClassLoader and java.net.URLClassLoader are in module java.base of loader 'bootstrap') Apr 13 04:56:44 !error Apr 13 04:56:44 Apr 13 04:56:44 set; Apr 13 04:56:44 [ERROR] Could not execute SQL statement. Reason: Apr 13 04:56:44 java.lang.ClassCastException: class jdk.internal.loader.ClassLoaders$AppClassLoader cannot be cast to class java.net.URLClassLoader (jdk.internal.loader.ClassLoaders$AppClassLoader and java.net.URLClassLoader are in module java.base of loader 'bootstrap') Apr 13 04:56:44 !error ... Apr 13 04:56:44 [ERROR] Could not execute SQL statement. Reason: Apr 13 04:56:44 org.apache.flink.sql.parser.impl.ParseException: Encountered "STRING" at line 10, column 27. Apr 13 04:56:44 Was expecting one of: Apr 13 04:56:44 ")" ... Apr 13 04:56:44 "," ... Apr 13 04:56:44 Apr 13 04:56:44 !error ... Apr 13 04:56:44 SHOW JARS; Apr 13 04:56:44 Empty set Apr 13 04:56:44 !ok Apr 13 04:56:44 " Apr 13 04:56:44 at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) Apr 13 04:56:44 at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) Apr 13 04:56:44 at java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) Apr 13 04:56:44 at org.apache.flink.table.client.cli.CliClientITCase.testSqlStatements(CliClientITCase.java:139) Apr 13 04:56:44 at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Apr 13 04:56:44 at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Apr 13 04:56:44 at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Apr 13 04:56:44 at java.base/java.lang.reflect.Method.invoke(Method.java:566) Apr 13 04:56:44 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) Apr 13 04:56:44 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) Apr 13 04:56:44 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) Apr 13 04:56:44 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) Apr 13 04:56:44 at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) Apr 13 04:56:44 at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) Apr 13 04:56:44 at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45) Apr 13 04:56:44 at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) Apr 13 04:56:44 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) Apr 13 04:56:44 at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4Class
[jira] [Created] (FLINK-27284) KafkaSinkITCase$IntegrationTests.testScaleUp failed on azures due to failed to create topic
Yun Gao created FLINK-27284: --- Summary: KafkaSinkITCase$IntegrationTests.testScaleUp failed on azures due to failed to create topic Key: FLINK-27284 URL: https://issues.apache.org/jira/browse/FLINK-27284 Project: Flink Issue Type: Bug Components: Connectors / Kafka Affects Versions: 1.16.0 Reporter: Yun Gao {code:java} 2022-04-17T06:38:39.4884418Z Apr 17 06:38:39 [ERROR] Tests run: 10, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 97.71 s <<< FAILURE! - in org.apache.flink.connector.kafka.sink.KafkaSinkITCase$IntegrationTests 2022-04-17T06:38:39.4885911Z Apr 17 06:38:39 [ERROR] org.apache.flink.connector.kafka.sink.KafkaSinkITCase$IntegrationTests.testScaleUp(TestEnvironment, DataStreamSinkExternalContext, CheckpointingMode)[2] Time elapsed: 30.115 s <<< ERROR! 2022-04-17T06:38:39.4887050Z Apr 17 06:38:39 java.lang.RuntimeException: Cannot create topic 'kafka-single-topic-4486440447887382037' 2022-04-17T06:38:39.4889332Z Apr 17 06:38:39at org.apache.flink.connector.kafka.sink.testutils.KafkaSinkExternalContext.createTopic(KafkaSinkExternalContext.java:108) 2022-04-17T06:38:39.4891038Z Apr 17 06:38:39at org.apache.flink.connector.kafka.sink.testutils.KafkaSinkExternalContext.createSink(KafkaSinkExternalContext.java:136) 2022-04-17T06:38:39.4892936Z Apr 17 06:38:39at org.apache.flink.connector.testframe.testsuites.SinkTestSuiteBase.tryCreateSink(SinkTestSuiteBase.java:567) 2022-04-17T06:38:39.4894388Z Apr 17 06:38:39at org.apache.flink.connector.testframe.testsuites.SinkTestSuiteBase.restartFromSavepoint(SinkTestSuiteBase.java:258) 2022-04-17T06:38:39.4895903Z Apr 17 06:38:39at org.apache.flink.connector.testframe.testsuites.SinkTestSuiteBase.testScaleUp(SinkTestSuiteBase.java:201) 2022-04-17T06:38:39.4897144Z Apr 17 06:38:39at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 2022-04-17T06:38:39.4898432Z Apr 17 06:38:39at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2022-04-17T06:38:39.4899803Z Apr 17 06:38:39at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 2022-04-17T06:38:39.4900985Z Apr 17 06:38:39at java.base/java.lang.reflect.Method.invoke(Method.java:566) 2022-04-17T06:38:39.4902266Z Apr 17 06:38:39at org.junit.platform.commons.util.ReflectionUtils.invokeMethod(ReflectionUtils.java:725) 2022-04-17T06:38:39.4903521Z Apr 17 06:38:39at org.junit.jupiter.engine.execution.MethodInvocation.proceed(MethodInvocation.java:60) 2022-04-17T06:38:39.4904835Z Apr 17 06:38:39at org.junit.jupiter.engine.execution.InvocationInterceptorChain$ValidatingInvocation.proceed(InvocationInterceptorChain.java:131) 2022-04-17T06:38:39.4906422Z Apr 17 06:38:39at org.junit.jupiter.engine.extension.TimeoutExtension.intercept(TimeoutExtension.java:149) 2022-04-17T06:38:39.4907505Z Apr 17 06:38:39at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestableMethod(TimeoutExtension.java:140) 2022-04-17T06:38:39.4908355Z Apr 17 06:38:39at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestTemplateMethod(TimeoutExtension.java:92) 2022-04-17T06:38:39.4909242Z Apr 17 06:38:39at org.junit.jupiter.engine.execution.ExecutableInvoker$ReflectiveInterceptorCall.lambda$ofVoidMethod$0(ExecutableInvoker.java:115) 2022-04-17T06:38:39.4910144Z Apr 17 06:38:39at org.junit.jupiter.engine.execution.ExecutableInvoker.lambda$invoke$0(ExecutableInvoker.java:105) 2022-04-17T06:38:39.4911103Z Apr 17 06:38:39at org.junit.jupiter.engine.execution.InvocationInterceptorChain$InterceptedInvocation.proceed(InvocationInterceptorChain.java:106) 2022-04-17T06:38:39.4912013Z Apr 17 06:38:39at org.junit.jupiter.engine.execution.InvocationInterceptorChain.proceed(InvocationInterceptorChain.java:64) 2022-04-17T06:38:39.4913109Z Apr 17 06:38:39at org.junit.jupiter.engine.execution.InvocationInterceptorChain.chainAndInvoke(InvocationInterceptorChain.java:45) 2022-04-17T06:38:39.4913983Z Apr 17 06:38:39at org.junit.jupiter.engine.execution.InvocationInterceptorChain.invoke(InvocationInterceptorChain.java:37) 2022-04-17T06:38:39.4914784Z Apr 17 06:38:39at org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:104) 2022-04-17T06:38:39.4915948Z Apr 17 06:38:39at org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:98) 2022-04-17T06:38:39.4916840Z Apr 17 06:38:39at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.lambda$invokeTestMethod$7(TestMethodTestDescriptor.java:214) 2022-04-17T06:38:39.4918168Z Apr 17 06:38:39at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) 2022-04-17T06:38:39.4919584Z Apr 17 06:38:39at org.junit.jup
[jira] [Created] (FLINK-27285) CassandraConnectorITCase failed on azure due to NoHostAvailableException
Yun Gao created FLINK-27285: --- Summary: CassandraConnectorITCase failed on azure due to NoHostAvailableException Key: FLINK-27285 URL: https://issues.apache.org/jira/browse/FLINK-27285 Project: Flink Issue Type: Bug Components: Connectors / Cassandra Affects Versions: 1.16.0 Reporter: Yun Gao {code:java} 2022-04-17T06:24:40.1216092Z Apr 17 06:24:40 [ERROR] org.apache.flink.streaming.connectors.cassandra.CassandraConnectorITCase Time elapsed: 29.81 s <<< ERROR! 2022-04-17T06:24:40.1218517Z Apr 17 06:24:40 com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /172.17.0.1:53053 (com.datastax.driver.core.exceptions.OperationTimedOutException: [/172.17.0.1] Timed out waiting for server response)) 2022-04-17T06:24:40.1220821Z Apr 17 06:24:40at com.datastax.driver.core.exceptions.NoHostAvailableException.copy(NoHostAvailableException.java:84) 2022-04-17T06:24:40.1222816Z Apr 17 06:24:40at com.datastax.driver.core.exceptions.NoHostAvailableException.copy(NoHostAvailableException.java:37) 2022-04-17T06:24:40.1224696Z Apr 17 06:24:40at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:37) 2022-04-17T06:24:40.1226624Z Apr 17 06:24:40at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:245) 2022-04-17T06:24:40.1228346Z Apr 17 06:24:40at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:63) 2022-04-17T06:24:40.1229839Z Apr 17 06:24:40at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:39) 2022-04-17T06:24:40.1231736Z Apr 17 06:24:40at org.apache.flink.streaming.connectors.cassandra.CassandraConnectorITCase.startAndInitializeCassandra(CassandraConnectorITCase.java:385) 2022-04-17T06:24:40.1233614Z Apr 17 06:24:40at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 2022-04-17T06:24:40.1234992Z Apr 17 06:24:40at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2022-04-17T06:24:40.1236194Z Apr 17 06:24:40at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 2022-04-17T06:24:40.1237598Z Apr 17 06:24:40at java.lang.reflect.Method.invoke(Method.java:498) 2022-04-17T06:24:40.1238768Z Apr 17 06:24:40at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) 2022-04-17T06:24:40.1240056Z Apr 17 06:24:40at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) 2022-04-17T06:24:40.1242109Z Apr 17 06:24:40at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) 2022-04-17T06:24:40.1243493Z Apr 17 06:24:40at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) 2022-04-17T06:24:40.1244903Z Apr 17 06:24:40at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) 2022-04-17T06:24:40.1246352Z Apr 17 06:24:40at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) 2022-04-17T06:24:40.1247809Z Apr 17 06:24:40at org.testcontainers.containers.FailureDetectingExternalResource$1.evaluate(FailureDetectingExternalResource.java:30) 2022-04-17T06:24:40.1249193Z Apr 17 06:24:40at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54) 2022-04-17T06:24:40.1250395Z Apr 17 06:24:40at org.junit.rules.RunRules.evaluate(RunRules.java:20) 2022-04-17T06:24:40.1251468Z Apr 17 06:24:40at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) 2022-04-17T06:24:40.1252601Z Apr 17 06:24:40at org.junit.runners.ParentRunner.run(ParentRunner.java:413) 2022-04-17T06:24:40.1253640Z Apr 17 06:24:40at org.junit.runner.JUnitCore.run(JUnitCore.java:137) 2022-04-17T06:24:40.1254768Z Apr 17 06:24:40at org.junit.runner.JUnitCore.run(JUnitCore.java:115) 2022-04-17T06:24:40.1256077Z Apr 17 06:24:40at org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:42) 2022-04-17T06:24:40.1257492Z Apr 17 06:24:40at org.junit.vintage.engine.VintageTestEngine.executeAllChildren(VintageTestEngine.java:80) 2022-04-17T06:24:40.1258820Z Apr 17 06:24:40at org.junit.vintage.engine.VintageTestEngine.execute(VintageTestEngine.java:72) 2022-04-17T06:24:40.1260174Z Apr 17 06:24:40at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:107) 2022-04-17T06:24:40.1261710Z Apr 17 06:24:40at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:88) 2022-04-17T06:24:40.1263260Z Apr 17 06:24:40at org.junit.platform.launcher.core.EngineExecutionOrchestrator.lambda$execute$0(EngineExecutionOrchestrator.java:54) 2022-04-17T06:24:40.1264989Z Apr 17 06:24:40at org.junit.platform.launcher.
[jira] [Created] (FLINK-27341) TaskManager running together with JobManager are bind to 127.0.0.1
Yun Gao created FLINK-27341: --- Summary: TaskManager running together with JobManager are bind to 127.0.0.1 Key: FLINK-27341 URL: https://issues.apache.org/jira/browse/FLINK-27341 Project: Flink Issue Type: Bug Components: Runtime / Coordination Affects Versions: 1.15.0 Reporter: Yun Gao If some TaskManagers running with JobManager on the same machine while some other TaskManager not, the TaskManagers running together with JobManager would bind to localhost or 127.0.01, which makes the Netty connections across the TaskManagers fail. -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Created] (FLINK-27413) Drop scala 2.11 support from the flink-docker
Yun Gao created FLINK-27413: --- Summary: Drop scala 2.11 support from the flink-docker Key: FLINK-27413 URL: https://issues.apache.org/jira/browse/FLINK-27413 Project: Flink Issue Type: Bug Components: flink-docker Affects Versions: 1.15.0, 1.16.0 Reporter: Yun Gao Fix For: 1.16.0, 1.15.0 Since now the scala 2.11 support has been dropped, we also dropped the support of scala 2.11 from release 1.15 -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Created] (FLINK-27492) Flink table / sql scala API is missing in the binary package
Yun Gao created FLINK-27492: --- Summary: Flink table / sql scala API is missing in the binary package Key: FLINK-27492 URL: https://issues.apache.org/jira/browse/FLINK-27492 Project: Flink Issue Type: Bug Components: Table SQL / API Affects Versions: 1.15.0, 1.16.0 Reporter: Yun Gao Currently it seems the flink-scala-api, flink-table-api-scala-bridge is missing from the binary package. If we start a standalone cluster from the binary distribution package and then submit a table / sql job in scala, it would fail due to not found the StreamTableEnvironment class. -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Created] (FLINK-27518) Refactor migration tests to support generate snapshots of new version automatically
Yun Gao created FLINK-27518: --- Summary: Refactor migration tests to support generate snapshots of new version automatically Key: FLINK-27518 URL: https://issues.apache.org/jira/browse/FLINK-27518 Project: Flink Issue Type: Bug Components: Test Infrastructure Affects Versions: 1.16.0 Reporter: Yun Gao Currently on releasing each version, we need to manually generate the snapshots for every migration tests and update the current versions. With more and more migration tests are added, this has been more and more intractable. It is better if we could make it happen automatically on cutting new branches. -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Created] (FLINK-27910) FileSink not registered the timer to enforce rolling policy if started from scratch
Yun Gao created FLINK-27910: --- Summary: FileSink not registered the timer to enforce rolling policy if started from scratch Key: FLINK-27910 URL: https://issues.apache.org/jira/browse/FLINK-27910 Project: Flink Issue Type: Bug Components: Connectors / FileSystem Affects Versions: 1.15.0, 1.16.0 Reporter: Yun Gao The current FileWriter only register the timer in initializeState, which is now only called on restoring. Thus if the job is started from scratch, the timer would fail to be registered and cause the rolling policy not work. -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Created] (FLINK-25088) KafkaSinkITCase failed on azure due to Container did not start correctly
Yun Gao created FLINK-25088: --- Summary: KafkaSinkITCase failed on azure due to Container did not start correctly Key: FLINK-25088 URL: https://issues.apache.org/jira/browse/FLINK-25088 Project: Flink Issue Type: Bug Components: Build System / Azure Pipelines, Connectors / Kafka Affects Versions: 1.14.1 Reporter: Yun Gao {code:java} Nov 29 03:38:00 at org.junit.vintage.engine.VintageTestEngine.executeAllChildren(VintageTestEngine.java:82) Nov 29 03:38:00 at org.junit.vintage.engine.VintageTestEngine.execute(VintageTestEngine.java:73) Nov 29 03:38:00 at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:220) Nov 29 03:38:00 at org.junit.platform.launcher.core.DefaultLauncher.lambda$execute$6(DefaultLauncher.java:188) Nov 29 03:38:00 at org.junit.platform.launcher.core.DefaultLauncher.withInterceptedStreams(DefaultLauncher.java:202) Nov 29 03:38:00 at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:181) Nov 29 03:38:00 at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:128) Nov 29 03:38:00 at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invokeAllTests(JUnitPlatformProvider.java:150) Nov 29 03:38:00 at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invoke(JUnitPlatformProvider.java:120) Nov 29 03:38:00 at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384) Nov 29 03:38:00 at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345) Nov 29 03:38:00 at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126) Nov 29 03:38:00 at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418) Nov 29 03:38:00 Caused by: org.rnorth.ducttape.RetryCountExceededException: Retry limit hit with exception Nov 29 03:38:00 at org.rnorth.ducttape.unreliables.Unreliables.retryUntilSuccess(Unreliables.java:88) Nov 29 03:38:00 at org.testcontainers.containers.GenericContainer.doStart(GenericContainer.java:327) Nov 29 03:38:00 ... 33 more Nov 29 03:38:00 Caused by: org.testcontainers.containers.ContainerLaunchException: Could not create/start container Nov 29 03:38:00 at org.testcontainers.containers.GenericContainer.tryStart(GenericContainer.java:523) Nov 29 03:38:00 at org.testcontainers.containers.GenericContainer.lambda$doStart$0(GenericContainer.java:329) Nov 29 03:38:00 at org.rnorth.ducttape.unreliables.Unreliables.retryUntilSuccess(Unreliables.java:81) Nov 29 03:38:00 ... 34 more Nov 29 03:38:00 Caused by: java.lang.IllegalStateException: Container did not start correctly. Nov 29 03:38:00 at org.testcontainers.containers.GenericContainer.tryStart(GenericContainer.java:461) Nov 29 03:38:00 ... 36 more Nov 29 03:38:00 Nov 29 03:38:01 [INFO] Running org.apache.flink.connector.kafka.sink.FlinkKafkaInternalProducerITCase Nov 29 03:38:16 [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.442 s - in org.apache.flink.connector.kafka.sink.FlinkKafkaInternalProducerITCase Nov 29 03:38:16 [INFO] Nov 29 03:38:16 [INFO] Results: Nov 29 03:38:16 [INFO] Nov 29 03:38:16 [ERROR] Errors: Nov 29 03:38:16 [ERROR] KafkaSinkITCase » ContainerLaunch Container startup failed Nov 29 03:38:16 [INFO] Nov 29 03:38:16 [ERROR] Tests run: 186, Failures: 0, Errors: 1, Skipped: 0 {code} https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=27181&view=logs&j=b0097207-033c-5d9a-b48c-6d4796fbe60d&t=8338a7d2-16f7-52e5-f576-4b7b3071eb3d&l=7151 -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-25089) KafkaSourceITCase.testBasicRead hangs on azure
Yun Gao created FLINK-25089: --- Summary: KafkaSourceITCase.testBasicRead hangs on azure Key: FLINK-25089 URL: https://issues.apache.org/jira/browse/FLINK-25089 Project: Flink Issue Type: Bug Components: Connectors / Kafka Affects Versions: 1.13.4 Reporter: Yun Gao https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=27180&view=logs&j=1fc6e7bf-633c-5081-c32a-9dea24b05730&t=80a658d1-f7f6-5d93-2758-53ac19fd5b19&l=6933 -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-25100) RMQSourceITCase failed on azure due to java.io.EOFException
Yun Gao created FLINK-25100: --- Summary: RMQSourceITCase failed on azure due to java.io.EOFException Key: FLINK-25100 URL: https://issues.apache.org/jira/browse/FLINK-25100 Project: Flink Issue Type: Bug Components: Connectors/ RabbitMQ Affects Versions: 1.14.1 Reporter: Yun Gao {code:java} Nov 29 12:02:05 at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:220) Nov 29 12:02:05 at org.junit.platform.launcher.core.DefaultLauncher.lambda$execute$6(DefaultLauncher.java:188) Nov 29 12:02:05 at org.junit.platform.launcher.core.DefaultLauncher.withInterceptedStreams(DefaultLauncher.java:202) Nov 29 12:02:05 at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:181) Nov 29 12:02:05 at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:128) Nov 29 12:02:05 at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invokeAllTests(JUnitPlatformProvider.java:150) Nov 29 12:02:05 at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invoke(JUnitPlatformProvider.java:120) Nov 29 12:02:05 at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384) Nov 29 12:02:05 at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345) Nov 29 12:02:05 at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126) Nov 29 12:02:05 at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418) Nov 29 12:02:05 Caused by: com.rabbitmq.client.AlreadyClosedException: connection is already closed due to connection error; cause: java.io.EOFException Nov 29 12:02:05 at com.rabbitmq.client.impl.AMQChannel.ensureIsOpen(AMQChannel.java:258) Nov 29 12:02:05 at com.rabbitmq.client.impl.AMQChannel.rpc(AMQChannel.java:341) Nov 29 12:02:05 at com.rabbitmq.client.impl.AMQChannel.privateRpc(AMQChannel.java:327) Nov 29 12:02:05 at com.rabbitmq.client.impl.AMQChannel.rpc(AMQChannel.java:275) Nov 29 12:02:05 at com.rabbitmq.client.impl.AMQConnection.start(AMQConnection.java:373) Nov 29 12:02:05 ... 59 more Nov 29 12:02:05 Nov 29 12:02:06 [INFO] Nov 29 12:02:06 [INFO] Results: Nov 29 12:02:06 [INFO] Nov 29 12:02:06 [ERROR] Errors: Nov 29 12:02:06 [ERROR] RMQSourceITCase.setUp:96->getRMQConnection:201 » PossibleAuthenticationFailure Nov 29 12:02:06 [INFO] Nov 29 12:02:06 [ERROR] Tests run: 3, Failures: 0, Errors: 1, Skipped: 0 {code} [https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=27205&view=logs&j=d44f43ce-542c-597d-bf94-b0718c71e5e8&t=ed165f3f-d0f6-524b-5279-86f8ee7d0e2d&l=13941] -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-25101) FlinkKafkaProducerITCase.testMigrateFromAtLeastOnceToExactlyOnce failed due to
Yun Gao created FLINK-25101: --- Summary: FlinkKafkaProducerITCase.testMigrateFromAtLeastOnceToExactlyOnce failed due to Key: FLINK-25101 URL: https://issues.apache.org/jira/browse/FLINK-25101 Project: Flink Issue Type: Bug Components: Connectors / Kafka Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} Nov 29 17:19:22 at org.junit.platform.launcher.core.DefaultLauncherSession$DelegatingLauncher.execute(DefaultLauncherSession.java:86) Nov 29 17:19:22 at org.junit.platform.launcher.core.SessionPerRequestLauncher.execute(SessionPerRequestLauncher.java:53) Nov 29 17:19:22 at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.execute(JUnitPlatformProvider.java:188) Nov 29 17:19:22 at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invokeAllTests(JUnitPlatformProvider.java:154) Nov 29 17:19:22 at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invoke(JUnitPlatformProvider.java:124) Nov 29 17:19:22 at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:428) Nov 29 17:19:22 at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:162) Nov 29 17:19:22 at org.apache.maven.surefire.booter.ForkedBooter.run(ForkedBooter.java:562) Nov 29 17:19:22 at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:548) Nov 29 17:19:22 Nov 29 17:19:22 [INFO] Nov 29 17:19:22 [INFO] Results: Nov 29 17:19:22 [INFO] Nov 29 17:19:22 [ERROR] Errors: Nov 29 17:19:22 [ERROR] FlinkKafkaProducerITCase.testMigrateFromAtLeastOnceToExactlyOnce:592->KafkaTestBase.assertExactlyOnceForTopic:317 » CorrelationIdMismatch Nov 29 17:19:22 [INFO] Nov 29 17:19:22 [ERROR] Tests run: 175, Failures: 0, Errors: 1, Skipped: 0 {code} [https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=27226&view=logs&j=c5f0071e-1851-543e-9a45-9ac140befc32&t=15a22db7-8faa-5b34-3920-d33c9f0ca23c&l=35495] -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-25102) ParquetFileSystemITCase.testPartialDynamicPartition failed on azure
Yun Gao created FLINK-25102: --- Summary: ParquetFileSystemITCase.testPartialDynamicPartition failed on azure Key: FLINK-25102 URL: https://issues.apache.org/jira/browse/FLINK-25102 Project: Flink Issue Type: Bug Components: Connectors / FileSystem Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} Nov 29 23:00:01 at org.apache.hadoop.conf.Configuration.getResource(Configuration.java:2780) Nov 29 23:00:01 at org.apache.hadoop.conf.Configuration.getStreamReader(Configuration.java:3036) Nov 29 23:00:01 at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2995) Nov 29 23:00:01 at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2968) Nov 29 23:00:01 at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2848) Nov 29 23:00:01 at org.apache.hadoop.conf.Configuration.get(Configuration.java:1200) Nov 29 23:00:01 at org.apache.hadoop.conf.Configuration.getTrimmed(Configuration.java:1254) Nov 29 23:00:01 at org.apache.hadoop.conf.Configuration.getInt(Configuration.java:1479) Nov 29 23:00:01 at org.apache.parquet.hadoop.codec.SnappyCodec.createInputStream(SnappyCodec.java:75) Nov 29 23:00:01 at org.apache.parquet.hadoop.CodecFactory$HeapBytesDecompressor.decompress(CodecFactory.java:109) Nov 29 23:00:01 at org.apache.parquet.hadoop.ColumnChunkPageReadStore$ColumnChunkPageReader$1.visit(ColumnChunkPageReadStore.java:103) Nov 29 23:00:01 at org.apache.parquet.hadoop.ColumnChunkPageReadStore$ColumnChunkPageReader$1.visit(ColumnChunkPageReadStore.java:99) Nov 29 23:00:01 at org.apache.parquet.column.page.DataPageV1.accept(DataPageV1.java:120) Nov 29 23:00:01 at org.apache.parquet.hadoop.ColumnChunkPageReadStore$ColumnChunkPageReader.readPage(ColumnChunkPageReadStore.java:99) Nov 29 23:00:01 at org.apache.flink.formats.parquet.vector.reader.AbstractColumnReader.readToVector(AbstractColumnReader.java:154) Nov 29 23:00:01 at org.apache.flink.formats.parquet.ParquetVectorizedInputFormat$ParquetReader.nextBatch(ParquetVectorizedInputFormat.java:390) Nov 29 23:00:01 at org.apache.flink.formats.parquet.ParquetVectorizedInputFormat$ParquetReader.readBatch(ParquetVectorizedInputFormat.java:358) Nov 29 23:00:01 at org.apache.flink.connector.file.src.impl.FileSourceSplitReader.fetch(FileSourceSplitReader.java:67) Nov 29 23:00:01 at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58) Nov 29 23:00:01 at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:142) Nov 29 23:00:01 ... 6 more Nov 29 23:00:01 Nov 29 23:00:02 [INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.341 s - in org.apache.flink.formats.parquet.ParquetFileCompactionITCase Nov 29 23:00:03 [ERROR] Picked up JAVA_TOOL_OPTIONS: -XX:+HeapDumpOnOutOfMemoryError Nov 29 23:00:03 [INFO] Running org.apache.flink.formats.parquet.ParquetFsStreamingSinkITCase Nov 29 23:00:20 [INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.033 s - in org.apache.flink.formats.parquet.ParquetFsStreamingSinkITCase Nov 29 23:00:21 [INFO] Nov 29 23:00:21 [INFO] Results: Nov 29 23:00:21 [INFO] Nov 29 23:00:21 [ERROR] Errors: Nov 29 23:00:21 [ERROR] ParquetFileSystemITCase.testPartialDynamicPartition Nov 29 23:00:21 [ERROR] Run 1: Failed to fetch next result Nov 29 23:00:21 [INFO] Run 2: PASS Nov 29 23:00:21 [INFO] Nov 29 23:00:21 [INFO] Nov 29 23:00:21 [ERROR] Tests run: 42, Failures: 0, Errors: 1, Skipped: 1 {code} https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=27235&view=logs&j=ba53eb01-1462-56a3-8e98-0dd97fbcaab5&t=2e426bf0-b717-56bb-ab62-d63086457354&l=11545 -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-25105) Enables final checkpoint by default
Yun Gao created FLINK-25105: --- Summary: Enables final checkpoint by default Key: FLINK-25105 URL: https://issues.apache.org/jira/browse/FLINK-25105 Project: Flink Issue Type: Sub-task Components: Runtime / Checkpointing Affects Versions: 1.15.0 Reporter: Yun Gao Fix For: 1.15.0 We would fix all the conflict tests and enable the feature by default in this version. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-25139) Shaded Hadoop S3A with credentials provider failed on azure
Yun Gao created FLINK-25139: --- Summary: Shaded Hadoop S3A with credentials provider failed on azure Key: FLINK-25139 URL: https://issues.apache.org/jira/browse/FLINK-25139 Project: Flink Issue Type: Bug Components: FileSystems Affects Versions: 1.13.3 Reporter: Yun Gao {code:java} Dec 01 19:33:39 at org.apache.hadoop.fs.s3a.S3AFileSystem.getObjectMetadata(S3AFileSystem.java:1232) ~[?:?] Dec 01 19:33:39 at org.apache.hadoop.fs.s3a.S3AFileSystem.s3GetFileStatus(S3AFileSystem.java:2169) ~[?:?] Dec 01 19:33:39 at org.apache.hadoop.fs.s3a.S3AFileSystem.innerGetFileStatus(S3AFileSystem.java:2149) ~[?:?] Dec 01 19:33:39 at org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:2088) ~[?:?] Dec 01 19:33:39 at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1734) ~[?:?] Dec 01 19:33:39 at org.apache.hadoop.fs.s3a.S3AFileSystem.exists(S3AFileSystem.java:2970) ~[?:?] Dec 01 19:33:39 at org.apache.flink.fs.s3hadoop.common.HadoopFileSystem.exists(HadoopFileSystem.java:165) ~[?:?] Dec 01 19:33:39 at org.apache.flink.core.fs.PluginFileSystemFactory$ClassLoaderFixingFileSystem.exists(PluginFileSystemFactory.java:148) ~[flink-dist_2.11-1.13-SNAPSHOT.jar:1.13-SNAPSHOT] Dec 01 19:33:39 at org.apache.flink.core.fs.FileSystem.initOutPathDistFS(FileSystem.java:984) ~[flink-dist_2.11-1.13-SNAPSHOT.jar:1.13-SNAPSHOT] Dec 01 19:33:39 at org.apache.flink.api.common.io.FileOutputFormat.initializeGlobal(FileOutputFormat.java:299) ~[flink-dist_2.11-1.13-SNAPSHOT.jar:1.13-SNAPSHOT] Dec 01 19:33:39 at org.apache.flink.runtime.jobgraph.InputOutputFormatVertex.initializeOnMaster(InputOutputFormatVertex.java:110) ~[flink-dist_2.11-1.13-SNAPSHOT.jar:1.13-SNAPSHOT] Dec 01 19:33:39 at org.apache.flink.runtime.executiongraph.DefaultExecutionGraphBuilder.buildGraph(DefaultExecutionGraphBuilder.java:174) ~[flink-dist_2.11-1.13-SNAPSHOT.jar:1.13-SNAPSHOT] Dec 01 19:33:39 at org.apache.flink.runtime.scheduler.DefaultExecutionGraphFactory.createAndRestoreExecutionGraph(DefaultExecutionGraphFactory.java:107) ~[flink-dist_2.11-1.13-SNAPSHOT.jar:1.13-SNAPSHOT] Dec 01 19:33:39 at org.apache.flink.runtime.scheduler.SchedulerBase.createAndRestoreExecutionGraph(SchedulerBase.java:342) ~[flink-dist_2.11-1.13-SNAPSHOT.jar:1.13-SNAPSHOT] Dec 01 19:33:39 at org.apache.flink.runtime.scheduler.SchedulerBase.(SchedulerBase.java:190) ~[flink-dist_2.11-1.13-SNAPSHOT.jar:1.13-SNAPSHOT] Dec 01 19:33:39 at org.apache.flink.runtime.scheduler.DefaultScheduler.(DefaultScheduler.java:122) ~[flink-dist_2.11-1.13-SNAPSHOT.jar:1.13-SNAPSHOT] Dec 01 19:33:39 at org.apache.flink.runtime.scheduler.DefaultSchedulerFactory.createInstance(DefaultSchedulerFactory.java:132) ~[flink-dist_2.11-1.13-SNAPSHOT.jar:1.13-SNAPSHOT] Dec 01 19:33:39 at org.apache.flink.runtime.jobmaster.DefaultSlotPoolServiceSchedulerFactory.createScheduler(DefaultSlotPoolServiceSchedulerFactory.java:110) ~[flink-dist_2.11-1.13-SNAPSHOT.jar:1.13-SNAPSHOT] Dec 01 19:33:39 at org.apache.flink.runtime.jobmaster.JobMaster.createScheduler(JobMaster.java:340) ~[flink-dist_2.11-1.13-SNAPSHOT.jar:1.13-SNAPSHOT] Dec 01 19:33:39 at org.apache.flink.runtime.jobmaster.JobMaster.(JobMaster.java:317) ~[flink-dist_2.11-1.13-SNAPSHOT.jar:1.13-SNAPSHOT] Dec 01 19:33:39 at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.internalCreateJobMasterService(DefaultJobMasterServiceFactory.java:107) ~[flink-dist_2.11-1.13-SNAPSHOT.jar:1.13-SNAPSHOT] Dec 01 19:33:39 at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.lambda$createJobMasterService$0(DefaultJobMasterServiceFactory.java:95) ~[flink-dist_2.11-1.13-SNAPSHOT.jar:1.13-SNAPSHOT] Dec 01 19:33:39 at org.apache.flink.util.function.FunctionUtils.lambda$uncheckedSupplier$4(FunctionUtils.java:112) ~[flink-dist_2.11-1.13-SNAPSHOT.jar:1.13-SNAPSHOT] Dec 01 19:33:39 at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604) ~[?:1.8.0_292] Dec 01 19:33:39 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_292] Dec 01 19:33:39 at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_292] Dec 01 19:33:39 at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) ~[?:1.8.0_292] Dec 01 19:33:39 at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) ~[?:1.8.0_292] Dec 01 19:33:39 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_292] Dec 01 19:33:39 at java.util
[jira] [Created] (FLINK-25140) Streaming File Sink s3 end-to-end test failed due to job has not started within a timeout of 10 sec
Yun Gao created FLINK-25140: --- Summary: Streaming File Sink s3 end-to-end test failed due to job has not started within a timeout of 10 sec Key: FLINK-25140 URL: https://issues.apache.org/jira/browse/FLINK-25140 Project: Flink Issue Type: Bug Components: Connectors / FileSystem Affects Versions: 1.13.3 Reporter: Yun Gao {code:java} Dec 01 19:06:38 Starting taskexecutor daemon on host fv-az26-327. Dec 01 19:06:38 Submitting job. Dec 01 19:06:54 Job (62f9a00856309492574699642574071c) is not yet running. Dec 01 19:06:57 Job (62f9a00856309492574699642574071c) is not yet running. Dec 01 19:07:00 Job (62f9a00856309492574699642574071c) is not yet running. Dec 01 19:07:03 Job (62f9a00856309492574699642574071c) is not yet running. Dec 01 19:07:06 Job (62f9a00856309492574699642574071c) is not yet running. Dec 01 19:07:09 Job (62f9a00856309492574699642574071c) is not yet running. Dec 01 19:07:12 Job (62f9a00856309492574699642574071c) is not yet running. Dec 01 19:07:15 Job (62f9a00856309492574699642574071c) is not yet running. Dec 01 19:07:18 Job (62f9a00856309492574699642574071c) is not yet running. Dec 01 19:07:21 Job (62f9a00856309492574699642574071c) is not yet running. Dec 01 19:07:22 Job (62f9a00856309492574699642574071c) has not started within a timeout of 10 sec Dec 01 19:07:22 Stopping job timeout watchdog (with pid=401626) {code} https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=27382&view=logs&j=c88eea3b-64a0-564d-0031-9fdcd7b8abee&t=ff888d9b-cd34-53cc-d90f-3e446d355529&l=12560 -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-25150) org.apache.flink.connector.file.src.reader.TextLineInputFormat.createReader failed due to violate ApiAnnotationRules
Yun Gao created FLINK-25150: --- Summary: org.apache.flink.connector.file.src.reader.TextLineInputFormat.createReader failed due to violate ApiAnnotationRules Key: FLINK-25150 URL: https://issues.apache.org/jira/browse/FLINK-25150 Project: Flink Issue Type: Bug Components: API / DataStream Reporter: Yun Gao {code:java} 021-12-02T21:44:11.4722598Z Dec 02 21:44:11 [ERROR] Tests run: 4, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 38.799 s <<< FAILURE! - in org.apache.flink.architecture.rules.ApiAnnotationRules 2021-12-02T21:44:11.4724167Z Dec 02 21:44:11 [ERROR] ApiAnnotationRules.PUBLIC_EVOLVING_API_METHODS_USE_ONLY_PUBLIC_EVOLVING_API_TYPES Time elapsed: 0.231 s <<< FAILURE! 2021-12-02T21:44:11.4725222Z Dec 02 21:44:11 java.lang.AssertionError: 2021-12-02T21:44:11.4726849Z Dec 02 21:44:11 Architecture Violation [Priority: MEDIUM] - Rule 'Return and argument types of methods annotated with @PublicEvolving must be annotated with @Public(Evolving).' was violated (2 times): 2021-12-02T21:44:11.4730100Z Dec 02 21:44:11 org.apache.flink.connector.file.src.reader.TextLineInputFormat.createReader(org.apache.flink.configuration.Configuration, org.apache.flink.core.fs.FSDataInputStream): Returned leaf type org.apache.flink.connector.file.src.reader.StreamFormat$Reader does not satisfy: reside outside of package 'org.apache.flink..' or annotated with @Public or annotated with @PublicEvolving or annotated with @Deprecated 2021-12-02T21:44:11.4734006Z Dec 02 21:44:11 org.apache.flink.connector.file.src.reader.TextLineInputFormat.createReader(org.apache.flink.configuration.Configuration, org.apache.flink.core.fs.FSDataInputStream): Returned leaf type org.apache.flink.connector.file.src.reader.TextLineInputFormat$Reader does not satisfy: reside outside of package 'org.apache.flink..' or annotated with @Public or annotated with @PublicEvolving or annotated with @Deprecated 2021-12-02T21:44:11.4736377Z Dec 02 21:44:11at com.tngtech.archunit.lang.ArchRule$Assertions.assertNoViolation(ArchRule.java:94) 2021-12-02T21:44:11.4737400Z Dec 02 21:44:11at com.tngtech.archunit.lang.ArchRule$Assertions.check(ArchRule.java:82) 2021-12-02T21:44:11.4738529Z Dec 02 21:44:11at com.tngtech.archunit.library.freeze.FreezingArchRule.check(FreezingArchRule.java:96) 2021-12-02T21:44:11.4739712Z Dec 02 21:44:11at com.tngtech.archunit.junit.ArchUnitTestDescriptor$ArchUnitRuleDescriptor.execute(ArchUnitTestDescriptor.java:159) 2021-12-02T21:44:11.4740983Z Dec 02 21:44:11at com.tngtech.archunit.junit.ArchUnitTestDescriptor$ArchUnitRuleDescriptor.execute(ArchUnitTestDescriptor.java:142) 2021-12-02T21:44:11.4742309Z Dec 02 21:44:11at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:151) 2021-12-02T21:44:11.4743532Z Dec 02 21:44:11at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) 2021-12-02T21:44:11.4744736Z Dec 02 21:44:11at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141) 2021-12-02T21:44:11.4745846Z Dec 02 21:44:11at org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137) 2021-12-02T21:44:11.4747137Z Dec 02 21:44:11at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139) 2021-12-02T21:44:11.4748480Z Dec 02 21:44:11at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) 2021-12-02T21:44:11.4749659Z Dec 02 21:44:11at org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:138) 2021-12-02T21:44:11.4750777Z Dec 02 21:44:11at org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:95) 2021-12-02T21:44:11.4751822Z Dec 02 21:44:11at java.util.ArrayList.forEach(ArrayList.java:1259) 2021-12-02T21:44:11.4752983Z Dec 02 21:44:11at org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.invokeAll(SameThreadHierarchicalTestExecutorService.java:41) 2021-12-02T21:44:11.4754345Z Dec 02 21:44:11at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:155) 2021-12-02T21:44:11.470Z Dec 02 21:44:11at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) 2021-12-02T21:44:11.4756753Z Dec 02 21:44:11at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141) 2021-12-02T21:44:11.4757869Z Dec 02 21:44:11at org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137) 2021-12-02T21:44:11.4759122Z Dec 02 21:44:11at org.junit.platform.engine.support.hierarchical.NodeTes
[jira] [Created] (FLINK-25165) CassandraConnectorITCase.testCassandraPojoAtLeastOnceSink failed on azure
Yun Gao created FLINK-25165: --- Summary: CassandraConnectorITCase.testCassandraPojoAtLeastOnceSink failed on azure Key: FLINK-25165 URL: https://issues.apache.org/jira/browse/FLINK-25165 Project: Flink Issue Type: Bug Reporter: Yun Gao {code:java} Dec 03 15:44:22 at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355) Dec 03 15:44:22 at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) Dec 03 15:44:22 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377) Dec 03 15:44:22 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363) Dec 03 15:44:22 at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) Dec 03 15:44:22 at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) Dec 03 15:44:22 at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) Dec 03 15:44:22 at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) Dec 03 15:44:22 at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) Dec 03 15:44:22 at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) Dec 03 15:44:22 at java.lang.Thread.run(Thread.java:748) Dec 03 15:44:22 Caused by: com.datastax.driver.core.exceptions.AlreadyExistsException: Table flink.test already exists Dec 03 15:44:22 at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:85) Dec 03 15:44:22 at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:37) Dec 03 15:44:22 at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:266) Dec 03 15:44:22 at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:246) Dec 03 15:44:22 at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) Dec 03 15:44:22 ... 18 more Dec 03 15:44:22 Dec 03 15:44:24 [INFO] Dec 03 15:44:24 [INFO] Results: Dec 03 15:44:24 [INFO] Dec 03 15:44:24 [ERROR] Errors: Dec 03 15:44:24 [ERROR] CassandraConnectorITCase.testCassandraPojoAtLeastOnceSink:469 » AlreadyExists ... Dec 03 15:44:24 [INFO] Dec 03 15:44:24 [ERROR] Tests run: 17, Failures: 0, Errors: 1, Skipped: 0 Dec 03 15:44:24 [INFO] {code} https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=27539&view=logs&j=d44f43ce-542c-597d-bf94-b0718c71e5e8&t=ed165f3f-d0f6-524b-5279-86f8ee7d0e2d&l=11550 -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-25166) UpsertKafkaDynamicTableFactoryTest failed on azure
Yun Gao created FLINK-25166: --- Summary: UpsertKafkaDynamicTableFactoryTest failed on azure Key: FLINK-25166 URL: https://issues.apache.org/jira/browse/FLINK-25166 Project: Flink Issue Type: Bug Components: Connectors / Kafka Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} 2021-12-04T01:23:22.9044771Z Dec 04 01:23:22 [ERROR] org.apache.flink.streaming.connectors.kafka.table.UpsertKafkaDynamicTableFactoryTest.testCreateSourceTableWithoutPK Time elapsed: 0.117 s <<< FAILURE! 2021-12-04T01:23:22.9046338Z Dec 04 01:23:22 java.lang.AssertionError: 2021-12-04T01:23:22.9047372Z Dec 04 01:23:22 2021-12-04T01:23:22.9050240Z Dec 04 01:23:22 Expected: (an instance of org.apache.flink.table.api.ValidationException and Expected failure cause is ) 2021-12-04T01:23:22.9054889Z Dec 04 01:23:22 but: Expected failure cause is The throwable does not contain the expected failure cause 2021-12-04T01:23:22.9073152Z Dec 04 01:23:22 Stacktrace was: org.apache.flink.table.api.ValidationException: Unable to create a source for reading table 'default.default.t1'. 2021-12-04T01:23:22.9073787Z Dec 04 01:23:22 2021-12-04T01:23:22.9074202Z Dec 04 01:23:22 Table options are: 2021-12-04T01:23:22.9074871Z Dec 04 01:23:22 2021-12-04T01:23:22.9075467Z Dec 04 01:23:22 'connector'='upsert-kafka' 2021-12-04T01:23:22.9076416Z Dec 04 01:23:22 'key.format'='test-format' 2021-12-04T01:23:22.9077449Z Dec 04 01:23:22 'key.test-format.changelog-mode'='I' 2021-12-04T01:23:22.9078047Z Dec 04 01:23:22 'key.test-format.delimiter'=',' 2021-12-04T01:23:22.9078684Z Dec 04 01:23:22 'key.test-format.fail-on-missing'='true' 2021-12-04T01:23:22.9079338Z Dec 04 01:23:22 'properties.bootstrap.servers'='dummy' 2021-12-04T01:23:22.9079984Z Dec 04 01:23:22 'topic'='sourceTopic_1' 2021-12-04T01:23:22.9080573Z Dec 04 01:23:22 'value.format'='test-format' 2021-12-04T01:23:22.9081181Z Dec 04 01:23:22 'value.test-format.changelog-mode'='I' 2021-12-04T01:23:22.9081869Z Dec 04 01:23:22 'value.test-format.delimiter'=',' 2021-12-04T01:23:22.9082502Z Dec 04 01:23:22 'value.test-format.fail-on-missing'='true' 2021-12-04T01:23:22.9083130Z Dec 04 01:23:22at org.apache.flink.table.factories.FactoryUtil.createDynamicTableSource(FactoryUtil.java:151) 2021-12-04T01:23:22.9084069Z Dec 04 01:23:22at org.apache.flink.table.factories.utils.FactoryMocks.createTableSource(FactoryMocks.java:58) 2021-12-04T01:23:22.9085335Z Dec 04 01:23:22at org.apache.flink.streaming.connectors.kafka.table.UpsertKafkaDynamicTableFactoryTest.testCreateSourceTableWithoutPK(UpsertKafkaDynamicTableFactoryTest.java:413) 2021-12-04T01:23:22.9087234Z Dec 04 01:23:22at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 2021-12-04T01:23:22.9088432Z Dec 04 01:23:22at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2021-12-04T01:23:22.9089635Z Dec 04 01:23:22at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 2021-12-04T01:23:22.9090624Z Dec 04 01:23:22at java.base/java.lang.reflect.Method.invoke(Method.java:566) 2021-12-04T01:23:22.9091202Z Dec 04 01:23:22at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) 2021-12-04T01:23:22.9092013Z Dec 04 01:23:22at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) 2021-12-04T01:23:22.9092699Z Dec 04 01:23:22at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) 2021-12-04T01:23:22.9093385Z Dec 04 01:23:22at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) 2021-12-04T01:23:22.9094096Z Dec 04 01:23:22at org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:258) 2021-12-04T01:23:22.9095110Z Dec 04 01:23:22at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45) 2021-12-04T01:23:22.9095817Z Dec 04 01:23:22at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) 2021-12-04T01:23:22.9096630Z Dec 04 01:23:22at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) 2021-12-04T01:23:22.9097273Z Dec 04 01:23:22at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) 2021-12-04T01:23:22.9097859Z Dec 04 01:23:22at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) 2021-12-04T01:23:22.9098505Z Dec 04 01:23:22at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) 2021-12-04T01:23:22.9099176Z Dec 04 01:23:22at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) 2021-12-04T01:23:22.9099802Z Dec 04 01:23:22at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) 2021-12-04T01:23:22.9100404Z Dec
[jira] [Created] (FLINK-25168) Azure failed due to unable to transfer maven artifacts
Yun Gao created FLINK-25168: --- Summary: Azure failed due to unable to transfer maven artifacts Key: FLINK-25168 URL: https://issues.apache.org/jira/browse/FLINK-25168 Project: Flink Issue Type: Bug Components: Build System / Azure Pipelines Affects Versions: 1.13.3 Reporter: Yun Gao {code:java} [ERROR] Failed to execute goal org.apache.maven.plugins:maven-deploy-plugin:2.8.2:deploy (default-deploy) on project flink-tests: Failed to deploy artifacts: Could not transfer artifact org.apache.flink:flink-tests:jar:1.13-20211205.020632-728 from/to apache.snapshots.https (https://repository.apache.org/content/repositories/snapshots): Failed to transfer file: https://repository.apache.org/content/repositories/snapshots/org/apache/flink/flink-tests/1.13-SNAPSHOT/flink-tests-1.13-20211205.020632-728.jar. Return code is: 502, ReasonPhrase: Proxy Error. -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn -rf :flink-tests ##[error]Bash exited with code '1'. Finishing: Deploy maven snapshot {code} https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=27560&view=logs&j=eca6b3a6-1600-56cc-916a-c549b3cde3ff&t=e9844b5e-5aa3-546b-6c3e-5395c7c0cac7&l=97156 -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-25269) Quickstarts Scala nightly end-to-end test failed on azure due to could not connect to resource manager
Yun Gao created FLINK-25269: --- Summary: Quickstarts Scala nightly end-to-end test failed on azure due to could not connect to resource manager Key: FLINK-25269 URL: https://issues.apache.org/jira/browse/FLINK-25269 Project: Flink Issue Type: Bug Components: Runtime / Coordination Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} Dec 10 13:12:17 at akka.actor.Actor.aroundReceive(Actor.scala:537) [flink-rpc-akka_ae8961cc-571e-483d-b468-da652db90bb9.jar:1.15-SNAPSHOT] Dec 10 13:12:17 at akka.actor.Actor.aroundReceive$(Actor.scala:535) [flink-rpc-akka_ae8961cc-571e-483d-b468-da652db90bb9.jar:1.15-SNAPSHOT] Dec 10 13:12:17 at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220) [flink-rpc-akka_ae8961cc-571e-483d-b468-da652db90bb9.jar:1.15-SNAPSHOT] Dec 10 13:12:17 at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580) [flink-rpc-akka_ae8961cc-571e-483d-b468-da652db90bb9.jar:1.15-SNAPSHOT] Dec 10 13:12:17 at akka.actor.ActorCell.invoke(ActorCell.scala:548) [flink-rpc-akka_ae8961cc-571e-483d-b468-da652db90bb9.jar:1.15-SNAPSHOT] Dec 10 13:12:17 at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) [flink-rpc-akka_ae8961cc-571e-483d-b468-da652db90bb9.jar:1.15-SNAPSHOT] Dec 10 13:12:17 at akka.dispatch.Mailbox.run(Mailbox.scala:231) [flink-rpc-akka_ae8961cc-571e-483d-b468-da652db90bb9.jar:1.15-SNAPSHOT] Dec 10 13:12:17 at akka.dispatch.Mailbox.exec(Mailbox.scala:243) [flink-rpc-akka_ae8961cc-571e-483d-b468-da652db90bb9.jar:1.15-SNAPSHOT] Dec 10 13:12:17 at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) [?:1.8.0_292] Dec 10 13:12:17 at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) [?:1.8.0_292] Dec 10 13:12:17 at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) [?:1.8.0_292] Dec 10 13:12:17 at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) [?:1.8.0_292] Dec 10 13:12:17 2021-12-10 13:12:07,296 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Starting the resource manager. Dec 10 13:12:17 2021-12-10 13:12:09,426 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Registering TaskManager with ResourceID 10.1.0.79:35275-d26a40 (akka.tcp://flink@10.1.0.79:35275/user/rpc/taskmanager_0) at ResourceManager Dec 10 13:12:17 2021-12-10 13:12:09,496 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Registering TaskManager with ResourceID 10.1.0.79:35275-d26a40 (akka.tcp://flink@10.1.0.79:35275/user/rpc/taskmanager_0) at ResourceManager Dec 10 13:12:17 2021-12-10 13:12:13,189 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Received JobGraph submission 'Elasticsearch7.x end to end sink test example' (effb86be1cfd961e947988200a724de7). Dec 10 13:12:17 2021-12-10 13:12:13,190 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Submitting job 'Elasticsearch7.x end to end sink test example' (effb86be1cfd961e947988200a724de7). Dec 10 13:12:17 2021-12-10 13:12:13,225 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at akka://flink/user/rpc/jobmanager_2 . Dec 10 13:12:17 2021-12-10 13:12:13,252 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Initializing job 'Elasticsearch7.x end to end sink test example' (effb86be1cfd961e947988200a724de7). Dec 10 13:12:17 2021-12-10 13:12:13,324 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Using restart back off time strategy FixedDelayRestartBackoffTimeStrategy(maxNumberRestartAttempts=2147483647, backoffTimeMS=1000) for Elasticsearch7.x end to end sink test example (effb86be1cfd961e947988200a724de7). Dec 10 13:12:17 2021-12-10 13:12:13,428 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Running initialization on master for job Elasticsearch7.x end to end sink test example (effb86be1cfd961e947988200a724de7). {code} -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-25270) Azure failed due to stopped hearing from agent AlibabaCI006-agent01
Yun Gao created FLINK-25270: --- Summary: Azure failed due to stopped hearing from agent AlibabaCI006-agent01 Key: FLINK-25270 URL: https://issues.apache.org/jira/browse/FLINK-25270 Project: Flink Issue Type: Bug Components: Build System / Azure Pipelines Affects Versions: 1.14.0 Reporter: Yun Gao {code:java} ##[error]We stopped hearing from agent AlibabaCI006-agent01. Verify the agent machine is running and has a healthy network connection. Anything that terminates an agent process, starves it for CPU, or blocks its network access can cause this error. For more information, see: https://go.microsoft.com/fwlink/?linkid=846610 Started: 周六 at 下午1:37 Duration: <1s {code} https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=27982&view=logs&j=f2b08047-82c3-520f-51ee-a30fd6254285 -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-25271) ApplicationDispatcherBootstrapITCase. testDispatcherRecoversAfterLosingAndRegainingLeadership failed on azure
Yun Gao created FLINK-25271: --- Summary: ApplicationDispatcherBootstrapITCase. testDispatcherRecoversAfterLosingAndRegainingLeadership failed on azure Key: FLINK-25271 URL: https://issues.apache.org/jira/browse/FLINK-25271 Project: Flink Issue Type: Bug Components: Client / Job Submission Affects Versions: 1.14.0 Reporter: Yun Gao {code:java} Dec 12 04:22:42 at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:128) Dec 12 04:22:42 at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invokeAllTests(JUnitPlatformProvider.java:150) Dec 12 04:22:42 at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invoke(JUnitPlatformProvider.java:120) Dec 12 04:22:42 at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384) Dec 12 04:22:42 at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345) Dec 12 04:22:42 at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126) Dec 12 04:22:42 at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418) Dec 12 04:22:42 Dec 12 04:22:42 [INFO] Dec 12 04:22:42 [INFO] Results: Dec 12 04:22:42 [INFO] Dec 12 04:22:42 [ERROR] Errors: Dec 12 04:22:42 [ERROR] ApplicationDispatcherBootstrapITCase.testDispatcherRecoversAfterLosingAndRegainingLeadership:124->awaitJobStatus:135->lambda$awaitJobStatus$2:138 » IllegalState Dec 12 04:22:42 [INFO] Dec 12 04:22:42 [ERROR] Tests run: 3, Failures: 0, Errors: 1, Skipped: 0 Dec 12 04:22:42 [INFO] {code} https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=27993&view=logs&j=4d4a0d10-fca2-5507-8eed-c07f0bdf4887&t=7b25afdf-cc6c-566f-5459-359dc2585798&l=9350 -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-25278) Azure failed due to unable to transfer jar from confluent maven repo
Yun Gao created FLINK-25278: --- Summary: Azure failed due to unable to transfer jar from confluent maven repo Key: FLINK-25278 URL: https://issues.apache.org/jira/browse/FLINK-25278 Project: Flink Issue Type: Bug Components: Build System / Azure Pipelines Affects Versions: 1.13.3 Reporter: Yun Gao {code:java} Dec 12 00:46:45 [ERROR] Failed to execute goal on project flink-avro-confluent-registry: Could not resolve dependencies for project org.apache.flink:flink-avro-confluent-registry:jar:1.13-SNAPSHOT: Could not transfer artifact io.confluent:common-utils:jar:5.5.2 from/to confluent (https://packages.confluent.io/maven/): transfer failed for https://packages.confluent.io/maven/io/confluent/common-utils/5.5.2/common-utils-5.5.2.jar: Connection reset -> [Help 1] Dec 12 00:46:45 [ERROR] Dec 12 00:46:45 [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. Dec 12 00:46:45 [ERROR] Re-run Maven using the -X switch to enable full debug logging. Dec 12 00:46:45 [ERROR] Dec 12 00:46:45 [ERROR] For more information about the errors and possible solutions, please read the following articles: Dec 12 00:46:45 [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException Dec 12 00:46:45 [ERROR] Dec 12 00:46:45 [ERROR] After correcting the problems, you can resume the build with the command Dec 12 00:46:45 [ERROR] mvn -rf :flink-avro-confluent-registry {code} https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=27994&view=logs&j=a5ef94ef-68c2-57fd-3794-dc108ed1c495&t=9c1ddabe-d186-5a2c-5fcc-f3cafb3ec699&l=8812 -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-25279) KafkaSourceLegacyITCase.testKeyValueSupport failed on azure due to topic already exists
Yun Gao created FLINK-25279: --- Summary: KafkaSourceLegacyITCase.testKeyValueSupport failed on azure due to topic already exists Key: FLINK-25279 URL: https://issues.apache.org/jira/browse/FLINK-25279 Project: Flink Issue Type: Bug Components: Connectors / Kafka Affects Versions: 1.15.0 Reporter: Yun Gao {code:java} Dec 12 03:00:12 [ERROR] Failures: Dec 12 03:00:12 [ERROR] KafkaSourceLegacyITCase.testKeyValueSupport:58->KafkaConsumerTestBase.runKeyValueTest:1528->KafkaTestBase.createTestTopic:222 Create test topic : keyvaluetest failed, org.apache.kafka.common.errors.TopicExistsException: Topic 'keyvaluetest' already exists. Dec 12 03:00:12 [INFO] Dec 12 03:00:12 [ERROR] Tests run: 177, Failures: 1, Errors: 0, Skipped: 0 {code} https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=27995&view=logs&j=72d4811f-9f0d-5fd0-014a-0bc26b72b642&t=e424005a-b16e-540f-196d-da062cc19bdf&l=35697 -- This message was sent by Atlassian Jira (v8.20.1#820001)