[jira] [Created] (FLINK-9661) TTL state should support to do time shift after restoring from checkpoint( savepoint).

Sihua Zhou created FLINK-9661: - Summary: TTL state should support to do time shift after restoring from checkpoint( savepoint). Key: FLINK-9661 URL: https://issues.apache.org/jira/browse/FLINK-9661 Projec

[jira] [Created] (FLINK-9633) Flink doesn't use the Savepoint path's filesystem to create the OuptutStream on Task.

Sihua Zhou created FLINK-9633: - Summary: Flink doesn't use the Savepoint path's filesystem to create the OuptutStream on Task. Key: FLINK-9633 URL: https://issues.apache.org/jira/browse/FLINK-9633 Project

[jira] [Created] (FLINK-9622) DistributedCacheDfsTest failed on travis

Sihua Zhou created FLINK-9622: - Summary: DistributedCacheDfsTest failed on travis Key: FLINK-9622 URL: https://issues.apache.org/jira/browse/FLINK-9622 Project: Flink Issue Type: Bug Co

[jira] [Created] (FLINK-9619) Always close the task manager connection when the container is completed in YarnResourceManager

Sihua Zhou created FLINK-9619: - Summary: Always close the task manager connection when the container is completed in YarnResourceManager Key: FLINK-9619 URL: https://issues.apache.org/jira/browse/FLINK-9619

[jira] [Created] (FLINK-9613) YARNSessionCapacitySchedulerITCase failed because YarnTestBase.checkClusterEmpty()

Sihua Zhou created FLINK-9613: - Summary: YARNSessionCapacitySchedulerITCase failed because YarnTestBase.checkClusterEmpty() Key: FLINK-9613 URL: https://issues.apache.org/jira/browse/FLINK-9613 Project: F

[jira] [Created] (FLINK-9601) Snapshot of CopyOnWriteStateTable will failed, when the amount of record is more than MAXIMUM_CAPACITY

Sihua Zhou created FLINK-9601: - Summary: Snapshot of CopyOnWriteStateTable will failed, when the amount of record is more than MAXIMUM_CAPACITY Key: FLINK-9601 URL: https://issues.apache.org/jira/browse/FLINK-9601

[jira] [Created] (FLINK-9546) The heartbeatTimeoutIntervalMs of HeartbeatMonitor should be larger than 0

Sihua Zhou created FLINK-9546: - Summary: The heartbeatTimeoutIntervalMs of HeartbeatMonitor should be larger than 0 Key: FLINK-9546 URL: https://issues.apache.org/jira/browse/FLINK-9546 Project: Flink

[jira] [Created] (FLINK-9480) Let local recovery support rescaling

Sihua Zhou created FLINK-9480: - Summary: Let local recovery support rescaling Key: FLINK-9480 URL: https://issues.apache.org/jira/browse/FLINK-9480 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-9479) Let the rescale API to use local recovery

Sihua Zhou created FLINK-9479: - Summary: Let the rescale API to use local recovery Key: FLINK-9479 URL: https://issues.apache.org/jira/browse/FLINK-9479 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-9475) introduce an approximate version of "select distinct"

Sihua Zhou created FLINK-9475: - Summary: introduce an approximate version of "select distinct" Key: FLINK-9475 URL: https://issues.apache.org/jira/browse/FLINK-9475 Project: Flink Issue Type: New

[jira] [Created] (FLINK-9474) Introduce an approximate version of "count distinct"

Sihua Zhou created FLINK-9474: - Summary: Introduce an approximate version of "count distinct" Key: FLINK-9474 URL: https://issues.apache.org/jira/browse/FLINK-9474 Project: Flink Issue Type: New

[jira] [Created] (FLINK-9468) get outputLimit of LimitedConnectionsFileSystem incorrectly

Sihua Zhou created FLINK-9468: - Summary: get outputLimit of LimitedConnectionsFileSystem incorrectly Key: FLINK-9468 URL: https://issues.apache.org/jira/browse/FLINK-9468 Project: Flink Issue Ty

[jira] [Created] (FLINK-9426) Harden RocksDBWriteBatchPerformanceTest.benchMark()

Sihua Zhou created FLINK-9426: - Summary: Harden RocksDBWriteBatchPerformanceTest.benchMark() Key: FLINK-9426 URL: https://issues.apache.org/jira/browse/FLINK-9426 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-9401) Data lost when rescaling the job from incremental checkpoint

Sihua Zhou created FLINK-9401: - Summary: Data lost when rescaling the job from incremental checkpoint Key: FLINK-9401 URL: https://issues.apache.org/jira/browse/FLINK-9401 Project: Flink Issue T

[jira] [Created] (FLINK-9373) Always call RocksIterator.status() to check the internal error of RocksDB

Sihua Zhou created FLINK-9373: - Summary: Always call RocksIterator.status() to check the internal error of RocksDB Key: FLINK-9373 URL: https://issues.apache.org/jira/browse/FLINK-9373 Project: Flink

[jira] [Created] (FLINK-9364) Add doc for the memory usage in flink

Sihua Zhou created FLINK-9364: - Summary: Add doc for the memory usage in flink Key: FLINK-9364 URL: https://issues.apache.org/jira/browse/FLINK-9364 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-9351) RM stop assigning slot to Job because the TM killed before connecting to JM successfully

Sihua Zhou created FLINK-9351: - Summary: RM stop assigning slot to Job because the TM killed before connecting to JM successfully Key: FLINK-9351 URL: https://issues.apache.org/jira/browse/FLINK-9351 Proj

[jira] [Created] (FLINK-9325) generate the _meta file only when the writing is totally successful

Sihua Zhou created FLINK-9325: - Summary: generate the _meta file only when the writing is totally successful Key: FLINK-9325 URL: https://issues.apache.org/jira/browse/FLINK-9325 Project: Flink

[jira] [Created] (FLINK-9269) Concurrency problem in HeapKeyedStateBackend when performing checkpoint async

Sihua Zhou created FLINK-9269: - Summary: Concurrency problem in HeapKeyedStateBackend when performing checkpoint async Key: FLINK-9269 URL: https://issues.apache.org/jira/browse/FLINK-9269 Project: Flink

[jira] [Created] (FLINK-9263) Kafka010ITCase failed on travis flaky

Sihua Zhou created FLINK-9263: - Summary: Kafka010ITCase failed on travis flaky Key: FLINK-9263 URL: https://issues.apache.org/jira/browse/FLINK-9263 Project: Flink Issue Type: Bug Compo

[jira] [Created] (FLINK-9260) Introduce a friendly way to resume the job from externalized checkpoints automatically

Sihua Zhou created FLINK-9260: - Summary: Introduce a friendly way to resume the job from externalized checkpoints automatically Key: FLINK-9260 URL: https://issues.apache.org/jira/browse/FLINK-9260 Projec

[jira] [Created] (FLINK-9251) Move MemoryStateBackend to flink-state-backends

Sihua Zhou created FLINK-9251: - Summary: Move MemoryStateBackend to flink-state-backends Key: FLINK-9251 URL: https://issues.apache.org/jira/browse/FLINK-9251 Project: Flink Issue Type: Improveme

[jira] [Created] (FLINK-9243) SuccessAfterNetworkBuffersFailureITCase#testSuccessfulProgramAfterFailure is unstable

Sihua Zhou created FLINK-9243: - Summary: SuccessAfterNetworkBuffersFailureITCase#testSuccessfulProgramAfterFailure is unstable Key: FLINK-9243 URL: https://issues.apache.org/jira/browse/FLINK-9243 Projec

[jira] [Created] (FLINK-9174) The type of state created in ProccessWindowFunction.proccess() is inconsistency

Sihua Zhou created FLINK-9174: - Summary: The type of state created in ProccessWindowFunction.proccess() is inconsistency Key: FLINK-9174 URL: https://issues.apache.org/jira/browse/FLINK-9174 Project: Flin

[jira] [Created] (FLINK-9116) Introduce getAll and removeAll for MapState

Sihua Zhou created FLINK-9116: - Summary: Introduce getAll and removeAll for MapState Key: FLINK-9116 URL: https://issues.apache.org/jira/browse/FLINK-9116 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-9102) Make the JobGraph disable queued scheduling for Flip6LocalStreamEnvironment

Sihua Zhou created FLINK-9102: - Summary: Make the JobGraph disable queued scheduling for Flip6LocalStreamEnvironment Key: FLINK-9102 URL: https://issues.apache.org/jira/browse/FLINK-9102 Project: Flink

[jira] [Created] (FLINK-9028) flip6 should check config before starting cluster

Sihua Zhou created FLINK-9028: - Summary: flip6 should check config before starting cluster Key: FLINK-9028 URL: https://issues.apache.org/jira/browse/FLINK-9028 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-9022) fix resource close in `StreamTaskStateInitializerImpl.streamOperatorStateContext()`

Sihua Zhou created FLINK-9022: - Summary: fix resource close in `StreamTaskStateInitializerImpl.streamOperatorStateContext()` Key: FLINK-9022 URL: https://issues.apache.org/jira/browse/FLINK-9022 Project:

[jira] [Created] (FLINK-8968) Fix native resource leak caused by ReadOptions

Sihua Zhou created FLINK-8968: - Summary: Fix native resource leak caused by ReadOptions Key: FLINK-8968 URL: https://issues.apache.org/jira/browse/FLINK-8968 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-8927) Eagerly release the checkpoint object created from RocksDB

Sihua Zhou created FLINK-8927: - Summary: Eagerly release the checkpoint object created from RocksDB Key: FLINK-8927 URL: https://issues.apache.org/jira/browse/FLINK-8927 Project: Flink Issue Type

[jira] [Created] (FLINK-8918) Introduce Runtime Filter Join

Sihua Zhou created FLINK-8918: - Summary: Introduce Runtime Filter Join Key: FLINK-8918 URL: https://issues.apache.org/jira/browse/FLINK-8918 Project: Flink Issue Type: Bug Components: T

[jira] [Created] (FLINK-8859) RocksDB backend should pass WriteOption to Rocks.put() when restoring

Sihua Zhou created FLINK-8859: - Summary: RocksDB backend should pass WriteOption to Rocks.put() when restoring Key: FLINK-8859 URL: https://issues.apache.org/jira/browse/FLINK-8859 Project: Flink

[jira] [Created] (FLINK-8846) ntroducing `parallel recovery` mode for incremental checkpoint

Sihua Zhou created FLINK-8846: - Summary: ntroducing `parallel recovery` mode for incremental checkpoint Key: FLINK-8846 URL: https://issues.apache.org/jira/browse/FLINK-8846 Project: Flink Issue

[jira] [Created] (FLINK-8845) Introducing `parallel recovery` mode for fully checkpoint (savepoint)

Sihua Zhou created FLINK-8845: - Summary: Introducing `parallel recovery` mode for fully checkpoint (savepoint) Key: FLINK-8845 URL: https://issues.apache.org/jira/browse/FLINK-8845 Project: Flink

[jira] [Created] (FLINK-8817) Decrement numPendingContainerRequests only when request container successfully

Sihua Zhou created FLINK-8817: - Summary: Decrement numPendingContainerRequests only when request container successfully Key: FLINK-8817 URL: https://issues.apache.org/jira/browse/FLINK-8817 Project: Flink

[jira] [Created] (FLINK-8816) Remove the oldWorker only after starting newWorker successfully in registerTaskExecutorInternal()

Sihua Zhou created FLINK-8816: - Summary: Remove the oldWorker only after starting newWorker successfully in registerTaskExecutorInternal() Key: FLINK-8816 URL: https://issues.apache.org/jira/browse/FLINK-8816

[jira] [Created] (FLINK-8790) Improve performance for recovery from incremental checkpoint

Sihua Zhou created FLINK-8790: - Summary: Improve performance for recovery from incremental checkpoint Key: FLINK-8790 URL: https://issues.apache.org/jira/browse/FLINK-8790 Project: Flink Issue T

[jira] [Created] (FLINK-8777) improve resource release when recovery from failover

Sihua Zhou created FLINK-8777: - Summary: improve resource release when recovery from failover Key: FLINK-8777 URL: https://issues.apache.org/jira/browse/FLINK-8777 Project: Flink Issue Type: Impr

[jira] [Created] (FLINK-8753) Introduce Incremental savepoint

Sihua Zhou created FLINK-8753: - Summary: Introduce Incremental savepoint Key: FLINK-8753 URL: https://issues.apache.org/jira/browse/FLINK-8753 Project: Flink Issue Type: New Feature Com

[jira] [Created] (FLINK-8699) Fix concurrency problem in rocksdb full checkpoint

Sihua Zhou created FLINK-8699: - Summary: Fix concurrency problem in rocksdb full checkpoint Key: FLINK-8699 URL: https://issues.apache.org/jira/browse/FLINK-8699 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-8679) RocksDBKeyedBackend.getKeys(stateName, namespace) doesn't filter data with namespace

Sihua Zhou created FLINK-8679: - Summary: RocksDBKeyedBackend.getKeys(stateName, namespace) doesn't filter data with namespace Key: FLINK-8679 URL: https://issues.apache.org/jira/browse/FLINK-8679 Project:

[jira] [Created] (FLINK-8676) Memory Leak in AbstractKeyedStateBackend.applyToAllKeys() when backend is base on RocksDB

Sihua Zhou created FLINK-8676: - Summary: Memory Leak in AbstractKeyedStateBackend.applyToAllKeys() when backend is base on RocksDB Key: FLINK-8676 URL: https://issues.apache.org/jira/browse/FLINK-8676 Pro

[jira] [Created] (FLINK-8657) Fix incorrect description for external checkpoint vs savepoint

Sihua Zhou created FLINK-8657: - Summary: Fix incorrect description for external checkpoint vs savepoint Key: FLINK-8657 URL: https://issues.apache.org/jira/browse/FLINK-8657 Project: Flink Issue

[jira] [Created] (FLINK-8639) Fix always need to seek multiple times when iterator RocksDBMapState

Sihua Zhou created FLINK-8639: - Summary: Fix always need to seek multiple times when iterator RocksDBMapState Key: FLINK-8639 URL: https://issues.apache.org/jira/browse/FLINK-8639 Project: Flink

[jira] [Created] (FLINK-8602) Accelerate recover from failover when use incremental checkpoint

Sihua Zhou created FLINK-8602: - Summary: Accelerate recover from failover when use incremental checkpoint Key: FLINK-8602 URL: https://issues.apache.org/jira/browse/FLINK-8602 Project: Flink Iss

[jira] [Created] (FLINK-8601) Introduce LinkedBloomFilterState for Approximate calculation and other situations of performance optimization

Sihua Zhou created FLINK-8601: - Summary: Introduce LinkedBloomFilterState for Approximate calculation and other situations of performance optimization Key: FLINK-8601 URL: https://issues.apache.org/jira/browse/FLINK-8

[jira] [Created] (FLINK-8044) Introduce scheduling mechanism to satisfy both state locality and input

Sihua Zhou created FLINK-8044: - Summary: Introduce scheduling mechanism to satisfy both state locality and input Key: FLINK-8044 URL: https://issues.apache.org/jira/browse/FLINK-8044 Project: Flink

[jira] [Created] (FLINK-8018) RMQ does not support disabling queueDeclare, when the user has no declaration permissions, it cannot connect

Sihua Zhou created FLINK-8018: - Summary: RMQ does not support disabling queueDeclare, when the user has no declaration permissions, it cannot connect Key: FLINK-8018 URL: https://issues.apache.org/jira/browse/FLINK-80

[jira] [Created] (FLINK-7873) Introduce HybridStreamStateHandle for quick recovery from checkpoint.

Sihua Zhou created FLINK-7873: - Summary: Introduce HybridStreamStateHandle for quick recovery from checkpoint. Key: FLINK-7873 URL: https://issues.apache.org/jira/browse/FLINK-7873 Project: Flink

[jira] [Created] (FLINK-7219) Current allocate strategy cann‘t achieve the optimal effect with input's location

Sihua Zhou created FLINK-7219: - Summary: Current allocate strategy cann‘t achieve the optimal effect with input's location Key: FLINK-7219 URL: https://issues.apache.org/jira/browse/FLINK-7219 Project: Fl

[jira] [Created] (FLINK-7218) ExecutionVertex.getPreferredLocationsBasedOnInputs() will always return empty

Sihua Zhou created FLINK-7218: - Summary: ExecutionVertex.getPreferredLocationsBasedOnInputs() will always return empty Key: FLINK-7218 URL: https://issues.apache.org/jira/browse/FLINK-7218 Project: Flink

[jira] [Created] (FLINK-7180) CoGroupStream perform checkpoint failed

Sihua Zhou created FLINK-7180: - Summary: CoGroupStream perform checkpoint failed Key: FLINK-7180 URL: https://issues.apache.org/jira/browse/FLINK-7180 Project: Flink Issue Type: Bug Com

[jira] [Created] (FLINK-7160) Support hive like udtf

Sihua Zhou created FLINK-7160: - Summary: Support hive like udtf Key: FLINK-7160 URL: https://issues.apache.org/jira/browse/FLINK-7160 Project: Flink Issue Type: New Feature Components:

[jira] [Created] (FLINK-7153) JM can't allocate source for ExecutionGraph correctly

Sihua Zhou created FLINK-7153: - Summary: JM can't allocate source for ExecutionGraph correctly Key: FLINK-7153 URL: https://issues.apache.org/jira/browse/FLINK-7153 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-6980) TypeExtractor.getForObject can't get typeinfo correctly.

Sihua Zhou created FLINK-6980: - Summary: TypeExtractor.getForObject can't get typeinfo correctly. Key: FLINK-6980 URL: https://issues.apache.org/jira/browse/FLINK-6980 Project: Flink Issue Type: