[
https://issues.apache.org/jira/browse/KAFKA-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17046915#comment-17046915
]
ASF GitHub Bot commented on KAFKA-9618:
---------------------------------------
abbccdda commented on pull request #8186: KAFKA-9618: Directory deletion
failure leading to error task RocksDB open
URL: https://github.com/apache/kafka/pull/8186
*More detailed description of your change,
if necessary. The PR title and PR message become
the squashed commit message, so use a separate
comment to ping reviewers.*
*Summary of testing strategy (including rationale)
for the feature or bug fix. Unit and/or integration
tests are expected for any behaviour change and
system tests should be considered for larger changes.*
### Committer Checklist (excluded from commit message)
- [ ] Verify design and implementation
- [ ] Verify test coverage and CI build status
- [ ] Verify documentation (including upgrade notes)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Failed state store deletion could lead to task file not found
> -------------------------------------------------------------
>
> Key: KAFKA-9618
> URL: https://issues.apache.org/jira/browse/KAFKA-9618
> Project: Kafka
> Issue Type: Bug
> Components: streams
> Reporter: Boyang Chen
> Assignee: Boyang Chen
> Priority: Major
>
> A failed deletion of a stream task directory could later lead to the
> impression that the task state is still there, thus causing file not found
> exception as the directory was partially deleted.
> {code:java}
> [2020-02-26T22:08:05-08:00]
> (streams-soak-trunk-eos_soak_i-04ebd21fd0e0da9bf_streamslog) [2020-02-27
> 06:08:04,394] WARN
> [stream-soak-test-b26adb53-07e2-4013-933a-0f4bcac84c04-StreamThread-2]
> stream-thread
> [stream-soak-test-b26adb53-07e2-4013-933a-0f4bcac84c04-StreamThread-2] task
> [2_2] Failed to wiping state stores for task 2_2
> (org.apache.kafka.streams.processor.internals.StreamTask)
> [2020-02-26T22:08:05-08:00]
> (streams-soak-trunk-eos_soak_i-04ebd21fd0e0da9bf_streamslog) [2020-02-27
> 06:08:04,394] INFO
> [stream-soak-test-b26adb53-07e2-4013-933a-0f4bcac84c04-StreamThread-2]
> [Producer
> clientId=stream-soak-test-b26adb53-07e2-4013-933a-0f4bcac84c04-StreamThread-2-2_2-producer,
> transactionalId=stream-soak-test-2_2] Closing the Kafka producer with
> timeoutMillis = 9223372036854775807 ms.
> (org.apache.kafka.clients.producer.KafkaProducer)
> [2020-02-26T22:08:05-08:00]
> (streams-soak-trunk-eos_soak_i-04ebd21fd0e0da9bf_streamslog) [2020-02-27
> 06:08:04,411] ERROR
> [stream-soak-test-b26adb53-07e2-4013-933a-0f4bcac84c04-StreamThread-1]
> stream-thread
> [stream-soak-test-b26adb53-07e2-4013-933a-0f4bcac84c04-StreamThread-1]
> Encountered the following exception during processing and the thread is going
> to shut down: (org.apache.kafka.streams.processor.internals.StreamThread)
> [2020-02-26T22:08:05-08:00]
> (streams-soak-trunk-eos_soak_i-04ebd21fd0e0da9bf_streamslog)
> org.apache.kafka.streams.errors.ProcessorStateException: Error opening store
> KSTREAM-AGGREGATE-STATE-STORE-0000000040 at location
> /mnt/run/streams/state/stream-soak-test/2_2/rocksdb/KSTREAM-AGGREGATE-STATE-STORE-0000000040
> at
> org.apache.kafka.streams.state.internals.RocksDBTimestampedStore.openRocksDB(RocksDBTimestampedStore.java:87)
> at
> org.apache.kafka.streams.state.internals.RocksDBStore.openDB(RocksDBStore.java:191)
> at
> org.apache.kafka.streams.state.internals.RocksDBStore.init(RocksDBStore.java:230)
> at
> org.apache.kafka.streams.state.internals.WrappedStateStore.init(WrappedStateStore.java:48)
> at
> org.apache.kafka.streams.state.internals.ChangeLoggingKeyValueBytesStore.init(ChangeLoggingKeyValueBytesStore.java:44)
> at
> org.apache.kafka.streams.state.internals.WrappedStateStore.init(WrappedStateStore.java:48)
> at
> org.apache.kafka.streams.state.internals.CachingKeyValueStore.init(CachingKeyValueStore.java:58)
> at
> org.apache.kafka.streams.state.internals.WrappedStateStore.init(WrappedStateStore.java:48)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
