GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/4324
KAFKA-6360: Clear RocksDB Segments when store is closed
Now that we support re-initializing state stores, we need to clear the
segments when the store is closed so that they can be re-opened
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/4318
MINOR: fix warn logging in RecordCollectorImpl
Fix warn log message in RecordCollectorImpl so it prints the exception
message rather than `{}`
### Committer Checklist (excluded from commit
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/4317
KAFKA-6349: fix concurrent modification exception in AbstractStateManager
during restore
Fixes a `ConcurrentModificationException` in`AbstractStateManager` that is
triggered when a `StateStore` is re
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/4239
KAFKA-6214: enable use of in-memory store for standby tasks
Remove the flag in `ProcessorStateManager` that checks if a store is
persistent when registering it as a standby task.
Updated the smoke
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/4074
MINOR: add equals to SessionWindows
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dguy/kafka minor-session-window-equals
Alternatively you can
Github user dguy commented on the issue:
https://github.com/apache/kafka-site/pull/91
Merged to asf-site
---
Github user dguy closed the pull request at:
https://github.com/apache/kafka/pull/4025
---
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/4025
KAFKA-5989: resume consumption of tasks that have state stores but no
changelogging
Stores where logging is disabled where never consumed as the partitions
were paused, but never resumed.
You can
Github user dguy closed the pull request at:
https://github.com/apache/kafka/pull/3740
---
Github user dguy closed the pull request at:
https://github.com/apache/kafka/pull/4001
---
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/4009
MINOR: add with method to Materialized
Add a `with(Serde keySerde, Serde valSerde)` to `Materialized` for cases
where people don't care about the state store name.
You can merge this pull re
Github user dguy commented on the issue:
https://github.com/apache/kafka-site/pull/77
@miguno
---
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/4002
KAFKA-5989: resume consumption of tasks that have state stores but no
changelogging
Stores where logging is disabled where never consumed as the partitions
were paused, but never resumed.
You can
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/4001
KAFKA-6001: remove from Materialized usages
Make the API simpler by removing `` from usages of
`Materialized`. This is already enforced when by
`Materialized.as(KeyValueBytesStore)` etc.
You can
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3984
MINOR: update streams quickstart for KIP-182
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dguy/kafka quickstart-update
Alternatively you can
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3983
KAFKA-5986: Streams State Restoration never completes when logging is
disabled
When logging is disabled and there are state stores the task never
transitions from restoring to running. This is
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3981
HOTFIX: fix build compilation error
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dguy/kafka fix-build
Alternatively you can review and apply
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3971
MINOR: additional kip-182 doc updates
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dguy/kafka kip-182-docs
Alternatively you can review and
Github user dguy commented on the issue:
https://github.com/apache/kafka-site/pull/86
Thanks @manjuapu, LGTM. Can you please also file a PR against apache kafka
for the change to `streams/index.html'? Otherwise that change will be lost.
---
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3943
MINOR: always set Serde.Long on count operations
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dguy/kafka count-materialized
Alternatively you
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3936
KAFKA-5956: use serdes from materialized in table and globalTable
The new overloads `StreamBuilder.table(String, Materialized)` and
`StreamsBuilder.globalTable(String, Materialized)` need to set the
Github user dguy commented on the issue:
https://github.com/apache/kafka-site/pull/82
@manjuapu you should be able to close it yourself? I can't close it.
---
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3921
MINOR: add upgrade note for KIP-173 topic configs
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dguy/kafka minor-kip-173-docs
Alternatively you
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3905
MINOR: change task initialization logging levels
In `AssignedTasks` log at debug all task ids that are yet to be initialized.
In `StreamsTask` log at trace when the task is initialized.
You can
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3903
KAFKA-5931: deprecate KTable#through and KTable#to
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dguy/kafka deprectate-to-through
Alternatively
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3902
KAFKA-5922: Add SessionWindowedKStream
Add `SessionWindowedKStream` and implementation. Deprecate existing
`SessionWindow` `aggregate` methods on `KGroupedStream`
You can merge this pull request into
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3892
MINOR: use StoreBuilder in KStreamImpl rather than StateStoreSupplier
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dguy/kafka cleanup-state
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3889
KAFKA-5921: add Materialized overloads to windowed kstream
Add `Materialized` overloads to `WindowedKStream`. Deprecate existing
methods on `KGroupedStream`
You can merge this pull request into a Git
Github user dguy closed the pull request at:
https://github.com/apache/kafka/pull/3858
---
Github user dguy commented on the issue:
https://github.com/apache/kafka-site/pull/77
as per: https://github.com/apache/kafka-site/pull/78#issuecomment-329644776
---
Github user dguy commented on the issue:
https://github.com/apache/kafka-site/pull/78
@joel-hamill thanks for the PR. However... these changes should be made
against the Apache Kafka project - otherwise we run the risk of losing them.
---
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3868
KAFKA-5908: fix range query in CompositeReadOnlyWindowStore
The `NextIteratorFunction` in `CompositeReadOnlyWindowStore` was
incorrectly using the `timeFrom` as the `timeTo`
You can merge this pull
Github user dguy closed the pull request at:
https://github.com/apache/kafka/pull/3857
---
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3858
MINOR: update docs to add note about removing SNAPSHOT from streams
dependency
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dguy/kafka docs
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3857
MINOR: Bump version in streams quickstart archetype pom.xml
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dguy/kafka fix-archetype-version
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3847
MINOR: update tutorial doc to match ak-site
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dguy/kafka minor-doc-update
Alternatively you can
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3846
MINOR: update release script for streams quickstart
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dguy/kafka minor-release-script
Alternatively
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3837
KAFKA-5873: add materialized overloads to StreamsBuilder
Add overloads for `table` and `globalTable` that use `Materialized`
You can merge this pull request into a Git repository by running
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3829
KAFKA-5655: materialized count, aggregate, reduce to KGroupedTable
Add overloads of `count`, `aggregate`, `reduce` using `Materialized` to
`KGroupedTable`
deprecate other overloads
You can merge
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3827
KAFKA-5654: add materialized count, reduce, aggregate to KGroupedStream
Add overloads of `count`, `reduce`, and `aggregate` that are `Materialized`
to `KGroupedStream`.
Refactor common parts
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3826
KAFKA:5653: add join overloads to KTable
Add `join`, `leftJoin`, `outerJoin` overloads that use `Materialized` to
`KTable`
You can merge this pull request into a Git repository by running:
$ git
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3825
KAFKA-5817: [FOLLOW-UP] add SerializedInternal
Add `SerializedInternal` class and remove getters from `Serialized`
You can merge this pull request into a Git repository by running:
$ git pull
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3817
MINOR: make Printed copy ctor protected
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dguy/kafka printed-ctor-protected
Alternatively you can
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3816
MINOR: make Consumed copy ctor protected
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dguy/kafka consumed-ctor
Alternatively you can review
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3810
KAFKA-5816: [FOLLOW UP] - create ProducedInternal class
Create `ProducedInternal` and remove getters from `Produced`
You can merge this pull request into a Git repository by running:
$ git pull
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3809
KAFKA-5853: implement WindowedKStream
Add the `WindowedKStream` interface and implementation of methods that
don't require `Materialized`
You can merge this pull request into a Git reposito
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3807
KAFKA-5852: Add filter, filterNot, mapValues and Materialized to KTable
Add overloads of `filter`, `filterNot`, `mapValues` that take
`Materialized` as a param to `KTable`. Deprecate overloads using
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3802
KAFKA-5844: add groupBy(selector, serialized) to Ktable
add `KTable#groupBy(KeyValueMapper, Serialized)` and deprecate the overload
with `Serde` params
You can merge this pull request into a Git
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3793
MINOR: add mvn-pgp-plugin to sign streams quickstart jars
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dguy/kafka sign-mvn-jars
Alternatively
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3790
MINOR: fix scalaVersion variable in templateData.js
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dguy/kafka fix-js-tempate
Alternatively you
Github user dguy closed the pull request at:
https://github.com/apache/kafka/pull/3786
---
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3786
MINOR: preparing for bug fix release
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dguy/kafka 0.11.0
Alternatively you can review and apply
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3784
KAFKA-5832: add Consumed and change StreamBuilder to use it
Added `Consumed` class.
Updated `StreamBuilder#stream`, `StreamBuilder#table`,
`StreamBuilder#globalTable`
You can merge this pull
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3783
KAFKA-5515: Remove date formatting from Segments
Remove date formatting from `Segments` and use the `segementId` instead.
Add tests to make sure can load old segments.
Rename old segment dirs
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3776
KAFKA-5819: Add Joined class and relevant KStream join overloads
Add the `Joined` class and the overloads to `KStream` that use it.
Deprecate existing methods that have `Serde` params
You can
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3772
KAFKA-5817: Add Serialized class and overloads to KStream#groupBy and
KStream#groupByKey
Part of KIP-182
- Add the `Serialized` class
- implement overloads of `KStream#groupByKey` and KStream
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3770
KAFKA-5816: add Produced class, KStream#to(topic, Produced), and
KStream#through(topic, Produced)
Add the `Produced` class and `KStream` overloads that use it:
`KStream#to(String, Produced
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3768
KAFKA:5652 add Printed class and KStream#print(printed)
Part of KIP-182
- Add `Printed` class and `KStream#print(Printed)`
- deprecate all other `print` and `writeAsText` methods
You can merge
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3767
KAFKA-5650: add StateStoreBuilder interface and implementations
Part of KIP-182
- Add `StateStoreBuilder` interface and `WindowStateStoreBuilder`,
`KeyValueStateStoreBuilder`, and
Github user dguy closed the pull request at:
https://github.com/apache/kafka/pull/3759
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3759
[WIP]: extract and make public KeySchema & HasNextCondition
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dguy/kafka keyschema-ext
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3754
KAFKA-5804: retain duplicates in ChangeLoggingWindowBytesStore
`ChangeLoggingWindowBytesStore` needs to have the same `retainDuplicates`
functionality as `RocksDBWindowStore` else data could be lost
Github user dguy closed the pull request at:
https://github.com/apache/kafka/pull/3747
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3747
KAFKA-5787: StoreChangelogReader needs to restore partitions that were
added post initialization
If a task fails during initialization due to a LockException, its changelog
partitions are not
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3740
MINOR: reduce logging to trace in NetworkClient when an old server API is
being used
logging in `NetworkClient#doSend´ at debug level is spamming the logs when
you have a producer that is sending
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3736
KAFKA-5787: StoreChangelogReader needs to restore partitions that were
added post initialization
If a task fails during initialization due to a LockException, its changelog
partitions are not
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3729
KAFKA-5749: Add MeteredSessionStore and ChangeloggingSessionBytesStore.
Make MeteredSessionStore the outermost store.
You can merge this pull request into a Git repository by running:
$ git pull
Github user dguy closed the pull request at:
https://github.com/apache/kafka/pull/3724
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3725
HOTFIX: reduce streams benchmark input records to 10 million
We are occasionally hitting some timeouts due to processing not finishing.
So rather than failing the build for these reasons it would be
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3724
KAFKA-5769: Transient test failure
org.apache.kafka.streams.integration.KStreamRepartitionJoinTest.shouldCorrectlyRepartitionOnJoinOperationsWithZeroSizedCache
Don't start the consumer until st
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3692
KAFKA-5689:Add MeteredWindowStore and refactor store hierarchy
Add MeteredWindowStore and ChangeLoggingWindowBytesStore.
Refactor Store hierarchy such that Metered is always the outermost store
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3685
KAFKA-5668: fetch across stores in CompositeReadOnlyWindowStore &
CompositeReadOnlySessionStore
Fix range queries in `CompositeReadOnlyWindowStore` and
`CompositeReadOnlySessionStore` to fetch ac
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3675
KAFKA-5152: perform state restoration in poll loop
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dguy/kafka kafka-5152
Alternatively you can
Github user dguy closed the pull request at:
https://github.com/apache/kafka/pull/3170
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user dguy closed the pull request at:
https://github.com/apache/kafka/pull/3653
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user dguy closed the pull request at:
https://github.com/apache/kafka/pull/3654
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3654
KAFKA-5562: Do streams state directory cleanup on a single thread
Backported from trunk: https://github.com/apache/kafka/pull/3516
You can merge this pull request into a Git repository by running
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3653
KAFKA-5152: move state restoration out of rebalance and into poll loop
In `onPartitionsAssigned`:
1. release all locks for non-assigned suspended tasks.
2. resume any suspended tasks.
3
Github user dguy closed the pull request at:
https://github.com/apache/kafka/pull/3652
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3652
MINOR: change log level in ThreadCache to trace
cache eviction logging at debug level is too high volume
You can merge this pull request into a Git repository by running:
$ git pull https
Github user dguy closed the pull request at:
https://github.com/apache/kafka/pull/3633
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3650
KAFKA-5717: InMemoryKeyValueStore should delete keys with null values
during restore
Fixed a bug in the InMemoryKeyValueStore restoration where a key with a
`null` value is written in to the map
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3633
MINOR: streams memory management docs
update streams memory management docs
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dguy/kafka mem-doc-011
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3624
KAFKA-5702: extract refactor StreamThread
Extracted `TaskManager` to handle all task related activities.
Make `StandbyTaskCreator`, `TaskCreator`, and `RebalanceListener` static
classes so they
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3604
MINOR: add memory management section to streams docs
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dguy/kafka memory-management-docs
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3592
KAFKA-5673: refactor KeyValueStore hierarchy to make MeteredKeyValueStore
outermost
refactor StateStoreSuppliers such that a `MeteredKeyValueStore` is the
outermost store.
You can merge this pull
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3588
HOTFIX: fix threading issue in MeteredKeyValueStore
`MeteredKeyValueStore` wasn't thread safe. Interleaving operations could
modify the state, i.e, the `key` and/or `value` which could resu
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3516
KAFKA-5562: execute state dir cleanup on single thread
Use a single `StateDirectory` per streams instance.
Use threadId to determine which thread owns the lock.
Only allow the owning thread to
Github user dguy commented on the issue:
https://github.com/apache/kafka-site/pull/65
@guozhangwang , yep had the discussion with @ijuma today. Managed to break
everything in the process due to changes that weren't in `kafka` that were in
`kafka-site` and changes in `kafka` that
Github user dguy closed the pull request at:
https://github.com/apache/kafka-site/pull/65
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3502
HOTFIX: fix paths in streams index
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dguy/kafka doc-fixes
Alternatively you can review and apply
Github user dguy commented on the issue:
https://github.com/apache/kafka-site/pull/65
Can't i just merge this PR? The process there seems more about creating a
new version for a release, i.e, i don't want to update everything
---
If your project is set up for it, you ca
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3493
HOTFIX: fix broken streams test
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dguy/kafka hotfix-test-failure
Alternatively you can review and
GitHub user dguy opened a pull request:
https://github.com/apache/kafka-site/pull/65
MINOR: add Interactive Queries docs
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dguy/kafka-site iq-doc-update
Alternatively you can review
Github user dguy commented on the issue:
https://github.com/apache/kafka-site/pull/65
@guozhangwang
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3484
MINOR: add IQ docs to streams documentation
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dguy/kafka iq-doc
Alternatively you can review and
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3469
MINOR: remove unused eosEnabled field from ProcessorStateManager
remove unused eosEnabled field from ProcessorStateManager
You can merge this pull request into a Git repository by running:
$ git
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3459
KAFKA-3741: allow users to specify default topic configs for internal topics
Allow users to specify default topic configs for streams internal topics by
supplying properties from `TopicConfig` with a
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3410
KAFKA-4913: prevent creation of window stores with less than 2 segments
Throw IllegalArgumentException when attempting to create a `WindowStore`
via `Stores` or directly with
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/3384
MINOR: remove unused hitRatio field in NamedCache
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dguy/kafka remove-unused-field
Alternatively
1 - 100 of 271 matches
Mail list logo
