[
https://issues.apache.org/jira/browse/KAFKA-6181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16258373#comment-16258373
]
ASF GitHub Bot commented on KAFKA-6181:
---------------------------------------
GitHub user deorenikhil opened a pull request:
https://github.com/apache/kafka/pull/4233
KAFKA-6181 Examining log messages with {{--deep-iteration}} should show
superset of fields
Printing log data on Kafka brokers using kafka.tools.DumpLogSegments
--deep-iteration option doesn't print all the fields.
Adding missing fields in the log data on kafka brokers
Adding following fields in the deep-interation option:
baseOffset
lastOffset
baseSequence
lastSequence
producerEpoch
partitionLeaderEpoch
size
crc
thanks,
Nikhil
### Committer Checklist (excluded from commit message)
- [ ] Verify design and implementation
- [ ] Verify test coverage and CI build status
- [ ] Verify documentation (including upgrade notes)
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/deorenikhil/kafka trunk
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/kafka/pull/4233.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4233
----
commit 4c2ae5974077d4bd6e5a756b280f3b6c382eb8bc
Author: deorenikhil <[email protected]>
Date: 2017-11-19T06:49:19Z
Adding missing fields in the log data on kafka brokers
----
> Examining log messages with {{--deep-iteration}} should show superset of
> fields
> -------------------------------------------------------------------------------
>
> Key: KAFKA-6181
> URL: https://issues.apache.org/jira/browse/KAFKA-6181
> Project: Kafka
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.11.0.0
> Reporter: Yeva Byzek
> Priority: Minor
> Labels: newbie
>
> Printing log data on Kafka brokers using {{kafka.tools.DumpLogSegments}}:
> {{--deep-iteration}} should show a superset of fields in each message, as
> compared to without this parameter, however some fields are missing. Impact:
> users need to execute both commands to get the full set of fields.
> {noformat}
> kafka-run-class kafka.tools.DumpLogSegments \
> --print-data-log \
> --files 00000000000000000000.log
> Dumping 00000000000000000000.log
> Starting offset: 0
> baseOffset: 0 lastOffset: 35 baseSequence: -1 lastSequence: -1 producerId: -1
> producerEpoch: -1 partitionLeaderEpoch: 0 isTransactional: false position: 0
> CreateTime: 1509987569448 isvalid: true size: 3985 magic: 2 compresscodec:
> NONE crc: 4227905507
> {noformat}
> {noformat}
> kafka-run-class kafka.tools.DumpLogSegments \
> --print-data-log \
> --files 00000000000000000000.log \
> --deep-iteration
> Dumping 00000000000000000000.log
> Starting offset: 0
> offset: 0 position: 0 CreateTime: 1509987569420 isvalid: true keysize: -1
> valuesize: 100
> magic: 2 compresscodec: NONE producerId: -1 sequence: -1 isTransactional:
> false headerKeys: [] payload:
> SSXVNJHPDQDXVCRASTVYBCWVMGNYKRXVZXKGXTSPSJDGYLUEGQFLAQLOCFLJBEPOWFNSOMYARHAOPUFOJHHDXEHXJBHW
> {noformat}
> Notice, for example, that {{partitionLeaderEpoch}} and {{crc}} are missing.
> Print these and all missing fields.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
