[
https://issues.apache.org/jira/browse/FLINK-8500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16465456#comment-16465456
]
ASF GitHub Bot commented on FLINK-8500:
---------------------------------------
GitHub user FredTing opened a pull request:
https://github.com/apache/flink/pull/5958
[FLINK-8500] Get the timestamp of the Kafka message from kafka consumer
## What is the purpose of the change
This pull request make the Kafka timestamp and timestampType available in
the message deserialisation so one can use it in the business logic processing.
## Brief change log
Introduced new interface `ConsumerRecordMetaInfo` with meta info of the
kafka message
Extended the `DeserializationSchema` with the `T
deserialize(ConsumerRecordMetaInfo consumerRecord)` method.
Adjusted the Kafka Connectors to support the new interface.
Added some documentation.
## Verifying this change
This change is already covered by existing tests, such as most of the Kafka
Consumer tests.
## Does this pull request potentially affect one of the following parts:
- Dependencies (does it add or upgrade a dependency): (yes / **no**)
- The public API, i.e., is any changed class annotated with
`@Public(Evolving)`: (**yes** / no)
- The serializers: (**yes** / no / don't know)
- The runtime per-record code paths (performance sensitive): (**yes** /
no / don't know)
- Anything that affects deployment or recovery: JobManager (and its
components), Checkpointing, Yarn/Mesos, ZooKeeper: (yes / **no** / don't know)
- The S3 file system connector: (yes / **no** / don't know)
## Documentation
- Does this pull request introduce a new feature? (**yes** / no)
- If yes, how is the feature documented? (not applicable / **docs** /
**JavaDocs** / not documented)
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/FredTing/flink FLINK-8500
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/5958.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #5958
----
commit dca3e7bf5504fdeb929cb38bdd05c3fcec184d6c
Author: Fred Teunissen <fred.teunissen@...>
Date: 2018-05-06T15:31:15Z
[FLINK-8500] Get the timestamp of the Kafka message from kafka consumer
----
> Get the timestamp of the Kafka message from kafka consumer(Kafka010Fetcher)
> ---------------------------------------------------------------------------
>
> Key: FLINK-8500
> URL: https://issues.apache.org/jira/browse/FLINK-8500
> Project: Flink
> Issue Type: Improvement
> Components: Kafka Connector
> Affects Versions: 1.4.0
> Reporter: yanxiaobin
> Priority: Major
> Fix For: 1.6.0
>
> Attachments: image-2018-01-30-14-58-58-167.png,
> image-2018-01-31-10-48-59-633.png
>
>
> The method deserialize of KeyedDeserializationSchema needs a parameter
> 'kafka message timestamp' (from ConsumerRecord) .In some business scenarios,
> this is useful！
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
