[
https://issues.apache.org/jira/browse/FLINK-4630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15526424#comment-15526424
]
shijinkui commented on FLINK-4630:
----------------------------------
Some business system such as risk online management. They need the response
cost to be minimum, at least below 50ms. If we business system send message to
kafka or other message queue, the delay will growing up. Message send directly
from distributed business system to Flink Source, that is end-to-end.
I only finished netty tcp source, example:
https://github.com/HuaweiBigData/flink-netty-source/blob/master/src/test/scala/com/huawei/stream/NettySourceTest.scala
> add netty tcp/restful pushed source support
> -------------------------------------------
>
> Key: FLINK-4630
> URL: https://issues.apache.org/jira/browse/FLINK-4630
> Project: Flink
> Issue Type: New Feature
> Components: Streaming Connectors
> Reporter: shijinkui
>
> When source stream get start, listen a provided tcp port, receive stream data
> from user data source.
> This netty tcp source is keepping alive and end-to-end, that is from business
> system to flink worker directly.
> Such source service is needed in produce indeed.
> describe the source in detail below:
> 1. source run as a netty tcp server
> 2. user provide a tcp port, if the port is in used, increace the port
> number between 1024 to 65535. Source can parallel.
> 3. callback the provided url to report the real port to listen
> 4. user push streaming data to netty server, then collect the data to flink
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
