Hi Mans, there is no explicit guide for how to write a custom source/sink as far as I know. There is just a paragraph in the data sources section ( https://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/#data-sources ).
For sources you have to implement the SourceFunction interface for non parallel sources or the ParallelSourceFunction for parallel sources. If you need access to the RuntimeContext, then you should extend the RichParallelSourceFunction. Be aware, that you should always emit elements to the downstream operator when you hold the checkpoint lock. You emit and obtain the checkpoint lock from the SourceContext. For custom sinks you have to implement the SinkFunction or the ParallelSinkFunction. I hope this gets you started :-) Cheers, Till On Mon, May 9, 2016 at 11:54 PM, M Singh <mans2si...@yahoo.com.invalid> wrote: > Hi Folks: > I am new to Flink and wanted to find out if there is a guide to how to > create new sources/sinks for Flink. > I tried browsing through the documentation but did not find a single place > with all the interfaces/etc required. > Thanks for your help. > Mans
