Hi Sharma, >From your description, it seem that you need to implement a custom source to fetch data from an Http server. Please refer to data sources <https://nightlies.apache.org/flink/flink-docs-master/docs/dev/datastream/sources/>[1] to learn how to develop a data source. And FYI, there is a similar question[2].
Hope this helps. Best, Shuiqiang [1] https://nightlies.apache.org/flink/flink-docs-master/docs/dev/datastream/sources/ [2] https://stackoverflow.com/questions/51257309/can-flink-receive-http-requests-as-datasource Manjusha Sharma <sharma.manju...@gmail.com> 于2021年11月8日周一 下午7:46写道： > Hi > > I am new to Flink and just getting started. I've watched quite a few Flink > Forward videos and excited to get started. > > I have a need where I need to pull data from a RESTFul API endpoint that > is authenticated using username and password and send this data to a Kafka > Topic. I would like to pull data from thie REST API every 10 minutes (or > set this value to be configurable). > > I've done some google searches but I always end up at > https://ci.apache.org/projects/flink/flink-docs-master/docs/ops/rest_api/ > which isn't the right thing I'm looking for. > > Can someone please let me know if this is possible to accomplish in Flink? > If so, which API should I be using? >
