I am not sure if spark natively support this functionality. Custom poller
class can query HTTP resources as per configured interval and dump it on
HDFS / other stores in csv or json format. Using lambda arch (aws) or
invoking sc context you can use these values for further processing
On Thursday 1
Not very clear. Can you elaborate your use case ?
On Thursday 10 December 2015, Sourav Mazumder
wrote:
> Hi All,
>
> Currently is there a way using which one can connect to a http server to
> get data as a dstream at a given frequency ?
>
> Or one has to write own utility for the same ?
>
> Rega
Hi All,
Currently is there a way using which one can connect to a http server to
get data as a dstream at a given frequency ?
Or one has to write own utility for the same ?
Regards,
Sourav
