Re: [DISCUSS] Deprecate/remove Twitter connector

2022-01-31 Thread Andrew Otto
Any SSE/EventSource Java Client should work. I have not personally used one. From a quick search, maybe https://github.com/launchdarkly/okhttp-eventsource or something like it? On Mon, Jan 31, 2022 at 11:45 AM Francesco Guardiani < france...@ververica.com> wrote: > > Shameless plug: Maybe th

Re: [DISCUSS] Deprecate/remove Twitter connector

2022-01-31 Thread Andrew Otto
https://golb.hplar.ch/2018/02/Access-Server-Sent-Events-from-Java.html looks like a nice tutorial. On Mon, Jan 31, 2022 at 12:27 PM Andrew Otto wrote: > Any SSE/EventSource Java Client should work. I have not personally used > one. From a quick search, maybe > https://github.com/launchdarkly/o

Re: [DISCUSS] Deprecate/remove Twitter connector

2022-01-31 Thread Francesco Guardiani
> Shameless plug: Maybe the Wikipedia EventStreams SSE API would make for a great connector example in Flink? Sounds like a great idea! Do you have a ready to use Java Client for that?

Re: [DISCUSS] Deprecate/remove Twitter connector

2022-01-31 Thread Jing Ge
Thanks @Martijn for driving this! +1 for deprecating and removing it. All the concerns mentioned previously are valid. It is good to know that the upcoming connector template/archetype will help the user for the kickoff. Beyond that, speaking of using a real connector as a sample, since Flink is he

Re: [DISCUSS] Deprecate/remove Twitter connector

2022-01-31 Thread Andrew Otto
Shameless plug: Maybe the Wikipedia EventStreams SSE API would make for a great connector example in Flink? :D On Mon, Jan 31, 2022 at 5:41 AM Martijn Visser wrote: > Hi all, > > Than

Re: [DISCUSS] Deprecate/remove Twitter connector

2022-01-31 Thread Martijn Visser
Hi all, Thanks for your feedback. It's not about having this connector in the main repo, that has been voted on already. This is strictly about the connector itself, since it's not maintained and most probably also can't be used due to changes in Twitter's API that aren't reflected in our connecto

Re: [DISCUSS] Deprecate/remove Twitter connector

2022-01-31 Thread Francesco Guardiani
Hi, I agree with the concern about having this connector in the main repo. But I think in general it doesn't harm to have a sample connector to show how to develop a custom connector, and I think that the Twitter connector can be a good candidate for such a template. It needs rework for sure, as i

Re: [DISCUSS] Deprecate/remove Twitter connector

2022-01-30 Thread David Anderson
I agree. The Twitter connector is used in a few (unofficial) tutorials, so if we remove it that will make it more difficult for those tutorials to be maintained. On the other hand, if I recall correctly, that connector uses V1 of the Twitter API, which has been deprecated, so it's really not very

[DISCUSS] Deprecate/remove Twitter connector

2022-01-21 Thread Martijn Visser
Hi everyone, I would like to discuss deprecating Flinks' Twitter connector [1]. This was one of the first connectors that was added to Flink, which could be used to access the tweets from Twitter. Given the evolution of Flink over Twitter, I don't think that: * Users are still using this connecto