Re: Re:RE: RE: [DISCUSS] FLIP-233: Introduce HTTP Connector

2022-06-02 Thread Martijn Visser
Hi all, Thanks for opening a discussion and/or creating a FLIP. I do think that a HTTP connector could be a powerful connector for users. In order to get a proper HTTP connector in as part of the Apache Flink project, we'll need to have FLIP and a successful vote. When that's done, one of the PMC

Re: Re:RE: RE: [DISCUSS] FLIP-233: Introduce HTTP Connector

2022-06-02 Thread Ber, Jeremy
Hi Xuyang, Great feedback on the early days of this FLIP! With respect to the Source question, definitely want to add a source connector in collaboration with the getindata folks below in this thread. We will collaborate to make HTTP source changes. I agree that FLIP-171 is the cornerstone of

Re:RE: RE: [DISCUSS] FLIP-233: Introduce HTTP Connector

2022-06-01 Thread Xuyang
Hi, Jeremy, thanks for driving this work. I have noticed that there have been a lot of users that need a official HTTP connector from user-email. I have some comments about this Flip. * The title is "Introduce HTTP Connector", but it seems that this FLIP only contains the content of HTTP sink.

RE: RE: [DISCUSS] FLIP-233: Introduce HTTP Connector

2022-06-01 Thread Krzysztof Chmielewski
Hello Jeremy, I'm the original author and currently main contributor to our HTTP connector [1] that Maciej wrote about. I'm more than happy to help and get this going. Should you have any questions about our implementation feel free to contact me. [1]: https://github.com/getindata/flink-http-conn

Re: [DISCUSS] FLIP-233: Introduce HTTP Connector

2022-06-01 Thread Ber, Jeremy
Hi Maciej, This is great! I would love to test this out myself and review your Async Sink implementation. The best way to get this sink merged in would be to reopen the FLIP, add in your modifications / implementation details, and drive the FLIP process forward. Let's work together to make it

RE: [DISCUSS] FLIP-233: Introduce HTTP Connector

2022-05-31 Thread Maciej Bryński
Hi Jeremy, We as GetinData already started some work related with HTTP connector. As a first step we created HTTP Source [1] described in blog post here [2]. During next 3 months we are planning to create HTTP Sink based on Flink 1.15 new Async Sink API. How can we help with making this sink “offi

Re: [DISCUSS] FLIP-233: Introduce HTTP Connector

2022-05-19 Thread Ber, Jeremy
Hi Austin, Thanks for the recommendations! After internal discussion I have decided to park this FLIP for now until I have more capacity to commit to it. Jeremy On 5/17/22, 10:26 AM, "Austin Cawley-Edwards" wrote: CAUTION: This email originated from outside of the organization. Do not c

Re: [DISCUSS] FLIP-233: Introduce HTTP Connector

2022-05-17 Thread Austin Cawley-Edwards
Hey Jeremy, Thanks for kicking off this discussion. As a Flink user, I too struggled with the lack of HTTP support and rolled my own with AsyncIO. Reading through the FLIP, I just have a few general questions and comments. * It is not clear to me if multiple HTTP methods are supported or not? It'

[DISCUSS] FLIP-233: Introduce HTTP Connector

2022-05-17 Thread Ber, Jeremy
Hi there, We would like to start a discussion thread on FLIP-233: Introduce HTTP Connector where we propose to create a connector for delivering arbitrary data packets from Apache Flink to an HTTP Endpoint.