Re: [DISCUSS] Break up streaming connectors into subprojects

2015-04-13 Thread Robert Metzger
I filed a JIRA to address the issue: https://issues.apache.org/jira/browse/FLINK-1874 On Thu, Apr 9, 2015 at 4:08 PM, Robert Metzger wrote: > Thanks for bringing up this discussion. > > I'm very much in favor of splitting up the connectors into separate maven > modules. > The transitive dependen

Re: [DISCUSS] Break up streaming connectors into subprojects

2015-04-09 Thread Robert Metzger
Thanks for bringing up this discussion. I'm very much in favor of splitting up the connectors into separate maven modules. The transitive dependencies are a mess otherwise. Also, I would not put them to "flink-dist" (=lib folder) because we would have the dependency mess again. On Wed, Apr 8, 2

Re: [DISCUSS] Break up streaming connectors into subprojects

2015-04-08 Thread Márton Balassi
Overall I think this is a nice approach, but let us then also discuss where would we like to put these jars. Currently these jars are not in the lib folder of the Flink distribution, which mean that whenever a user would like to use them they have to package it with there usercode which is a bit in

Re: [DISCUSS] Break up streaming connectors into subprojects

2015-04-08 Thread Stephan Ewen
Exactly each streaming connector would be a separate jar: - stream-connector-kafka - stream-connector-rabbitmq - stream-connector-flume - ... On Tue, Apr 7, 2015 at 10:59 PM, Henry Saputra wrote: > Would this proposal also include packaging streaming connectors into > separate source an

Re: [DISCUSS] Break up streaming connectors into subprojects

2015-04-07 Thread Henry Saputra
Would this proposal also include packaging streaming connectors into separate source and binary jars? - Henry On Tue, Apr 7, 2015 at 12:21 PM, Stephan Ewen wrote: > What do you think about dividing the streaming connectors project into > various smaller projects, basically one per connector? > >

[DISCUSS] Break up streaming connectors into subprojects

2015-04-07 Thread Stephan Ewen
What do you think about dividing the streaming connectors project into various smaller projects, basically one per connector? I am personally always happy when projects offer me artifacts that contain what I need, and not a lot of other unnecessary dependencies as well Many people using the strea