@Eron Yes, that would be the difference in characterisation. I think technically all sources could be transformed by that by pushing data into a (blocking) queue and having the "getElement()" method pull from that.
> On 15. Sep 2017, at 20:17, Elias Levy <fearsome.lucid...@gmail.com> wrote: > > On Fri, Sep 15, 2017 at 10:02 AM, Eron Wright <eronwri...@gmail.com > <mailto:eronwri...@gmail.com>> wrote: > Aljoscha, would it be correct to characterize your idea as a 'pull' source > rather than the current 'push'? It would be interesting to look at the > existing connectors to see how hard it would be to reverse their orientation. > e.g. the source might require a buffer pool. > > The Kafka client works that way. As does the QueueingConsumer used by the > RabbitMQ source. The Kinesis and NiFi sources also seems to poll. Those are > all the bundled sources.
