Corentin You indeed received a response but you are not subscribed to the mailing list so you didnt see it. Please subscribe to the list if you want to see replies.
As a courtesy I will forward the response to you. As for any downstream vendor adoption of changes we cant speak to that. Thanks Joe On Sun, Jan 19, 2025 at 7:38 AM Corentin Régent <corentin.reg...@gmail.com> wrote: > Hello NiFi team, > > I'm writing you back regarding these subjects of contributions and > releases, as I got no answer yet. > > Would you be interested in me contributing to the discussed features for > NiFI? And how long could it take before an eventual release in NiFi and > Cloudera Data Flow? Also, can both NiFi 1 and NiFi 2 be targeted? > > Thanks, > > Le lun. 13 janv. 2025 à 16:14, Corentin Régent <corentin.reg...@gmail.com> > a écrit : > > > Hello NiFi team, > > > > I am trying to monitor NiFi data ingestions from Kafka to HDFS, by > tracing > > the offsets of the messages to make sure none is lost. The idea I have > > would be to aggregate Kafka provenance attributes as the messages are > > merged into a single file, then atomically save them as HDFS extended > > attributes when writing the output file. > > > > So I *may* (if I find enough time and if it is worth the effort) wish to > > contribute and: > > - Implement a new attribute strategy for the MergeContent processor, that > > would allow the user to merge the attributes of the flowfiles. I only > need > > a "join-like" operation so I probably won't be creating a fully-fledged > > aggregation expression language though. > > - Add the ability to write extended file attributes in the PutHDFS file > > (based on flowfile attributes). I saw that ticket NIFI-10524 > > <https://issues.apache.org/jira/browse/NIFI-10524> discusses this > subject > > a little, though does not really address it. > > > > I am unfamiliar with NiFi / Apache development processes. First of all, > > would you be interested in me implementing such features? (I make no > > promises though) > > > > And, at my company we are using NiFi 1.x through Cloudera Data Flow. So, > I > > was wondering whether you were still adding new features in NiFi 1.x? I > > assume this would imply making one PR for NiFi 1, and one PR for NiFi 2, > > for each feature? And, how long (approximately) could I expect to be > > waiting for a new NiFi release after the (potential) merge? Also, if you > > are still closely related with Cloudera, how long can it take to support > a > > new NiFi version in CDF? > > > > Thank you for your work and support, > > > > Corentin Régent > > >
