Re: Processing JSON Files Embedded with Base64 Encoded Files

Hello Chris, Depending on the structure of your Json file, you may be able to achieve what you need using processors such as JoltTransformJSON

Re: Analytic Framework Metrics / Logging

Hello Aliesha, Thank you for reaching out! What specific analytics settings did you change in nifi.properties? For example by default the *nifi.analytics.predict.enabled* property is set to false. Enabling that to be true by itself should turn on predictions (after a restart of nifi). Also if yo

Re: In memoriam of Jeff Storck

I echo everyone in saying I am heartbroken over the loss of Jeff. I'm so happy to have known him. We had lots of conversations around all things code, food and one of our favorite TV shows "Atlanta". At times if anyone were listening in they'd hear us go from having a fierce (but friendly) debate

Re: [VOTE] Release Apache NiFi 1.11.0 (rc3)

+1 (binding) Ran through release guide, confirming signatures and hashes. Built with Java 11 and ran on Mac Os. Created simple flows on a single node instance and confirmed some of the latest additions around rules with no issues encountered. On Wed, Jan 22, 2020 at 9:59 AM Tony Kurc wrote: >

Re: Rules engine documentation?

Hi Mike, In the 1.10 release the EasyRules Controller service has documentation related to how rules can be defined and how the service can be configured. Also I am working on a blog post detailing the Rules API in general and how it can be leveraged using InvokeScriptedProcessor. Hopefully this

Re: [VOTE] Release Apache NiFi 1.10.0 (rc3)

+1 (binding) Ran through release helper and verified on secure cluster with samples flows and recent contributions for analytics. All looks good. 3rd times a charm :). Thanks Joe for RMing this release! On Fri, Nov 1, 2019 at 12:22 PM Scott Aslan wrote: > +1 (binding) > > Verified signatures,

Re: [ANNOUNCE] New Apache NiFi Committer Rob Fellows

Congratulations Rob! > On Sep 25, 2019, at 10:09 AM, Marc Parisi wrote: > > Congrats Rob! > >> On Wed, Sep 25, 2019 at 9:59 AM Rob Moran wrote: >> >> Thanks for all your work, Rob -- congrats! >> >> On Wed, Sep 25, 2019 at 9:29 AM Andrew Lim >> wrote: >> >>> Congrats Rob! >>> >>> O

Re: [VOTE] Create NiFi Standard Libraries sub-project

+1 Create NiFi Standard Libraries (binding) On Tue, Sep 3, 2019 at 7:03 PM Koji Kawamura wrote: > +1 Create NiFi Standard Libraries (binding) > > On Wed, Sep 4, 2019 at 7:25 AM Mike Thomsen > wrote: > > > > +1 binding > > > > On Tue, Sep 3, 2019 at 5:33 PM Andy LoPresto > wrote: > > > > > +1,

Re: Re:[EXT] [DISCUSS] Predictive Analytics for NiFi Metrics

t that time, effectively indicating no overflow > > concerns. > > > > > > > > [cid:image003.png@01D55697.965C27D0] > > > > > > > > A similar display for flowfile count is displayed as well. > > > > > > > > The current

Re:[EXT] [DISCUSS] Predictive Analytics for NiFi Metrics

ng > but > > > > > > that > > > > > > > > > > also just as easily a remote implementation where the engine > lives and > > > > > > is > > > > > > > > > > managed externally could also

Re: [DISCUSS] Predictive Analytics for NiFi Metrics

could also be supported. > >>> > >>> Thanks > >>> > >>> > >>> On Tue, Jul 30, 2019 at 1:40 PM Andy LoPresto > >> wrote: > >>> > >>>> Yolanda, > >>>> > >>>> I think this sounds

[DISCUSS] Predictive Analytics for NiFi Metrics

Hello Everyone, I wanted to reach out to the community to discuss potentially enhancing NiFi to include predictive analytics that can help users assess and predict NiFi behavior and performance. Currently NiFi has lots of metrics available for areas including jvm and flow component usage (via comp

Re: [ANNOUNCE] New NiFi PMC member Kevin Doran

Congratulations Kevin! On Wed, Aug 1, 2018 at 7:23 AM, Rob Moran wrote: > Congratulations, Kevin! > > On Tue, Jul 31, 2018 at 1:16 PM Sivaprasanna > wrote: > > > Congratulations, Kevin. > > > > On Tue, 31 Jul 2018 at 9:43 PM, Scott Aslan > wrote: > > > > > Congrats Kevin! > > > > > > On Tue, J

Re: [ANNOUNCE] New NiFi PMC member Jeremy Dyer

Congratulations Jeremy! On Wed, Aug 1, 2018 at 7:23 AM, Rob Moran wrote: > Congratulations, Jeremy! > > On Tue, Jul 31, 2018 at 1:17 PM Sivaprasanna > wrote: > > > Congratulations, Jeremy. Well deserved. > > > > On Tue, 31 Jul 2018 at 9:44 PM, Scott Aslan > wrote: > > > > > Congrats Jeremy! >

Re: [VOTE] Establish Fluid Design System, a sub-project of Apache NiFi

+1 On Fri, Mar 9, 2018 at 3:22 PM, Pierre Villard wrote: > +1 > > Le ven. 9 mars 2018 à 21:16, Bryan Bende a écrit : > > > +1 > > > > On Fri, Mar 9, 2018 at 3:11 PM, Joe Witt wrote: > > > +1 > > > > > > On Mar 9, 2018 3:10 PM, "Scott Aslan" wrote: > > > > > > All, > > > > > > Following a soli

Re: [VOTE] Release Apache NiFi Registry 0.1.0

+1, binding Have been looking forward to this contribution; it is a great addition to the community! Following the release helper I verified signatures, hashes as well as the README, NOTICE, and LICENSE. Successfully built the project per instructions and built the NiFi project using the referen

Re: [ANNOUNCE] New NiFi PMC member Marc Parisi

Congratulations Marc! On Fri, Dec 15, 2017 at 6:52 AM, Rob Moran wrote: > Congratulations, Marc! > > On Fri, Dec 15, 2017 at 4:31 AM Pierre Villard < > pierre.villard...@gmail.com> > wrote: > > > Congrats Marc!! > > > > 2017-12-15 6:38 GMT+01:00 Jeff : > > > > > Congrats, Marc! Treat yourself t

Re: [ANNOUNCE] New NiFi PMC member Jeff Storck

Congrats Jeff! On Wed, Dec 6, 2017 at 5:12 PM, Jeff wrote: > Thanks, all! It's great to be a part of this amazing community. > > On Tue, Dec 5, 2017 at 12:27 PM Matt Burgess wrote: > > > Congrats Jeff! Welcome aboard! > > > > On Tue, Dec 5, 2017 at 11:49 AM, Tony Kurc wrote: > > > NiFi commu

Re: [ANNOUNCE] New NiFi PMC member Scott Aslan

Congrats Scott!! Sent from my iPhone > On Dec 2, 2017, at 8:43 PM, Marc wrote: > > Congrats Scott! > >> On Dec 2, 2017 8:14 PM, "Kevin Doran" wrote: >> >> Congrats, Scott! Keep crushing it! >> >> Get Outlook for iOS >> >> From: Joe Wit

Re: SSL and Zookeeper

Hi Mark, Just adding to what Andy said below. Currently there is support for Kerberos/SASL authentication with Zookeeper. The admin guide provides details on that configuration and setup for embedded zookeeper and links for guidance on external Zookeeper installations. https://nifi.apache.org/do

Re: [DRAFT][REPORT] Apache NiFi Board Report Oct 2017

LGTM as well with suggested update. -yolanda On Mon, Oct 9, 2017 at 11:03 AM, Rob Moran wrote: > Joe, looks good with the couple changes Drew mentioned--thanks. > > On Mon, Oct 9, 2017 at 10:30 AM Andrew Lim > wrote: > > > Noticed the following: > > > > -In Health Report section: "seeing a ver

Re: [DRAFT][REPORT] Apache NiFi - July 2017

> > > > > processors > > > > > > >to easily handle cases like acquisition, SQL based routing, > > > > > > enrichment, > > > > > > >conversion, and delivery of record oriented data. These > make > > > man

Re: File Filter regular expression - GetFile

Hello Shankha, Give the below a try: ab\.[\w]* That should match any files that start with "ab." (with any word character in the extension). Please let me know if that works for you. Best Regards, Yolanda On Wed, Jun 28, 2017 at 5:55 AM, shankhamajumdar < shankha.majum...@lexmark.com> wrote

Re: [VOTE] Release Apache NiFi 0.7.4

+1 (binding) -Ran through release helper -Full build with contrib check on OSX -Ran simple flow, worked as expected On Tue, Jun 6, 2017 at 1:59 PM, Scott Aslan wrote: > +1 (non-binding) > > - Verified signatures, checksums, LICENSE, NOTICE, and README > - Built using a full clean build with con

Re: [VOTE] Release Apache NiFi 1.3.0

+1 (binding) -ran through release helper, verified hashes, signatures, checked README, LICENSE, NOTICE -ran build and tested with flows using QueryRecord (RecordReaders/Writers etc), worked as expected. On Tue, Jun 6, 2017 at 12:44 PM, Joe Skora wrote: > +1 (binding) > > * Verified GPG signatur

Re: [ANNOUNCE] New Apache NiFi Committer Marc Parisi

Congrats Marc! On Thu, Jun 1, 2017 at 9:36 AM, Bryan Rosander wrote: > Congrats Marc! Thanks for all the C++ help so far :) > > On Thu, Jun 1, 2017 at 8:48 AM, Scott Aslan wrote: > > > Congrats Marc! > > > > On Thu, Jun 1, 2017 at 8:39 AM, Marc wrote: > > > > > Thank you, everyone! Amazing to

Re: [ANNOUNCE] New Apache NiFi Committer Drew Lim

Congratulations Drew! > On May 31, 2017, at 4:20 PM, Bryan Rosander wrote: > > Congrats Drew! > > On Wed, May 31, 2017 at 3:51 PM, Andrew Psaltis > wrote: > >> Congrats Drew! I spend a lot of time teaching people about NiFi and can >> honestly say the documentation -- built-in and on the wi

Re: [ANNOUNCE] New Apache NiFi PMC Member - Koji Kawamura

Congratulations Koji! Sent from my iPhone > On May 26, 2017, at 10:58 PM, Andy LoPresto wrote: > > Congratulations Koji. For anyone not familiar with some of his greatest hits, > it’s not just the (impressive) code contributions like the Wait & Notify > processors and massive Site-to-site ref

Re: [ANNOUNCE] New Apache NiFi PMC Member - Pierre Villard

Congrats Pierre! On Mon, May 22, 2017 at 3:17 PM, Tony Kurc wrote: > On behalf of the Apache NiFi PMC, I am pleased to announce that Pierre > Villard has accepted the PMC's invitation to join the Apache NiFi PMC. We > greatly appreciate all of Pierre's hard work and generous contributions to >

Re: [ANNOUNCE] New Apache NiFi PMC Member - Yolanda Davis

d thank you Yolanda! > > > > On Wed, May 17, 2017 at 10:11 PM, Tony Kurc wrote: > > > > On behalf of the Apache NiFi PMC, I am pleased to announce that Yolanda > > Davis has accepted the PMC's invitation to join the Apache NiFi PMC. We > > greatly

Re: [VOTE] Release Apache NiFi MiNiFi 0.2.0

+1 (non-binding) Verified signatures and hashes Reviewed README, NOTICE, LICENSE Ran Build with contrib-check Converted and ran simple flow, no issues On Mon, May 15, 2017 at 12:55 PM, Aldrin Piri wrote: > Hello, > > I am pleased to be calling this vote for the source release of Apache NiFi > M

Re: [VOTE] Release Apache NiFi 1.2.0 (RC2)

+1 (non-binding) Verified signatures, hashes, LICENSE, NOTICE, and README Built successfully on OSX (version 10.12.4) Ran test flows and admin toolkit operations (sent notification & ran node status, disconnect, connect, remove ) On Sun, May 7, 2017 at 11:28 AM, Scott Aslan wrote: > +1 (non-bi

Re: Making NiFi upgrade smoother

Hi Andre, Realized I responded on the wrong thread... Just wanted to add my thoughts on this. One of the things I have been thinking and working through in creating utilities to automate upgrades (see https://issues.apache.org/jira/browse/NIFI-3663) is creating the ability to migrate to new conf

Re: Making NiFi upgrade smoother

Hi Andre, Just wanted to add my thoughts on this. One of the things I have been thinking and working through in creating utilities to automate upgrades (see https://issues.apache.org/jira/browse/NIFI-3663) is creating the ability to migrate to new configurations/settings, especially in the instan

Re: [ANNOUNCE] New Apache NiFi PMC Member - Oleg Zhurakousky

Congratulations Oleg! On Tue, Apr 4, 2017 at 3:51 PM, Tony Kurc wrote: > Apache NiFi Community, > > On behalf of the Apache NiFi PMC, I am pleased to announce that Oleg > Zhurakousky has accepted the PMC's invitation to join the Apache NiFi PMC. > We greatly appreciate all of Oleg’s hard work an

Re: [ANNOUNCE] New Apache NiFi Committer Bin Qiu

Congrats Bin! On Tue, Apr 4, 2017 at 4:17 PM, Tony Kurc wrote: > Apache NiFi community, > > > On behalf of the Apache NiFI PMC, I am very pleased to announce that Bin > Qiu has accepted the PMC's invitation to become a committer on the Apache > NiFi project. We greatly appreciate all of Bin’s ha

Re: [ANNOUNCE] New Apache NiFi Committer Jeff Storck

Congratulations Jeff! On Tue, Feb 21, 2017 at 2:41 PM, Aldrin Piri wrote: > On behalf of the Apache NiFI PMC, I am very pleased to announce that Jeff > Storck has accepted the PMC's invitation to become a committer on the > Apache NiFi project. We greatly appreciate all of Jeff's hard work and >

Re: [VOTE] Release Apache NiFi 0.7.2

+1 (non-binding) Confirmed hashes and signatures, ran build and executed a simple flow On Thu, Feb 16, 2017 at 11:42 PM, Andy LoPresto wrote: > Hello, > > I am pleased to be calling this vote for the source release of Apache NiFi > nifi-0.7.2. > > The source zip, including signatures, digests,

Re: [VOTE] Release Apache NiFi 1.1.2

+1 (non-binding) Confirmed hashes and signatures, ran full build and executed a simple flow. all looked good. On Thu, Feb 16, 2017 at 10:37 PM, Andy LoPresto wrote: > Hello, > > I am pleased to be calling this vote for the source release of Apache NiFi > nifi-1.1.2. > > The source zip, includin

Re: [VOTE] Establish Registry, a sub-project of Apache NiFi

+1 (non-binding) On Fri, Feb 10, 2017 at 11:40 AM, Bryan Bende wrote: > All, > > Following a solid discussion for the past few days [1] regarding the > establishment of Registry as a sub-project of Apache NiFi, I'd like to > call a formal vote to record this important community decision and > es

Re: [ANNOUNCE] New Apache NiFi PMC Member - Joe Skora

Congratulations Joe! On Thu, Dec 29, 2016 at 1:02 PM, Aldrin Piri wrote: > All, > > On behalf of the Apache NiFi PMC, I am pleased to announce that Joe Skora has > accepted the PMC's invitation to join the Apache NiFi PMC. Joe has been > with NiFi for quite some time, even before its arrival in

Re: [VOTE] Release Apache NiFi 1.1.1 (RC1)

+1 (non-binding) Verified signatures, hashes, README, NOTICE and LICENSE. Built and ran on OS X (java 1.8 build 111). -yolanda On Mon, Dec 19, 2016 at 5:35 PM, Joe Percivall < joeperciv...@yahoo.com.invalid> wrote: > Hello Apache NiFi Community, > > I am pleased to be calling this vote for the

Re: [ANNOUNCE] New Apache NiFi Committer Jeremy Dyer

Congratulations Jeremy! On Mon, Dec 19, 2016 at 8:23 PM, Aldrin Piri wrote: > On behalf of the Apache NiFI PMC, I am very pleased to announce that Jeremy > Dyer has accepted the PMC's invitation to become a committer on the > Apache NiFi project. We greatly appreciate all of Jeremy's hard work a

Re: [VOTE] Release Apache NiFi 1.0.1 (RC1)

+1 (non-binding) Ran through release helper guide, verified signatures and hashes, then built and ran simple flow on OS X (java 1.8 build 111). -yolanda On Fri, Dec 16, 2016 at 10:18 AM, Joe Percivall < joeperciv...@yahoo.com.invalid> wrote: > Hello Apache NiFi Community, > I am pleased to be c

Re: [VOTE] Release Apache NiFi 1.1.0 (RC2)

+1 (non-binding) Verified signatures, checksums, LICENSE and NOTICE Build was successful on OS X (JDK 1.8.0_111-b14) Tested basic flows in standalone and three node cluster (using GetTwitter, JoltTransformJson, PutMongo) Tested upgrade use case of moving from 1.0.0 to 1.1.0 (See Andre's email f

Re: [VOTE] Release Apache NiFi 1.1.0 (RC2)

Aldrin, I saw the same exception on that test on OS X but it resolved when I upgraded my version of java (upgraded to 1.8.0_111-b14) On Sun, Nov 27, 2016 at 5:13 PM, Aldrin Piri wrote: > +1, binding > > Hashes and signatures looked good. > Contrib passed > Builds and functionality were okay on

Re: [VOTE] Release Apache NiFi 1.1.0 (RC1)

Andre, I attempted to reproduce your test case with a three node cluster (unsecured in my case since I figured it may not be relevant). Upon initial startup of nodes in 1.1.0, using the linked 1.0.0 conf directory, each node was disconnected from the cluster until the vote determined which flow wa

Re: nifi configuration file for process group

Thu, Nov 17, 2016 at 10:42 AM, Yolanda Davis wrote: > Hello Bala, > > If you are using a processor that supports expression language for the IP > address property you can configure NiFi to use a variable within a custom > property file that you define. Once that is set you c

Re: nifi configuration file for process group

Hello Bala, If you are using a processor that supports expression language for the IP address property you can configure NiFi to use a variable within a custom property file that you define. Once that is set you can refer to the custom variable in the IP field instead of the raw IP value. For mo

Re: [ANNOUNCE] New Apache NiFi Committer Scott Aslan

Congrats Scott!! Sent from my iPhone > On Nov 4, 2016, at 11:25 AM, Tony Kurc wrote: > > On behalf of the Apache NiFI PMC, I am very pleased to announce that Scott > Aslan has accepted the PMC's invitation to become a committer on the Apache > NiFi project. We greatly appreciate all of Scott's

Re: [ANNOUNCE] New Apache NiFi Committer Bryan Rosander

Congrats Bryan! On Wed, Oct 26, 2016 at 1:15 PM, Joe Witt wrote: > On behalf of the Apache NiFI PMC, I am very pleased to announce that > Bryan Rosander has accepted the PMC's invitation to become a committer > on the Apache NiFi project. We greatly appreciate all of Andre's hard > work and gene

Re: [ANNOUNCE] New Apache NiFi PMC Member - Matt Burgess

Congratulations Matt B.!! On Fri, Oct 7, 2016 at 10:28 AM, Tony Kurc wrote: > On behalf of the Apache NiFI PMC, I am very pleased to announce that Matt > Burgess has accepted the PMC's invitation to join the Apache NiFi PMC. We > greatly appreciate all of Matt's hard work and generous contributi

Re: [ANNOUNCE] New Apache NiFi Committer Rob Moran

Congratulations Rob! On Mon, Sep 19, 2016 at 3:36 PM, Rob Moran wrote: > Thanks everyone! I look forward to continuing the great progress we've > made, and trying to make us look a little better while we do it ;) > > Rob > > On Mon, Sep 19, 2016 at 3:08 PM, Tony Kurc wrote: > > > On behalf of t

Re: [VOTE] Release Apache NiFi 1.0.0 (RC1)

Resending on appropriate thread: +1 (non-binding) Ran full test suite, with rat and contrib-check. Verified, readme, notice, license, commit ID, hashes and checksums. Tested flows and templates in standalone cluster (on Mac OS). On Fri, Aug 26, 2016 at 12:25 PM, Joe Percivall < joeperciv...@yah

Re: Apache NiFi 1.0.0 RC1 Release Helper Guide

+1 (non-binding) Ran full test suite, with rat and contrib-check. Verified, readme, notice, license, commit ID, hashes and checksums. Tested flows and templates in standalone cluster (on Mac OS). On Fri, Aug 26, 2016 at 12:26 PM, Joe Percivall < joeperciv...@yahoo.com.invalid> wrote: > Hello Ap

Re: [ANNOUNCE] New Apache NiFi Committer Andre Fucs de Miranda

Congratulations Andre! Sent from my iPhone > On Aug 6, 2016, at 10:40 PM, Tony Kurc wrote: > > On behalf of the Apache NiFI PMC, I am very pleased to announce that Andre > Fucs de Miranda has accepted the PMC's invitation to become a committer on > the Apache NiFi project. We greatly appreciate

Re: [DISCUSS] MiNiFi C++ Initial Release - cpp-0.0.1

+1 ! On Thu, Aug 4, 2016 at 11:42 PM, Aldrin Piri wrote: > Hey folks, > > There's been great efforts to get an initial working implementation of > MiNiFi in C++. This currently provides a great start on the core > functionalities that the Java equivalent provides. Perhaps the neatest of > all

Re: [DISCUSS] 1.0 Beta Release

+1 On Wed, Aug 3, 2016 at 11:01 AM, Jeff wrote: > +1 > > On Tue, Aug 2, 2016 at 9:17 AM Joe Skora wrote: > > > +1 > > > > On Mon, Aug 1, 2016 at 10:49 PM, Tony Kurc wrote: > > > > > seems reasonable to me > > > > > > On Mon, Aug 1, 2016 at 10:14 PM, Joe Percivall < > > > joeperciv...@yahoo.com

Re: [ANNOUNCE] New Apache NiFi Committer Yolanda Davis

and thanks Yolanda! > > On Jul 30, 2016 8:16 AM, "Tony Kurc" wrote: > > > On behalf of the Apache NiFI PMC, I am very pleased to announce that > > Yolanda Davis has accepted the PMC's invitation to become a committer on > > the Apache NiFi project. We greatly

Re: [ANNOUNCE] New Apache NiFi PMC Member - Andy LoPresto

Congrats Andy! On Thu, Jul 7, 2016 at 5:22 PM, Joe Skora wrote: > Congrats! > > On Thu, Jul 7, 2016 at 5:15 PM, Oleg Zhurakousky < > ozhurakou...@hortonworks.com> wrote: > > > Way to go Andy! Well deserved! > > > > Cheers > > Oleg > > > On Jul 7, 2016, at 5:09 PM, Matt Burgess wrote: > > > > >

Re: 0.7.0 install bug centos 7

For those running this problem I've submitted a pull request for a potential fix: https://github.com/apache/nifi/pull/553/ One thing to note is with this fix I could not recreate the second issue where the nifi service did not start on reboot of the machine. In the PR I've added snapshots of my t