My case is simple and easy to reproduce:
1. Create a flow with custom processor (e.g. abc.MyProcesser )
2. Make sure flow is working. Then stop the server.
3. Replace nar in lib with new nar after refactoring processor's package (
e.g., xzy.MyProcesser)
4. When you try to start nifi , it fails with error in the log saying class
not found ( obviously coz deployed flow is still looking for old class)
My expectation is system should at least start and only throw error when
user try to start a flow that that had reference to class(processor) which
is no more available in the newly deployed nar.
I can send the my error log tonight
On Wed, Oct 21, 2015, 5:58 PM Joe Witt <joe.w...@gmail.com> wrote:
> Sumanth,
>
> Do you happen to still have the stack traces around? Unless we do
> some breaking/API unfriendly thing such issues should simply not
> occur. Want to make sure we understand what is happening here.
>
> Thanks
> Joe
>
> On Wed, Oct 21, 2015 at 8:56 PM, Sumanth Chinthagunta <xmlk...@gmail.com>
> wrote:
> > I noticed similar error when I have my flow using older version of a
> custom
> > nar and when I deployed new version of nar with package refactoring.
> > My workaround to bring the server back is to redeploy old nar, start nifi
> > and delete the flow then recreate the flow after deploying refactored
> nar.
> > Nifi should start even a nar file is replaced or removed.
> >
> > On Wed, Oct 21, 2015, 9:21 AM Joe Witt <joe.w...@gmail.com> wrote:
> >
> >> Ok so in seeing this part of the stackdump we know there is a
> >> 'classpath thing' going on
> >>
> >> "Caused by: java.lang.ClassNotFoundException:
> >> org.mitre.nifi.NiFiNITFReader"
> >>
> >> And we see from your provided info that your jar does contain such a
> class
> >>
> >> "22243 Wed Oct 21 10:36:46 EDT 2015
> org/mitre/nifi/NiFiNITFReader.class"
> >>
> >> And we see that you have a service loader manifest
> >>
> >> "808 Wed Oct 21 10:36:42 EDT 2015
> >> META-INF/services/org.apache.nifi.processor.Processor"
> >>
> >> QUESTIONS:
> >> -------------------
> >> Can you please provide content of that service manifest file?
> >>
> >> Also can you please provide the log information that writes out on
> >> startup which shows the processors/extensions that load?
> >>
> >> It looks like this...
> >>
> >> 2015-10-21 09:20:32,520 INFO [main]
> >> org.apache.nifi.nar.ExtensionManager Extension Type Mapping to
> >> Classloader:
> >> === ProvenanceEventRepository type || Classloader ===
> >> org.apache.nifi.provenance.PersistentProvenanceRepository ||
> >>
> >>
> org.apache.nifi.nar.NarClassLoader[./work/nar/extensions/nifi-provenance-repository-nar-0.3.1-SNAPSHOT.nar-unpacked]
> >> org.apache.nifi.provenance.VolatileProvenanceRepository ||
> >>
> >>
> org.apache.nifi.nar.NarClassLoader[./work/nar/extensions/nifi-provenance-repository-nar-0.3.1-SNAPSHOT.nar-unpacked]
> >> === End ProvenanceEventRepository types ===
> >> === Processor type || Classloader ===
> >> org.apache.nifi.processors.hl7.RouteHL7 ||
> >>
> >>
> org.apache.nifi.nar.NarClassLoader[./work/nar/extensions/nifi-hl7-nar-0.3.1-SNAPSHOT.nar-unpacked]
> >> org.apache.nifi.processors.standard.MergeContent ||
> >>
> >>
> org.apache.nifi.nar.NarClassLoader[./work/nar/extensions/nifi-standard-nar-0.3.1-SNAPSHOT.nar-unpacked]
> >> org.apache.nifi.processors.standard.EncryptContent ||
> >>
> >>
> org.apache.nifi.nar.NarClassLoader[./work/nar/extensions/nifi-standard-nar-0.3.1-SNAPSHOT.nar-unpacked]
> >> org.apache.nifi.processors.aws.s3.PutS3Object ||
> >>
> >>
> org.apache.nifi.nar.NarClassLoader[./work/nar/extensions/nifi-aws-nar-0.3.1-SNAPSHOT.nar-unpacked]
> >> .....
> >>
> >>
> >> Thanks!
> >> Joe
> >>
> >> On Wed, Oct 21, 2015 at 8:51 AM, Jones, Patrick L. <p...@mitre.org>
> wrote:
> >> > Howdy,
> >> >
> >> > I have created my own processor which I have been
> testing
> >> with NiFi for a while now. This stuff used to work for me, now it
> doesn't.
> >> Today nifi won't start. The nifi-app.log is below
> >> > The processor reads in an image type NITF and does a few things with
> >> it. I do a:
> >> > $ mvn install
> >> >
> >> > from ~/nifi-0.3.0/nifi-mitre-bundle/ which is where my software is. I
> >> then
> >> > $ cp
> >>
> ~/nifi-0.3.0/nifi-mitre-bundle/nifi-mitre-nar/target/nifi-mitre-nar-1.0-SNAPSHOT.nar
> >> ../lib/
> >> >
> >> > When I start nifi the nifi-app.log shows the below exception with the
> >> bottom line being
> >> > Caused by: java.lang.ClassNotFoundException:
> >> org.mitre.nifi.NiFiNITFReader
> >> >
> >> > I looked in my lib/nifi-mitre-nar-1.0-SNAPSHOT.nar it contains
> >> > 0 Wed Oct 21 10:36:50 EDT 2015 META-INF/
> >> > 152 Wed Oct 21 10:36:48 EDT 2015 META-INF/MANIFEST.MF
> >> > 0 Wed Oct 21 10:36:48 EDT 2015 META-INF/bundled-dependencies/
> >> > ...
> >> > 22201 Wed Oct 21 10:36:48 EDT 2015
> >> META-INF/bundled-dependencies/nifi-mitre-processors-1.0-SNAPSHOT.jar
> >> > ...
> >> > 2963 Wed Oct 21 10:36:48 EDT 2015 META-INF/DEPENDENCIES
> >> > 11358 Wed Oct 21 10:36:48 EDT 2015 META-INF/LICENSE
> >> > 155 Wed Oct 21 10:36:48 EDT 2015 META-INF/NOTICE
> >> > 0 Wed Oct 21 10:36:50 EDT 2015 META-INF/maven/
> >> > 0 Wed Oct 21 10:36:50 EDT 2015 META-INF/maven/mitre/
> >> > 0 Wed Oct 21 10:36:50 EDT 2015
> META-INF/maven/mitre/nifi-mitre-nar/
> >> > 1562 Fri Oct 09 11:19:10 EDT 2015
> >> META-INF/maven/mitre/nifi-mitre-nar/pom.xml
> >> > 111 Wed Oct 21 10:36:48 EDT 2015
> >> META-INF/maven/mitre/nifi-mitre-nar/pom.properties
> >> >
> >> > I then unjarred the .nar file and looked at
> >> META-INF/bundled-dependencies/nifi-mitre-processors-1.0-SNAPSHOT.jar
> >> >
> >> > $ jar tvf
> >>
> ~/dum/META-INF/bundled-dependencies/nifi-mitre-processors-1.0-SNAPSHOT.jar
> >> > 0 Wed Oct 21 10:36:48 EDT 2015 META-INF/
> >> > 412 Wed Oct 21 10:36:46 EDT 2015 META-INF/MANIFEST.MF
> >> > 0 Wed Oct 21 10:36:42 EDT 2015 META-INF/services/
> >> > 0 Wed Oct 21 10:36:44 EDT 2015 org/
> >> > 0 Wed Oct 21 10:36:44 EDT 2015 org/mitre/
> >> > 0 Wed Oct 21 10:36:46 EDT 2015 org/mitre/nifi/
> >> > 2730 Wed Oct 21 10:36:42 EDT 2015 META-INF/DEPENDENCIES
> >> > 11358 Wed Oct 21 10:36:42 EDT 2015 META-INF/LICENSE
> >> > 162 Wed Oct 21 10:36:42 EDT 2015 META-INF/NOTICE
> >> > 808 Wed Oct 21 10:36:42 EDT 2015
> >> META-INF/services/org.apache.nifi.processor.Processor
> >> > 2796 Wed Oct 21 10:36:46 EDT 2015
> org/mitre/nifi/NiFiNITFReader$1.class
> >> > 2025 Wed Oct 21 10:36:44 EDT 2015
> org/mitre/nifi/NITFNiFiIoReader.class
> >> > 22243 Wed Oct 21 10:36:46 EDT 2015 org/mitre/nifi/NiFiNITFReader.class
> >> > 0 Wed Oct 21 10:36:48 EDT 2015 META-INF/maven/
> >> > 0 Wed Oct 21 10:36:48 EDT 2015 META-INF/maven/mitre/
> >> > 0 Wed Oct 21 10:36:48 EDT 2015
> >> META-INF/maven/mitre/nifi-mitre-processors/
> >> > 4053 Wed Oct 14 11:23:52 EDT 2015
> >> META-INF/maven/mitre/nifi-mitre-processors/pom.xml
> >> > 118 Wed Oct 21 10:36:48 EDT 2015
> >> META-INF/maven/mitre/nifi-mitre-processors/pom.properties
> >> >
> >> > I see org/mitre/nifi/NiFiNITFReader.class in the jar file.
> >> >
> >> > Any thoughts on what the problem is?
> >> >
> >> > Thank you
> >> >
> >> > Patrick Jones
> >> >
> >> >
> >> >
> >> > ------------- nifi-app.log ---
> >> > ...
> >> > 2015-10-21 10:44:44,147 INFO [main]
> >> o.a.n.w.c.ApplicationStartupContextListener Starting Flow Controller...
> >> > 2015-10-21 10:44:44,484 WARN [main]
> >> o.a.nifi.fingerprint.FingerprintFactory Unable to create Processor of
> type
> >> org.mitre.nifi.NiFiNITFReader due to
> >> org.apache.nifi.controller.exception.ProcessorInstantiationException:
> >> org.mitre.nifi.NiFiNITFReader; its default properties will be
> fingerprinted
> >> instead of being ignored.
> >> > 2015-10-21 10:44:44,536 WARN [main]
> >> o.a.nifi.fingerprint.FingerprintFactory Unable to create Processor of
> type
> >> org.mitre.nifi.NiFiNITFReader due to
> >> org.apache.nifi.controller.exception.ProcessorInstantiationException:
> >> org.mitre.nifi.NiFiNITFReader; its default properties will be
> fingerprinted
> >> instead of being ignored.
> >> > 2015-10-21 10:44:44,607 INFO [main]
> >> o.a.n.c.s.StandardControllerServiceProvider No Controller Services to
> enable
> >> > 2015-10-21 10:44:44,703 WARN [main]
> >> org.eclipse.jetty.webapp.WebAppContext Failed startup of context
> >> o.e.j.w.WebAppContext@59d5a6fd
> >>
> {/nifi-api,file:/home/plj/nifi-0.3.0/work/jetty/nifi-web-api-0.3.0.war/webapp/,STARTING}{./work/nar/framework/nifi-framework-nar-0.3.0.nar-unpacked/META-INF/bundled-dependencies/nifi-web-api-0.3.0.war}
> >> > org.apache.nifi.controller.FlowSynchronizationException:
> >> org.apache.nifi.controller.exception.ProcessorInstantiationException:
> >> org.mitre.nifi.NiFiNITFReader
> >> > at
> >>
> org.apache.nifi.controller.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:317)
> >> ~[nifi-framework-core-0.3.0.jar:0.3.0]
> >> > at
> >>
> org.apache.nifi.controller.FlowController.synchronize(FlowController.java:1160)
> >> ~[nifi-framework-core-0.3.0.jar:0.3.0]
> >> > ...
> >> > at org.apache.nifi.NiFi.main(NiFi.java:227)
> >> [nifi-runtime-0.3.0.jar:0.3.0]
> >> > Caused by:
> >> org.apache.nifi.controller.exception.ProcessorInstantiationException:
> >> org.mitre.nifi.NiFiNITFReader
> >> > at
> >>
> org.apache.nifi.controller.FlowController.instantiateProcessor(FlowController.java:864)
> >> ~[nifi-framework-core-0.3.0.jar:0.3.0]
> >> > ...
> >> > ... 27 common frames omitted
> >> > Caused by: java.lang.ClassNotFoundException:
> >> org.mitre.nifi.NiFiNITFReader
> >> > at
> >> java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> ~[na:1.8.0_60]
> >> > ...
> >> > at
> >>
> org.apache.nifi.controller.FlowController.instantiateProcessor(FlowController.java:850)
> >> ~[nifi-framework-core-0.3.0.jar:0.3.0]
> >> > ... 30 common frames omitted
> >> > 2015-10-21 10:44:45,345 INFO [main]
> >> o.e.jetty.server.handler.ContextHandler Started
> >> o.e.j.w.WebAppContext@5fd8dd66
> >> {/nifi-content-viewer,file:/home/plj/nifi-...
> >> > 2015-10-21 10:44:45,631 INFO [main] org.eclipse.jetty.server.Server
> >> Started @33273ms
> >> > 2015-10-21 10:44:45,644 WARN [main]
> >> org.apache.nifi.web.server.JettyServer Failed to start web server...
> >> shutting down.
> >> > org.apache.nifi.controller.FlowSynchronizationException:
> >> org.apache.nifi.controller.exception.ProcessorInstantiationException:
> >> org.mitre.nifi.NiFiNITFReader
> >> > at
> >>
> org.apache.nifi.controller.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:317)
> >> ~[nifi-framework-core-0.3.0.jar:0.3.0]
> >> > ...
> >> > at org.apache.nifi.NiFi.<init>(NiFi.java:137)
> >> [nifi-runtime-0.3.0.jar:0.3.0]
> >> > at org.apache.nifi.NiFi.main(NiFi.java:227)
> >> [nifi-runtime-0.3.0.jar:0.3.0]
> >> > Caused by:
> >> org.apache.nifi.controller.exception.ProcessorInstantiationException:
> >> org.mitre.nifi.NiFiNITFReader
> >> > at
> >>
> org.apache.nifi.controller.FlowController.instantiateProcessor(FlowController.java:864)
> >> ~[nifi-framework-core-0.3.0.jar:0.3.0]
> >> > ...
> >> > at
> >>
> org.apache.nifi.controller.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:271)
> >> ~[nifi-framework-core-0.3.0.jar:0.3.0]
> >> > ... 27 common frames omitted
> >> > Caused by: java.lang.ClassNotFoundException:
> >> org.mitre.nifi.NiFiNITFReader
> >> > at
> >> java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> ~[na:1.8.0_60]
> >> > at
> java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> >> ~[na:1.8.0_60]
> >> > at
> java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> >> ~[na:1.8.0_60]
> >> > at java.lang.Class.forName0(Native Method)
> ~[na:1.8.0_60]
> >> > at java.lang.Class.forName(Class.java:264)
> ~[na:1.8.0_60]
> >> > at
> >>
> org.apache.nifi.controller.FlowController.instantiateProcessor(FlowController.java:850)
> >> ~[nifi-framework-core-0.3.0.jar:0.3.0]
> >> > ... 30 common frames omitted
> >> > 2015-10-21 10:44:45,650 INFO [Thread-1] org.apache.nifi.NiFi
> Initiating
> >> shutdown of Jetty web server...
> >>
>
