Craig Patrick created NIFI-15074:
------------------------------------
Summary: New parameters saved in processors do not get added to
the context when being deployed via Registry
Key: NIFI-15074
URL: https://issues.apache.org/jira/browse/NIFI-15074
Project: Apache NiFi
Issue Type: Bug
Components: Flow Versioning
Affects Versions: 2.0.0
Environment: All
Reporter: Craig Patrick
Attachments: image-2025-10-08-12-21-06-505.png
When adding a new parameter and referencing it in a processor which is
committed to Registry, updating this processor in a different environment does
not update the relevant parameter context.
*Example Case:*
* I have multiple parameter contexts which inherit each other, for example:
** api-params
** global-params (which inherits the api-params)
** processor-params (which inherits the global-params)
* I have created a processor (InvokeHTTP) and I have added 2 parameters to the
api-params for 'base-url' and 'token'
* Updated InvokeHTTP processor to use these new parameters
* Committed to Registry the changes for these parameters (along with others)
* Changed the versions of the integration on another system to this new one
*Expected Outcome:*
* processor group would update and use these new parameter references in the
api-params context.
*Actual Outcome:*
* Processor fails to start stating:
** 'Authorization' is invalid because Property references Parameter
'api.navsync.token' but the currently selected Parameter Context does not have
a Parameter with that name
** 'HTTP URL' is invalid because Property references Parameter
'api.navsync.baseurl' but the currently selected Parameter Context does not
have a Parameter with that name
* I have to add the newly created params into the api-params file and then
everything works as expected (so I would assume inheritance is working as it
should - but the param is simply not being written into the api-params context)
*Checks:*
* All relevant parameter contexts inherit as they should in configuration
* Every processor has the correct `processor-params` context associated with it
* The commit from the initial update in GIT shows the parameters being written
and updated (see below):
!image-2025-10-08-12-21-06-505.png!
I have checked the logs and can't see any errors with regards to the update of
the processor version, not can I see anything regarding the changing of the
parameters in the Process Group update Thread:
{code:java}
2025-10-08 12:57:55,172 INFO [Process Group Update Thread-1]
o.apache.nifi.web.api.FlowUpdateResource Disabling 0 Controller Services
2025-10-08 12:57:55,192 INFO [Process Group Update Thread-1]
o.apache.nifi.web.api.VersionsResource Updating Process Group with ID
cb9edf99-0198-1000-594b-907159df9bd4 to version 15 of the Versioned Flow
2025-10-08 12:57:55,199 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Updating
StandardProcessGroup[identifier=cb9edf99-0198-1000-594b-907159df9bd4,name=Dynamics
to ERP Integration] to org.apache.nifi.flow.VersionedExternalFlow@78cc7999;
there are 21 differences to take into account:
Property 'JSLT Transformation' for Processor with ID
469e39a4-e27a-3375-1d6d-8d740a85c63f is different
Processor with ID dcc016c1-10ad-1199-9036-053e04a0f4ce exists in Proposed Flow
but not in Currently Loaded Flow
Connection Bend Points Changed for Connection with ID
4fd5ecef-a0dc-37bd-fe44-a3ab9221f154; flow 'Currently Loaded Flow' has value
[]; flow 'Proposed Flow' has value [[x=256.0, y=-632.0], [x=536.0, y=-632.0]]
Property 'HTTP Method' for Processor with ID
307ccb7c-7474-3597-6f91-fa30baaad706 is different
Processor with ID aa8d1f21-10b1-1199-2b2e-3fe49bde9192 exists in Proposed Flow
but not in Currently Loaded Flow
Connection with ID aa8d1f25-10b1-1199-f724-1e22078310a6 exists in Proposed Flow
but not in Currently Loaded Flow
Processor with ID aa8d1f23-10b1-1199-34ae-c87db0d78abb exists in Proposed Flow
but not in Currently Loaded Flow
Property 'HTTP URL' for Processor with ID 307ccb7c-7474-3597-6f91-fa30baaad706
is different
Property 'Transform Result Filter' for Processor with ID
469e39a4-e27a-3375-1d6d-8d740a85c63f is different
Position Changed for Input Port with ID 834e1eac-bd2f-36a1-1709-e76538ac6622;
flow 'Currently Loaded Flow' has value [x=-848.0, y=-872.0]; flow 'Proposed
Flow' has value [x=-848.0, y=-1112.0]
Position Changed for Input Port with ID 5e0b22c9-4b7e-393e-97dc-09b249cb2a99;
flow 'Currently Loaded Flow' has value [x=-296.0, y=-360.0]; flow 'Proposed
Flow' has value [x=-304.0, y=-360.0]
Processor with ID dcc016c0-10ad-1199-db08-7007c43d82d4 exists in Proposed Flow
but not in Currently Loaded Flow
Connection with ID aa8d1f24-10b1-1199-8e07-bc165a4b688e exists in Proposed Flow
but not in Currently Loaded Flow
Connection with ID aa8d1f29-10b1-1199-5d0a-a14360dd24d6 exists in Proposed Flow
but not in Currently Loaded Flow
Position Changed for Output Port with ID 110c4819-4fb7-31de-69bb-18a07e4c0457;
flow 'Currently Loaded Flow' has value [x=-200.0, y=-456.0]; flow 'Proposed
Flow' has value [x=416.0, y=-800.0]
Property 'Authorization' for Processor with ID
307ccb7c-7474-3597-6f91-fa30baaad706 is different
Connection with ID aa8d1f28-10b1-1199-aa25-614de558a85f exists in Proposed Flow
but not in Currently Loaded Flow
Connection Destination Changed for Connection with ID
6f0a5e09-a40c-3d05-bf3f-9c7375aae15e; flow 'Currently Loaded Flow' has value
ConnectableComponent{id='022624b6-dea3-3b8b-9270-aa13b2a8c3dc',
instanceId='null', type=PROCESSOR,
groupId='6ec6eef7-f41b-3ac7-bb89-1ba8437ce9ce', name='Format JSON for Legacy'};
flow 'Proposed Flow' has value
ConnectableComponent{id='f64aad8d-e7a7-3a66-b676-cc6210945de5',
instanceId='dcc016c0-10ad-1199-db08-7007c43d82d4', type=PROCESSOR,
groupId='6ec6eef7-f41b-3ac7-bb89-1ba8437ce9ce', name='Extract Incoming Process
ID'}
Component Name Changed for Processor with ID
307ccb7c-7474-3597-6f91-fa30baaad706; flow 'Currently Loaded Flow' has value
Send Request to EDM API; flow 'Proposed Flow' has value Send Request to NavSync
Connection with ID aa8d1f26-10b1-1199-4f9f-a5dc6858f029 exists in Proposed Flow
but not in Currently Loaded Flow
Connection with ID aa8d1f27-10b1-1199-0eb7-1d1fa48fc954 exists in Proposed Flow
but not in Currently Loaded Flow
2025-10-08 12:57:55,205 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
StandardProcessGroup[identifier=b33ca6f1-b515-3ead-d223-f3c96a7b8431,name=Validate
Target System]
2025-10-08 12:57:55,205 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
StandardProcessGroup[identifier=151bb289-5d92-3aaa-3a70-d252cacba259,name=Process
Failure]
2025-10-08 12:57:55,217 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
InvokeHTTP[id=307ccb7c-7474-3597-6f91-fa30baaad706]
2025-10-08 12:57:55,217 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
StandardProcessGroup[identifier=48a0d357-7f30-3097-181a-5aee1b9a8401,name=Send
Request to External System]
2025-10-08 12:57:55,218 INFO [Process Group Update Thread-1]
o.a.nifi.groups.StandardProcessGroup
StandardFunnel[id=a8f96fd2-b957-3f89-247c-cd2b12616411-temp-funnel] added to
StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
Incoming REQUEST]
2025-10-08 12:57:55,219 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Removing
StandardFunnel[id=a8f96fd2-b957-3f89-247c-cd2b12616411-temp-funnel] from
StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
Incoming REQUEST]
2025-10-08 12:57:55,219 INFO [Process Group Update Thread-1]
o.a.nifi.groups.StandardProcessGroup
EvaluateJsonPath[id=6f68bb33-f8ad-34e9-d723-30df3b5d0779] added to
StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
Incoming REQUEST]
2025-10-08 12:57:55,219 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Added
EvaluateJsonPath[id=6f68bb33-f8ad-34e9-d723-30df3b5d0779] to
StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
Incoming REQUEST]
2025-10-08 12:57:55,219 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
JSLTTransformJSON[id=469e39a4-e27a-3375-1d6d-8d740a85c63f]
2025-10-08 12:57:55,219 INFO [Process Group Update Thread-1]
o.a.nifi.groups.StandardProcessGroup
UpdateAttribute[id=e5e64e7f-717c-31eb-3f42-72363e29e6ec] added to
StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
Incoming REQUEST]
2025-10-08 12:57:55,219 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Added
UpdateAttribute[id=e5e64e7f-717c-31eb-3f42-72363e29e6ec] to
StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
Incoming REQUEST]
2025-10-08 12:57:55,220 INFO [Process Group Update Thread-1]
o.a.nifi.groups.StandardProcessGroup
UpdateAttribute[id=7ce09ea8-6f52-34d2-3690-bea4e0e12e3f] added to
StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
Incoming REQUEST]
2025-10-08 12:57:55,220 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Added
UpdateAttribute[id=7ce09ea8-6f52-34d2-3690-bea4e0e12e3f] to
StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
Incoming REQUEST]
2025-10-08 12:57:55,220 INFO [Process Group Update Thread-1]
o.a.nifi.groups.StandardProcessGroup
RouteOnAttribute[id=96cb6169-8a9e-38a7-f9b3-4d8281dc3c71] added to
StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
Incoming REQUEST]
2025-10-08 12:57:55,220 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Added
RouteOnAttribute[id=96cb6169-8a9e-38a7-f9b3-4d8281dc3c71] to
StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
Incoming REQUEST]
2025-10-08 12:57:55,221 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Added
Connection[ID=06186867-adf6-330c-cdb4-27f9867f84c1, Source
ID=96cb6169-8a9e-38a7-f9b3-4d8281dc3c71, Dest
ID=7ce09ea8-6f52-34d2-3690-bea4e0e12e3f] to
StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
Incoming REQUEST]
2025-10-08 12:57:55,221 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Added
Connection[ID=d1c28710-387a-3bc8-3487-873dcd50d7fb, Source
ID=6f68bb33-f8ad-34e9-d723-30df3b5d0779, Dest
ID=e5e64e7f-717c-31eb-3f42-72363e29e6ec] to
StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
Incoming REQUEST]
2025-10-08 12:57:55,221 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
Connection[ID=4fd5ecef-a0dc-37bd-fe44-a3ab9221f154, Source
ID=1f04a949-7263-3d07-c94e-1e101bc1c038, Dest
ID=110c4819-4fb7-31de-69bb-18a07e4c0457]
2025-10-08 12:57:55,221 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
Connection[ID=6f0a5e09-a40c-3d05-bf3f-9c7375aae15e, Source
ID=834e1eac-bd2f-36a1-1709-e76538ac6622, Dest
ID=6f68bb33-f8ad-34e9-d723-30df3b5d0779]
2025-10-08 12:57:55,222 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Added
Connection[ID=9fcbe6d1-a8c1-3d02-a0cd-95dd3594d655, Source
ID=7ce09ea8-6f52-34d2-3690-bea4e0e12e3f, Dest
ID=110c4819-4fb7-31de-69bb-18a07e4c0457] to
StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
Incoming REQUEST]
2025-10-08 12:57:55,222 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Added
Connection[ID=4d8d8896-4439-3d4c-c878-4bb16d30926f, Source
ID=96cb6169-8a9e-38a7-f9b3-4d8281dc3c71, Dest
ID=469e39a4-e27a-3375-1d6d-8d740a85c63f] to
StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
Incoming REQUEST]
2025-10-08 12:57:55,222 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Added
Connection[ID=af3deb27-17a7-3442-246d-56c31697f87b, Source
ID=e5e64e7f-717c-31eb-3f42-72363e29e6ec, Dest
ID=110c4819-4fb7-31de-69bb-18a07e4c0457] to
StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
Incoming REQUEST]
2025-10-08 12:57:55,223 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Added
Connection[ID=8961e3b5-0c01-356c-2840-f2ab68b1c2cc, Source
ID=6f68bb33-f8ad-34e9-d723-30df3b5d0779, Dest
ID=96cb6169-8a9e-38a7-f9b3-4d8281dc3c71] to
StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
Incoming REQUEST]
2025-10-08 12:57:55,223 INFO [Process Group Update Thread-1]
o.a.nifi.groups.StandardProcessGroup
StandardFunnel[id=a8f96fd2-b957-3f89-247c-cd2b12616411-temp-funnel] removed
from flow
2025-10-08 12:57:55,223 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
Incoming REQUEST]
2025-10-08 12:57:55,223 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
StandardProcessGroup[identifier=b79cbce0-8ec2-3aad-e957-9b8fdb9f5a0c,name=Format
External RESPONSE]
2025-10-08 12:57:55,223 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
StandardProcessGroup[identifier=f98a31d3-b3a8-3e00-4fcf-920dd162d466,name=EDM]
2025-10-08 12:57:55,224 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
StandardProcessGroup[identifier=0cf0126b-33c8-3baa-bfd1-09e10dc65e97,name=Format
External RESPONSE]
2025-10-08 12:57:55,225 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
StandardProcessGroup[identifier=1c3b1a89-efd8-3241-db61-f6238810ae57,name=Format
Incoming REQUEST]
2025-10-08 12:57:55,225 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
StandardProcessGroup[identifier=8a17fe73-6846-3a9d-fc2c-1de7aa6d9fec,name=Send
Request to External System]
2025-10-08 12:57:55,225 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
StandardProcessGroup[identifier=2245cedc-a2ab-346c-601f-13824a732cd1,name=SAM]
2025-10-08 12:57:55,225 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
StandardProcessGroup[identifier=2f1c1eb5-8996-3fe6-20ee-5f71c9f4eb63,name=Send
Request To External System]
2025-10-08 12:57:55,225 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
StandardProcessGroup[identifier=2db0d0bc-2ddd-3f01-a1cd-b0a6f0a9e495,name=Process
Incoming Data]
2025-10-08 12:57:55,226 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
StandardProcessGroup[identifier=48b169e6-8acf-3440-b087-7ccddee41af4,name=Incoming
HTTP Request]
2025-10-08 12:57:55,227 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
StandardProcessGroup[identifier=208b5da3-59a2-32f3-aaf8-9425320ed868,name=Process
Failure]
2025-10-08 12:57:55,227 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
StandardProcessGroup[identifier=f273e9ed-036b-384a-43ef-448d17d63c58,name=Authenticate
Request]
2025-10-08 12:57:55,227 INFO [Process Group Update Thread-1]
o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
StandardProcessGroup[identifier=fd31c982-8e2f-3b70-592d-39f9acc5f197,name=Return
HTTP Response]
2025-10-08 12:57:55,237 INFO [Process Group Update Thread-1]
o.apache.nifi.web.api.FlowUpdateResource Successfully updated flow; re-enabling
0 Controller Services
2025-10-08 12:57:55,240 INFO [Process Group Update Thread-1]
o.apache.nifi.web.api.FlowUpdateResource Restarting 5 Processors
2025-10-08 12:57:55,256 INFO [Write-Ahead Local State Provider Maintenance]
o.a.n.wali.SequentialAccessWriteAheadLog Checkpointed Write-Ahead Log with 581
Records and 0 Swap Files in 5 milliseconds (Stop-the-world time = 0
milliseconds), max Transaction ID 304660
2025-10-08 12:57:55,263 INFO [Process Group Update Thread-1]
org.apache.nifi.controller.AbstractPort
LocalPort[id=834e1eac-bd2f-36a1-1709-e76538ac6622, type=INPUT_PORT, name=IN
Incoming Request, group=Format Incoming REQUEST] started
2025-10-08 12:57:55,264 INFO [Process Group Update Thread-1]
o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled
LocalPort[id=834e1eac-bd2f-36a1-1709-e76538ac6622, type=INPUT_PORT, name=IN
Incoming Request, group=Format Incoming REQUEST] to run with 1 threads
2025-10-08 12:57:55,264 INFO [Process Group Update Thread-1]
o.a.n.c.s.StandardProcessScheduler Starting
JSLTTransformJSON[id=469e39a4-e27a-3375-1d6d-8d740a85c63f]
2025-10-08 12:57:55,264 INFO [Process Group Update Thread-1]
o.a.n.c.s.StandardProcessScheduler Starting
UpdateAttribute[id=1f04a949-7263-3d07-c94e-1e101bc1c038]
2025-10-08 12:57:55,264 INFO [Process Group Update Thread-1]
org.apache.nifi.controller.AbstractPort
LocalPort[id=110c4819-4fb7-31de-69bb-18a07e4c0457, type=OUTPUT_PORT, name=OUT
Failure Output, group=Format Incoming REQUEST] started
2025-10-08 12:57:55,264 INFO [Process Group Update Thread-1]
o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled
LocalPort[id=110c4819-4fb7-31de-69bb-18a07e4c0457, type=OUTPUT_PORT, name=OUT
Failure Output, group=Format Incoming REQUEST] to run with 1 threads
2025-10-08 12:57:55,264 INFO [Process Group Update Thread-1]
o.a.n.c.s.StandardProcessScheduler Starting
InvokeHTTP[id=307ccb7c-7474-3597-6f91-fa30baaad706] {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
