[ 
https://issues.apache.org/jira/browse/NIFI-14658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18116067#comment-18116067
 ] 

Matt Burgess commented on NIFI-14658:
-------------------------------------

This Jira and NIFI-4621 and NIFI-9703 are all duplicates of each other.

In general, the properties of a processor (and the ability to configure the 
values via parameters) are the NiFi equivalent of an Initial Information Packet 
(IIP) in the Flow-Based Programming (FBP) paradigm. Allowing incoming 
connections for the purpose of dynamically configuring the processor would be 
the NiFi equivalent of the OPTIONS input port in FBP. Not having an OPTIONS 
input port in NiFi was a design choice by the original authors of NiFi.

Allowing incoming connections to source processors for the purposes of 
configuration would certainly be useful, but there are many things to consider. 
A big one is that many source processors (such as the List processors) are 
stateful, so the amount of state that could be stored could explode with the 
number of different configurations of the processor. This implies that we'd 
also need fine-grained state control (rather than just wiping the whole thing 
out), possible age-off capabilities, etc. Alternatively a change in config 
could indicate an automatic clearing of state, but what if I periodically want 
to list files from two different directories? The change in config would wipe 
the state of the first directory, and changing it back would wipe the second, 
and neither would pick up where they left off. Without automatically clearing 
state, if I wanted to list thousands of directories, I'd have to keep thousands 
of "state sets".

As this discussion is not specific to ListSFTP (and not even just for List 
processors but all source processors), I recommend a NiFi Improvement Proposal 
([NIP|https://issues.apache.org/jira/projects/NIP/summary]) Jira to have the 
broader discussion.

> ListSFTP FlowFile Input Trigger
> -------------------------------
>
>                 Key: NIFI-14658
>                 URL: https://issues.apache.org/jira/browse/NIFI-14658
>             Project: Apache NiFi
>          Issue Type: Wish
>            Reporter: Divashan Naicker
>            Priority: Minor
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> Would it be possible for future iterations of the ListSFTP processors to have 
> the capability to be triggered by a flowfile input?



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to