[
https://issues.apache.org/jira/browse/NIFI-13402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18103880#comment-18103880
]
David Handermann commented on NIFI-13402:
-----------------------------------------
Thanks for the through and helpful response [~mattyb149], I appreciate the work
to address the concerns I raised on the earlier PR.
To provide more substantive context, my concerns extend to both this new API
surface and the Python Processor extension itself.
I will start a discussion thread on the developer list, as I think this
warrants additional perspective. To summarize for now, the question is whether
the project should encourage additional usage of Python Processors or not.
Based on experience developing and using the Python Processor API, there is
value in its ability to support rapid iteration, but that value quickly
diminishes when it comes to production deployment considerations. As mentioned,
scalability concerns around Python process resource consumption and control are
primary. The packaging strategy for Python Processors is also different,
raising potential security concerns for a unified deployment strategy.
The addition of new Python Processor API interface is less about the amount of
code required and more about the promotion of an additional API surface. This
is the reason it should go through the NiFi Improvement Proposal review, and
also the reason to reconsider the future of the Python Processor extension
strategy.
> Multiple flowfiles as output for Python Processors
> --------------------------------------------------
>
> Key: NIFI-13402
> URL: https://issues.apache.org/jira/browse/NIFI-13402
> Project: Apache NiFi
> Issue Type: New Feature
> Components: Core Framework
> Reporter: Asif Arman Rahman
> Assignee: Matt Burgess
> Priority: Major
> Labels: features
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> This is a request to add the feature, where we can split an incoming flowfile
> to multiple flowfiles as output for Python Processor in NiFi 2.0.0.
> Use case: Input is a single flowfile which contains an excel file, and output
> would be multiple flowfiles, where each flowfile will contain one sheet from
> the excel file.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
