Thanks for the response. It gave my additional context such that I can
proceed with more confidence. I've been playing with creating additional
sessions and I believe that it will work for my use case. But I will keep
the duplicate flowfile potential issue in mind, though.
Thanks again.
Devin
On
Devin,
We do realize that we have some work to do in order to make it so that
a single Processor can buffer up hundreds of thousands or more FlowFiles.
The SplitText processor is very popular and suffers from this exact same
problem.
We want to have a mechanism for swapping those out of the Java
I'm creating a processor that will read a customer csv and will create a
new flowfile for each line in the form of XML. The CSV file will be quite
large (100s of thousands of lines). I would like to commit a reasonable
amount from time to time so that they can flow down to other processors.
But loo
