[ 
https://issues.apache.org/jira/browse/NIFI-14335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vijaya Gorla updated NIFI-14335:
--------------------------------
    Description: 
Elasticsearch processors currently do not support NiFi framework batching 
(using {{SupportsBatching}} annotation). Although {{PutElasticsearchJson}} and 
{{PutElasticsearchRecord}} processors support batching but this is implemented 
in the processor, not using {{SupportsBatching}} annotation.

Following processors could benefit from framework batching where high 
throughput is required.
 * {{GetElasticsearch}}
 * {{JsonQueryElasticsearch}}
 * {{UpdateByQueryElasticsearch}}
 * {{DeleteByQueryElasticsearch}}

Adding {{SupportsBatching}} with {{DefaultRunDuration.NO_BATCHING}} would 
preserve the existing behaviour by default and enable batching if required.

  was:
Elasticsearch processors currently do not support NiFi framework batching 
(using {{SupportsBatching}} annotation). Although {{PutElasticsearchJson}} and 
{{PutElasticsearchRecord}} processors support batching but this is implemented 
in the processor, not using {{SupportsBatching}} annotation.

Following processors could benefit from framework batching where high 
throughput isĀ  required (thousands of flow files per second)
 * {{GetElasticsearch}}
 * {{JsonQueryElasticsearch}}
 * {{UpdateByQueryElasticsearch}}
 * {{DeleteByQueryElasticsearch}}

Adding {{SupportsBatching}} with {{DefaultRunDuration.NO_BATCHING}} would 
preserve the existing behavior by default and enable batching if required.


> Support NiFi framework batching in Elasticsearch processors
> -----------------------------------------------------------
>
>                 Key: NIFI-14335
>                 URL: https://issues.apache.org/jira/browse/NIFI-14335
>             Project: Apache NiFi
>          Issue Type: Improvement
>          Components: Extensions
>    Affects Versions: 2.2.0
>            Reporter: Vijaya Gorla
>            Priority: Minor
>              Labels: elasticsearch
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> Elasticsearch processors currently do not support NiFi framework batching 
> (using {{SupportsBatching}} annotation). Although {{PutElasticsearchJson}} 
> and {{PutElasticsearchRecord}} processors support batching but this is 
> implemented in the processor, not using {{SupportsBatching}} annotation.
> Following processors could benefit from framework batching where high 
> throughput is required.
>  * {{GetElasticsearch}}
>  * {{JsonQueryElasticsearch}}
>  * {{UpdateByQueryElasticsearch}}
>  * {{DeleteByQueryElasticsearch}}
> Adding {{SupportsBatching}} with {{DefaultRunDuration.NO_BATCHING}} would 
> preserve the existing behaviour by default and enable batching if required.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to