[
https://issues.apache.org/jira/browse/NIFI-8340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Payne resolved NIFI-8340.
------------------------------
Fix Version/s: 1.16.0
Resolution: Fixed
> If content repository is filling up, create bulletin when exerting
> backpressure
> -------------------------------------------------------------------------------
>
> Key: NIFI-8340
> URL: https://issues.apache.org/jira/browse/NIFI-8340
> Project: Apache NiFi
> Issue Type: Improvement
> Components: Core Framework
> Reporter: Mark Payne
> Priority: Major
> Fix For: 1.16.0
>
>
> When the content repository reaches its configured threshold (by default,
> 50%), it will exert backpressure that prevents any component from writing to
> it until archive has occurred. This is designed to prevent a case where the
> content repository is written to so fast that cleanup is unable to keep up.
> This can be important for use cases where there is extremely high throughput
> and the nodes are pretty well tapped out resource-wise.
> However, when this happens, it's not at all obvious to the user, as it only
> shows an INFO level message in the logs. As a result, users who encounter
> this typically think NiFi just suddenly "froze."
> To improve the experience here, we should do the following:
> * Change default to something less restrictive, such as 75 or 80%. For dev
> environments, especially, the content repository is not by itself and it's
> common for the drive to be more than 50% full before NiFi is even installed.
> * Change the log message from INFO to WARN
> * Create a Bulletin at the Controller Level that warns that backpressure is
> being applied. Ideally, this could even be created at the component level,
> but it's not clear that this is possible without significant refactoring, as
> the Content Repository does not know which component is trying to write to it.
> The {{nifi.content.repository.archive.backpressure.percentage}} property is
> not part of the default nifi.properties currently. Please add it to the
> default nifi.properties template and also document the property in the Admin
> Guide.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
