[
https://issues.apache.org/jira/browse/NIFI-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17935259#comment-17935259
]
David Handermann commented on NIFI-14355:
-----------------------------------------
Thanks for the discussion [~adistefano] and [~pvillard]! I merged the change
from 1 minute to 30 minutes.
It is true that the App Installation Token method still has the same rate
limit, so ultimately, creating separate accounts is probably the most scalable
and secure solution for large numbers of NiFi instances. However, reducing the
sync frequency should provide a general improvement for production deployments
where flow changes occur less often.
> Authenticated GitHub Registry Client hitting rate limit (5000 reqs per hour)
> ----------------------------------------------------------------------------
>
> Key: NIFI-14355
> URL: https://issues.apache.org/jira/browse/NIFI-14355
> Project: Apache NiFi
> Issue Type: Improvement
> Components: Flow Versioning, NiFi Registry
> Affects Versions: 2.2.0
> Environment: Not relevant
> Reporter: Andrea Di Stefano
> Assignee: Pierre Villard
> Priority: Major
> Attachments: image-2025-03-11-16-47-39-522.png
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> Hello.
> We are using the GitHub Registry Client with a Personal Authentication Token
> (PAT) and constantly hitting the API rate limit. The rate limit, [as stated
> in the GitHub
> docs|https://docs.github.com/en/rest/using-the-rest-api/rate-limits-for-the-rest-api?apiVersion=2022-11-28#primary-rate-limit-for-authenticated-users],
> is 5000 requests per hour.
> We have a pipeline with 53 instances of 3 versioned process groups, which are
> part of a bigger pipeline (~1.1k components).
> I uploaded a related stack trace [here|https://pastebin.com/R0tTw4bP].
> Calling the GitHub API with Postman, we saw that the response headers include
> data about the rate limit, current usage, and reset time in Unix epoch
> format, see the attached screenshot for an example:
> !image-2025-03-11-16-47-39-522.png!
> Is NiFi periodically polling the GitHub API in background?
> Can we somehow limit the number of calls?
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
