[
https://issues.apache.org/jira/browse/NIFI-4809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16384836#comment-16384836
]
ASF GitHub Bot commented on NIFI-4809:
--------------------------------------
Github user pvillard31 commented on the issue:
https://github.com/apache/nifi/pull/2430
@mattyb149 - this is not the final version, I still have unit tests and
"additional details" doc to add, but wanted to give you an update in case you
want to have a look and if you already have feedbacks.
I've reworked the new reporting task as I suggested with two additional
properties. I also reworked the way metrics are constructed to have the ambari
format and the "record" format with the minimal code duplication. I also chose
this implementation (using the JsonTreeReader) so that we can easily reuse the
code for the other S2S reporting task. If it sounds OK to you, adding an
optional Record Writer property to the other S2S reporting tasks should be
really easy (I guess best is to take care of it into a follow-up JIRA).
> Implement a SiteToSiteMetricsReportingTask
> ------------------------------------------
>
> Key: NIFI-4809
> URL: https://issues.apache.org/jira/browse/NIFI-4809
> Project: Apache NiFi
> Issue Type: New Feature
> Components: Extensions
> Reporter: Pierre Villard
> Assignee: Pierre Villard
> Priority: Major
>
> At the moment there is an AmbariReportingTask to send the NiFi-related
> metrics of the host to the Ambari Metrics Service. In a multi-cluster
> configuration, or when working with MiNiFi (Java) agents, it might not be
> possible for all the NiFi instances (NiFi and/or MiNiFi) to access the AMS
> REST API.
> To solve this problem, a solution would be to implement a
> SiteToSiteMetricsReportingTask to send the data via S2S to the "main" NiFi
> instance/cluster that will be able to publish the metrics into AMS (using
> InvokeHTTP). This way, it is possible to have the metrics of all the
> instances exposed in one AMS instance.
> I propose to send the data formatted as we are doing right now in the Ambari
> reporting task. If needed, it can be easily converted into another schema
> using the record processors once received via S2S.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
