[
https://issues.apache.org/jira/browse/NIFI-4809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16381061#comment-16381061
]
ASF GitHub Bot commented on NIFI-4809:
--------------------------------------
Github user pvillard31 commented on the issue:
https://github.com/apache/nifi/pull/2430
What about adding a property to let the user decide the output format:
- "Output format" with two options: "Ambari Metrics Collector format" or
"Record based format"
- "Record writer": this property being used if and only if the "Record
based format" is selected
My primary objective was to have this reporting task usable in MiNiFi java
agents to send the metrics to a NiFi cluster that would publish the metrics to
AMS. But we could definitely use this reporting task to get the metrics and
store the data into another store such as Elasticsearch.
In any case, I'd add an "Additional details" page to provide information
about the schemas.
> Implement a SiteToSiteMetricsReportingTask
> ------------------------------------------
>
> Key: NIFI-4809
> URL: https://issues.apache.org/jira/browse/NIFI-4809
> Project: Apache NiFi
> Issue Type: New Feature
> Components: Extensions
> Reporter: Pierre Villard
> Assignee: Pierre Villard
> Priority: Major
>
> At the moment there is an AmbariReportingTask to send the NiFi-related
> metrics of the host to the Ambari Metrics Service. In a multi-cluster
> configuration, or when working with MiNiFi (Java) agents, it might not be
> possible for all the NiFi instances (NiFi and/or MiNiFi) to access the AMS
> REST API.
> To solve this problem, a solution would be to implement a
> SiteToSiteMetricsReportingTask to send the data via S2S to the "main" NiFi
> instance/cluster that will be able to publish the metrics into AMS (using
> InvokeHTTP). This way, it is possible to have the metrics of all the
> instances exposed in one AMS instance.
> I propose to send the data formatted as we are doing right now in the Ambari
> reporting task. If needed, it can be easily converted into another schema
> using the record processors once received via S2S.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
