[
https://issues.apache.org/jira/browse/SPARK-31987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-31987.
----------------------------------
Resolution: Invalid
Resolving as Invalid — this is a usage/how-to question rather than a specific
Spark defect or actionable change. Usage questions are best directed to
[email protected] (https://spark.apache.org/community.html) or Stack
Overflow (tag apache-spark). Findings from triage: Verified this is a pure
usage/how-to question ("Where to find Prometheus metrics path about executors
in Spark 3"), not a defect or actionable change. The feature genuinely exists
and is documented: config UI_PROMETHEUS_ENABLED (spark.ui.prometheus.enabled,
version 3.0.0) at
core/src/main/scala/org/apache/spark/internal/config/UI.scala:113 exposes
executor metrics at /metrics/executors/prometheus, backed by
core/src/main/scala/org/apache/spark/status/api/v1/PrometheusResource.scala and
PrometheusServlet.scala. docs/monitoring.md:900 and the endpoint table at lines
1169-1193 document /metrics/e
Please reopen with a concrete reproducer or a specific proposed change if this
is actually a bug or an actionable improvement.
> Where to find Prometheus metrics path about executors in Spark 3
> ----------------------------------------------------------------
>
> Key: SPARK-31987
> URL: https://issues.apache.org/jira/browse/SPARK-31987
> Project: Spark
> Issue Type: Question
> Components: Examples
> Affects Versions: 3.0.0
> Reporter: Smith Cruise
> Priority: Major
> Labels: documentation
>
> I know in Spark 3.0, it supports Prometheus Sink. But I don't know where to
> get metrics about executors. I want to fetch realtime executor's
> *_filesystem.hdfs.read_bytes,_* etc.
>
> I have tried several paths, but it doesn't work. Could you please tell me the
> Prometheus metrics path about all executors?
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
