[jira] [Created] (FLINK-21858) TaskMetricGroup taskName is too long, especially in sql tasks.

[Andrew.D.lin (Jira)]

Andrew.D.lin created FLINK-21858:
------------------------------------

             Summary: TaskMetricGroup taskName is too long, especially in sql 
tasks.
                 Key: FLINK-21858
                 URL: https://issues.apache.org/jira/browse/FLINK-21858
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Metrics
    Affects Versions: 1.12.2, 1.12.1, 1.12.0
            Reporter: Andrew.D.lin


Now operatorName is limited to 80 by 
org.apache.flink.runtime.metrics.groups.TaskMetricGroup#METRICS_OPERATOR_NAME_MAX_LENGTH.

So propose to limit the maximum length of metric name by configuration.

 

Here is an example:

 

"taskName":"GlobalGroupAggregate(groupBy=[dt, src, src1, src2, src3, ct1, ct2], 
select=[dt, src, src1, src2, src3, ct1, ct2, SUM_RETRACT((sum$0, count$1)) AS 
sx_pv, SUM_RETRACT((sum$2, count$3)) AS sx_uv, MAX_RETRACT(max$4) AS updt_time, 
MAX_RETRACT(max$5) AS time_id]) -> Calc(select=[((MD5((dt CONCAT _UTF-16LE'|' 
CONCAT src CONCAT _UTF-16LE'|' CONCAT src1 CONCAT _UTF-16LE'|' CONCAT src2 
CONCAT _UTF-16LE'|' CONCAT src3 CONCAT _UTF-16LE'|' CONCAT ct1 CONCAT 
_UTF-16LE'|' CONCAT ct2 CONCAT _UTF-16LE'|' CONCAT time_id)) SUBSTR 1 SUBSTR 2) 
CONCAT _UTF-16LE'_' CONCAT (dt CONCAT _UTF-16LE'|' CONCAT src CONCAT 
_UTF-16LE'|' CONCAT src1 CONCAT _UTF-16LE'|' CONCAT src2 CONCAT _UTF-16LE'|' 
CONCAT src3 CONCAT _UTF-16LE'|' CONCAT ct1 CONCAT _UTF-16LE'|' CONCAT ct2 
CONCAT _UTF-16LE'|' CONCAT time_id)) AS rowkey, sx_pv, sx_uv, updt_time]) -> 
LocalGroupAggregate(groupBy=[rowkey], select=[rowkey, MAX_RETRACT(sx_pv) AS 
max$0, MAX_RETRACT(sx_uv) AS max$1, MAX_RETRACT(updt_time) AS max$2, 
COUNT_RETRACT(*) AS count1$3])"


"operatorName":"GlobalGroupAggregate(groupBy=[dt, src, src1, src2, src3, ct1, 
ct2], selec=[dt, s"
 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)