[
https://issues.apache.org/jira/browse/HUDI-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yuweixiao updated HUDI-2849:
----------------------------
Description:
The following image shows upsert process using deltastreamer. The job
description is unclear and sometimes misleading. E.g., there are two jobs with
name 'isEmpty' and one of them actually can be removed. The job 8 does the
partition and write task, but it is named as 'Getting small files from
partitions'.
!image-2021-11-24-16-52-32-781.png|width=1045,height=413!
was:
The following image shows upsert process using deltastreamer. The job
description is unclear and sometimes misleading. E.g., there are two jobs with
name 'isEmpty' and one of them actually can be removed. The job 8 does the
partition and write task, but it is named as 'Getting small files from
partitions'.
!image-2021-11-24-16-52-32-781.png!
> Improve job/stage description in spark UI for hudi write
> --------------------------------------------------------
>
> Key: HUDI-2849
> URL: https://issues.apache.org/jira/browse/HUDI-2849
> Project: Apache Hudi
> Issue Type: Improvement
> Components: DeltaStreamer, Spark Integration
> Reporter: yuweixiao
> Priority: Trivial
> Attachments: image-2021-11-24-16-52-32-781.png
>
>
> The following image shows upsert process using deltastreamer. The job
> description is unclear and sometimes misleading. E.g., there are two jobs
> with name 'isEmpty' and one of them actually can be removed. The job 8 does
> the partition and write task, but it is named as 'Getting small files from
> partitions'.
> !image-2021-11-24-16-52-32-781.png|width=1045,height=413!
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
