[
https://issues.apache.org/jira/browse/YUNIKORN-3111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18013272#comment-18013272
]
Michael Chu edited comment on YUNIKORN-3111 at 8/11/25 6:18 PM:
----------------------------------------------------------------
This error comes from k8s. The {{note}} field (where we set
{{{}record.message{}}}) is hitting the size limit when shim publishes events.
Refs:
*
[https://github.com/kubernetes/kubernetes/blob/master/pkg/apis/core/validation/events.go#L184-L185]
*
[https://github.com/apache/yunikorn-k8shim/blob/master/pkg/cache/context.go#L1157-L1158]
was (Author: JIRAUSER307375):
This error comes from k8s. The {{note}} field (where we set
{{{}record.message{}}}) is hitting the size limit when shim publishes events. I
think we can truncate event messages in core to 1024 characters when generating
events.
Refs:
*
[https://github.com/kubernetes/kubernetes/blob/master/pkg/apis/core/validation/events.go#L184-L185]
*
[https://github.com/apache/yunikorn-k8shim/blob/master/pkg/cache/context.go#L1157-L1158]
> Limit event size to 1024
> ------------------------
>
> Key: YUNIKORN-3111
> URL: https://issues.apache.org/jira/browse/YUNIKORN-3111
> Project: Apache YuniKorn
> Issue Type: Bug
> Components: core - scheduler
> Reporter: Peter Bacsko
> Assignee: Michael Chu
> Priority: Major
> Labels: pull-request-available
>
> When sending events from the core, we can hit a size limit:
> {noformat}
> E0717 03:22:44.791674 1 event_broadcaster.go:270] "Server rejected
> event (will not retry!)" err="Event
> \"xxxxxxxx-yyyyyyyy-ds-tm5jz-executor-exec-181.1852eb73a5c69500\" is invalid:
> message: Invalid value: \"\": can have at most 1024 characters" event=<
>
> &Event{ObjectMeta:{xxxxxxxx-yyyyyyyy-ds-tm5jz-executor-exec-181.1852eb73a5c69500
> xxxxxxxx-yyyyyyyy 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[]
> map[] [] [] []},EventTime:2025-07-17 03:14:46.935564308 +0000 UTC
> m=+3877.518951570,Series:&EventSeries{Count:3,LastObservedTime:2025-07-17
> 03:15:16.942117679 +0000 UTC
> m=+3907.525504941,},ReportingController:yunikorn,ReportingInstance:yunikorn-yunikorn-scheduler-56cb9f874c-2w7t7,Action:Informational,Reason:Informational,Regarding:{Pod
> xxxxxxxx-yyyyyyyy xxxxxxxx-yyyyyyyy-ds-tm5jz-executor-exec-181
> 8d7bdda0-f1d1-46b6-a997-61b7d9f35ec9 v1 122445160
> },Related:nil,Note:Unschedulable request
> '8d7bdda0-f1d1-46b6-a997-61b7d9f35ec9': failed plugin: 'NodeAffinity'
> node(s) didn't match Pod's node affinity/selector (2x); failed plugin:
> 'TaintToleration'
> node(s) had untolerated taint {xyz-executor-main: reserved} (1x);
> failed plugin: 'TaintToleration'
> node(s) had untolerated taint {xyz-abc-executor: reserved} (14x);
> failed plugin: 'TaintToleration'
> node(s) had untolerated taint {xyz-abc-dfe: reserved} (1x); failed
> plugin: 'TaintToleration'
> node(s) had untolerated taint {ch-kp-dspark-xxxxxxxx-yyyyyyyy-dfe:
> reserved} (5x); failed plugin: 'TaintToleration'
> node(s) had untolerated taint {xyz-abc-executor: reserved} (23x);
> failed plugin: 'TaintToleration'
> node(s) had untolerated taint {xyz-abc-dfe: reserved} (2x); failed
> plugin: 'TaintToleration'
> node(s) had untolerated taint {karpenter.sh/disrupted: } (1x); failed
> plugin: 'TaintToleration'
> node(s) had untolerated taint {node.kubernetes.io/not-ready: } (1x);
> ,Type:Normal,DeprecatedSource:{ },DeprecatedFirstTimestamp:0001-01-01
> 00:00:00 +0000 UTC,DeprecatedLastTimestamp:0001-01-01 00:00:00 +0000
> UTC,DeprecatedCount:0,} {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
