[
https://issues.apache.org/jira/browse/HIVE-28013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17808545#comment-17808545
]
Stamatis Zampetakis edited comment on HIVE-28013 at 1/19/24 8:48 AM:
---------------------------------------------------------------------
The disk usage shows that the space is occupied by Jenkins builds.
{noformat}
jenkins@jenkins-6858ddb664-lstvm:/$ du -h var/jenkins_home | grep
"G[[:space:]]\+"
2.1G var/jenkins_home/caches
41G var/jenkins_home/jobs/hive-nightly-branch-3/builds
41G var/jenkins_home/jobs/hive-nightly-branch-3
1.8G var/jenkins_home/jobs/hive-precommit/branches/PR-4380/builds
1.8G var/jenkins_home/jobs/hive-precommit/branches/PR-4380
1.1G var/jenkins_home/jobs/hive-precommit/branches/PR-4683/builds
1.1G var/jenkins_home/jobs/hive-precommit/branches/PR-4683
1.3G var/jenkins_home/jobs/hive-precommit/branches/PR-4820/builds
1.3G var/jenkins_home/jobs/hive-precommit/branches/PR-4820
2.5G
var/jenkins_home/jobs/hive-precommit/branches/storage-branch-2-8.a76ggs/builds
2.5G var/jenkins_home/jobs/hive-precommit/branches/storage-branch-2-8.a76ggs
1.9G var/jenkins_home/jobs/hive-precommit/branches/branch-3/builds
1.9G var/jenkins_home/jobs/hive-precommit/branches/branch-3
1.4G var/jenkins_home/jobs/hive-precommit/branches/PR-4901/builds
1.4G var/jenkins_home/jobs/hive-precommit/branches/PR-4901
2.2G var/jenkins_home/jobs/hive-precommit/branches/PR-4740/builds
2.2G var/jenkins_home/jobs/hive-precommit/branches/PR-4740
1.3G var/jenkins_home/jobs/hive-precommit/branches/PR-4882/builds
1.3G var/jenkins_home/jobs/hive-precommit/branches/PR-4882
3.7G var/jenkins_home/jobs/hive-precommit/branches/PR-4913/builds
3.7G var/jenkins_home/jobs/hive-precommit/branches/PR-4913
1.3G var/jenkins_home/jobs/hive-precommit/branches/PR-4616/builds
1.3G var/jenkins_home/jobs/hive-precommit/branches/PR-4616
4.2G var/jenkins_home/jobs/hive-precommit/branches/PR-4852/builds
4.2G var/jenkins_home/jobs/hive-precommit/branches/PR-4852
1.4G var/jenkins_home/jobs/hive-precommit/branches/PR-4961/builds
1.4G var/jenkins_home/jobs/hive-precommit/branches/PR-4961
1.1G var/jenkins_home/jobs/hive-precommit/branches/PR-4973/builds
1.1G var/jenkins_home/jobs/hive-precommit/branches/PR-4973
4.0G var/jenkins_home/jobs/hive-precommit/branches/PR-4761/builds
4.0G var/jenkins_home/jobs/hive-precommit/branches/PR-4761
1.7G
var/jenkins_home/jobs/hive-precommit/branches/dependabo.ssr98q2m10i5.ss-1-24-0/builds
1.7G
var/jenkins_home/jobs/hive-precommit/branches/dependabo.ssr98q2m10i5.ss-1-24-0
103G var/jenkins_home/jobs/hive-precommit/branches/master/builds
103G var/jenkins_home/jobs/hive-precommit/branches/master
1.7G var/jenkins_home/jobs/hive-precommit/branches/PR-4950/builds
1.7G var/jenkins_home/jobs/hive-precommit/branches/PR-4950
3.6G var/jenkins_home/jobs/hive-precommit/branches/PR-4855/builds
3.6G var/jenkins_home/jobs/hive-precommit/branches/PR-4855
3.5G var/jenkins_home/jobs/hive-precommit/branches/PR-4744/builds
3.5G var/jenkins_home/jobs/hive-precommit/branches/PR-4744
2.4G var/jenkins_home/jobs/hive-precommit/branches/PR-4517/builds
2.4G var/jenkins_home/jobs/hive-precommit/branches/PR-4517
1.3G var/jenkins_home/jobs/hive-precommit/branches/PR-4755/builds
1.3G var/jenkins_home/jobs/hive-precommit/branches/PR-4755
1.1G var/jenkins_home/jobs/hive-precommit/branches/PR-4566/builds/8
1.2G var/jenkins_home/jobs/hive-precommit/branches/PR-4566/builds/27
5.8G var/jenkins_home/jobs/hive-precommit/branches/PR-4566/builds
5.8G var/jenkins_home/jobs/hive-precommit/branches/PR-4566
200G var/jenkins_home/jobs/hive-precommit/branches
200G var/jenkins_home/jobs/hive-precommit
1.4G var/jenkins_home/jobs/hive-flaky-check/builds/63/archive
1.4G var/jenkins_home/jobs/hive-flaky-check/builds/63
1.8G var/jenkins_home/jobs/hive-flaky-check/builds/802
6.7G var/jenkins_home/jobs/hive-flaky-check/builds
6.7G var/jenkins_home/jobs/hive-flaky-check
42G var/jenkins_home/jobs/hive-nightly/builds
42G var/jenkins_home/jobs/hive-nightly
289G var/jenkins_home/jobs
294G var/jenkins_home{noformat}
was (Author: zabetak):
The disk usage is still ongoing but it quickly shows that the space is occupied
by Jenkins builds.
{noformat}
jenkins@jenkins-6858ddb664-lstvm:/$ du -h var/jenkins_home | grep
"G[[:space:]]\+"
2.1G var/jenkins_home/caches
41G var/jenkins_home/jobs/hive-nightly-branch-3/builds
41G var/jenkins_home/jobs/hive-nightly-branch-3
1.8G var/jenkins_home/jobs/hive-precommit/branches/PR-4380/builds
1.8G var/jenkins_home/jobs/hive-precommit/branches/PR-4380
1.1G var/jenkins_home/jobs/hive-precommit/branches/PR-4683/builds
1.1G var/jenkins_home/jobs/hive-precommit/branches/PR-4683
1.3G var/jenkins_home/jobs/hive-precommit/branches/PR-4820/builds
1.3G var/jenkins_home/jobs/hive-precommit/branches/PR-4820
2.5G
var/jenkins_home/jobs/hive-precommit/branches/storage-branch-2-8.a76ggs/builds
2.5G var/jenkins_home/jobs/hive-precommit/branches/storage-branch-2-8.a76ggs
1.9G var/jenkins_home/jobs/hive-precommit/branches/branch-3/builds
1.9G var/jenkins_home/jobs/hive-precommit/branches/branch-3
1.4G var/jenkins_home/jobs/hive-precommit/branches/PR-4901/builds
1.4G var/jenkins_home/jobs/hive-precommit/branches/PR-4901
2.2G var/jenkins_home/jobs/hive-precommit/branches/PR-4740/builds
2.2G var/jenkins_home/jobs/hive-precommit/branches/PR-4740
1.3G var/jenkins_home/jobs/hive-precommit/branches/PR-4882/builds
1.3G var/jenkins_home/jobs/hive-precommit/branches/PR-4882
3.7G var/jenkins_home/jobs/hive-precommit/branches/PR-4913/builds
3.7G var/jenkins_home/jobs/hive-precommit/branches/PR-4913
1.3G var/jenkins_home/jobs/hive-precommit/branches/PR-4616/builds
1.3G var/jenkins_home/jobs/hive-precommit/branches/PR-4616
4.2G var/jenkins_home/jobs/hive-precommit/branches/PR-4852/builds
4.2G var/jenkins_home/jobs/hive-precommit/branches/PR-4852
1.4G var/jenkins_home/jobs/hive-precommit/branches/PR-4961/builds
1.4G var/jenkins_home/jobs/hive-precommit/branches/PR-4961
1.1G var/jenkins_home/jobs/hive-precommit/branches/PR-4973/builds
1.1G var/jenkins_home/jobs/hive-precommit/branches/PR-4973
4.0G var/jenkins_home/jobs/hive-precommit/branches/PR-4761/builds
4.0G var/jenkins_home/jobs/hive-precommit/branches/PR-4761
1.7G
var/jenkins_home/jobs/hive-precommit/branches/dependabo.ssr98q2m10i5.ss-1-24-0/builds
1.7G
var/jenkins_home/jobs/hive-precommit/branches/dependabo.ssr98q2m10i5.ss-1-24-0
...
{noformat}
> No space left on device when running precommit tests
> ----------------------------------------------------
>
> Key: HIVE-28013
> URL: https://issues.apache.org/jira/browse/HIVE-28013
> Project: Hive
> Issue Type: Bug
> Components: Testing Infrastructure
> Reporter: Stamatis Zampetakis
> Priority: Blocker
>
> The Hive precommit tests fail due to lack of space. Few of the most recent
> failures below:
> *
> http://ci.hive.apache.org/job/hive-precommit/view/change-requests/job/PR-4744/23/console
> *
> http://ci.hive.apache.org/job/hive-precommit/view/change-requests/job/PR-5005/10/console
> {noformat}
> java.io.IOException: No space left on device
> at java.base/sun.nio.ch.FileDispatcherImpl.write0(Native Method)
> at
> java.base/sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:62)
> at java.base/sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:113)
> at java.base/sun.nio.ch.IOUtil.write(IOUtil.java:79)
> at java.base/sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:280)
> at
> org.jenkinsci.plugins.workflow.support.pickles.serialization.RiverWriter.<init>(RiverWriter.java:109)
> at
> org.jenkinsci.plugins.workflow.cps.CpsThreadGroup.saveProgram(CpsThreadGroup.java:560)
> at
> org.jenkinsci.plugins.workflow.cps.CpsThreadGroup.saveProgram(CpsThreadGroup.java:537)
> at
> org.jenkinsci.plugins.workflow.cps.CpsThreadGroup.saveProgramIfPossible(CpsThreadGroup.java:520)
> at
> org.jenkinsci.plugins.workflow.cps.CpsThreadGroup.run(CpsThreadGroup.java:444)
> at
> org.jenkinsci.plugins.workflow.cps.CpsThreadGroup.access$400(CpsThreadGroup.java:97)
> at
> org.jenkinsci.plugins.workflow.cps.CpsThreadGroup$2.call(CpsThreadGroup.java:315)
> at
> org.jenkinsci.plugins.workflow.cps.CpsThreadGroup$2.call(CpsThreadGroup.java:279)
> at
> org.jenkinsci.plugins.workflow.cps.CpsVmExecutorService$2.call(CpsVmExecutorService.java:67)
> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> at
> hudson.remoting.SingleLaneExecutorService$1.run(SingleLaneExecutorService.java:139)
> at
> jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)
> at
> jenkins.security.ImpersonatingExecutorService$1.run(ImpersonatingExecutorService.java:68)
> at
> java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at java.base/java.lang.Thread.run(Thread.java:829)
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
