[
https://issues.apache.org/jira/browse/HIVE-28013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17808591#comment-17808591
]
Stamatis Zampetakis commented on HIVE-28013:
--------------------------------------------
I just deleted the following old builds as well:
{noformat}
curl -u zabetak:apitoken -H "Content-Length: 0" -X POST
http://ci.hive.apache.org/job/hive-nightly/[432-449]/doDelete
curl -u zabetak:apitoken -H "Content-Length: 0" -X POST
http://ci.hive.apache.org/job/hive-precommit/job/master/[583-1577]/doDelete
{noformat}
In addition, I changed the orphaned item stategy configuration for
hive-precommit job to discard old items after 15 days (previously 60).
With all the changes above the Jenkins disk usage is now at 50% and CI is
stable.
{noformat}
jenkins@jenkins-6858ddb664-2m79c:/$ df
Filesystem 1K-blocks Used Available Use% Mounted on
overlay 98831908 4857584 93957940 5% /
tmpfs 65536 0 65536 0% /dev
tmpfs 6647132 0 6647132 0% /sys/fs/cgroup
/dev/sdb 308521792 147638092 160867316 48% /var/jenkins_home
/dev/sda1 98831908 4857584 93957940 5% /etc/hosts
shm 65536 0 65536 0% /dev/shm
tmpfs 10804920 12 10804908 1%
/run/secrets/kubernetes.io/serviceaccount
tmpfs 6647132 0 6647132 0% /proc/acpi
tmpfs 6647132 0 6647132 0% /proc/scsi
tmpfs 6647132 0 6647132 0% /sys/firmware
{noformat}
I am considering this ticket resolved. Please leave a comment if you have ideas
or questions regarding the above.
> No space left on device when running precommit tests
> ----------------------------------------------------
>
> Key: HIVE-28013
> URL: https://issues.apache.org/jira/browse/HIVE-28013
> Project: Hive
> Issue Type: Bug
> Components: Testing Infrastructure
> Reporter: Stamatis Zampetakis
> Assignee: Stamatis Zampetakis
> Priority: Blocker
> Attachments: orphaned_item_strategy.png
>
>
> The Hive precommit tests fail due to lack of space. Few of the most recent
> failures below:
> *
> http://ci.hive.apache.org/job/hive-precommit/view/change-requests/job/PR-4744/23/console
> *
> http://ci.hive.apache.org/job/hive-precommit/view/change-requests/job/PR-5005/10/console
> {noformat}
> java.io.IOException: No space left on device
> at java.base/sun.nio.ch.FileDispatcherImpl.write0(Native Method)
> at
> java.base/sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:62)
> at java.base/sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:113)
> at java.base/sun.nio.ch.IOUtil.write(IOUtil.java:79)
> at java.base/sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:280)
> at
> org.jenkinsci.plugins.workflow.support.pickles.serialization.RiverWriter.<init>(RiverWriter.java:109)
> at
> org.jenkinsci.plugins.workflow.cps.CpsThreadGroup.saveProgram(CpsThreadGroup.java:560)
> at
> org.jenkinsci.plugins.workflow.cps.CpsThreadGroup.saveProgram(CpsThreadGroup.java:537)
> at
> org.jenkinsci.plugins.workflow.cps.CpsThreadGroup.saveProgramIfPossible(CpsThreadGroup.java:520)
> at
> org.jenkinsci.plugins.workflow.cps.CpsThreadGroup.run(CpsThreadGroup.java:444)
> at
> org.jenkinsci.plugins.workflow.cps.CpsThreadGroup.access$400(CpsThreadGroup.java:97)
> at
> org.jenkinsci.plugins.workflow.cps.CpsThreadGroup$2.call(CpsThreadGroup.java:315)
> at
> org.jenkinsci.plugins.workflow.cps.CpsThreadGroup$2.call(CpsThreadGroup.java:279)
> at
> org.jenkinsci.plugins.workflow.cps.CpsVmExecutorService$2.call(CpsVmExecutorService.java:67)
> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> at
> hudson.remoting.SingleLaneExecutorService$1.run(SingleLaneExecutorService.java:139)
> at
> jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)
> at
> jenkins.security.ImpersonatingExecutorService$1.run(ImpersonatingExecutorService.java:68)
> at
> java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at java.base/java.lang.Thread.run(Thread.java:829)
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
