Repository navigation
fix(asap-tools): store containerd images on /scratch - #895
Merged
Merged
Conversation
Docker's containerd image store ignores daemon.json data-root, so image layers and build snapshots filled the small root disk on CloudLab nodes. Point containerd's root at /scratch/var_lib_containerd during setup. Co-Authored-By: Claude Opus 5.5 <[email protected]>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Docker's containerd image store ignores
data-rootin/etc/docker/daemon.json, so images and build snapshots went to/var/lib/containerdon the 63G root disk. On CloudLab nodes this filled/(47G of leftover snapshots), breaking builds with "no space left on device" and sqlite "database or disk is full".setup_dependencies.shnow setsroot = "/scratch/var_lib_containerd"in/etc/containerd/config.toml(rewriting the commented default line, or adding it if missing) and restarts containerd before Docker.Tested: the config rewrite on a sample
config.toml(also when run twice) andbash -non the script. The same change was applied by hand on the 6 current nodes:/went from 82–100% used to about 16%, with containerd and Docker both running. A fresh deploy with the updated script hasn't been run yet.🤖 Generated with Claude Code