Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 3 additions & 1 deletion docs/model-workflows/shared-cache.md
Original file line number Diff line number Diff line change
Expand Up @@ -107,7 +107,9 @@ when transferring it, not just a snapshot directory.
## 3. Validate as the consumer, then load a local snapshot

On a reader node (or inside the actual workload container, with its real UID and
mount), run the validator from the repository root:
mount), use a DeepOps checkout present there with
`scripts/validation/validate_model_cache.py` readable and its parent directories
traversable by the consumer UID; run the validator from that checkout's root:

```bash
python3 scripts/validation/validate_model_cache.py --json \
Expand Down
7 changes: 5 additions & 2 deletions docs/model-workflows/vllm-quickstart.md
Original file line number Diff line number Diff line change
Expand Up @@ -39,8 +39,11 @@ is needed. Review the model license before use.
production isolation, multi-node serving, and scheduler manifests are outside
this example. The validator deliberately has no authentication options.

The commands below run **on the allocated serving node**, from the repository
root. Package installation can download large GPU dependencies. For disconnected
The commands below run **on the allocated serving node**, from a DeepOps checkout
present there with `scripts/validation/validate_model_cache.py` and
`scripts/validation/validate_vllm.py` readable and their parent directories
traversable by the consumer UID; run from that checkout's root.
Package installation can download large GPU dependencies. For disconnected
systems, prepare an approved wheel mirror first; offline model loading does not
make package installation offline.

Expand Down
7 changes: 5 additions & 2 deletions skills/manage-model-cache/SKILL.md
Original file line number Diff line number Diff line change
Expand Up @@ -34,8 +34,11 @@ for the supported CLI version, exact configuration and working download example.
as shown in the guide. Include every tokenizer/config file and weight shard
required by the workload. Do not use `main`, `--local-dir`, or deprecated
`hf_transfer`; do not have compute jobs warm the cache themselves.
3. Stop writes to the selected snapshot. As the actual reader UID, in the actual
workload mount context, run `python3 scripts/validation/validate_model_cache.py`
3. Stop writes to the selected snapshot. Use a DeepOps checkout on the reader node
(or inside the workload container) with `scripts/validation/validate_model_cache.py`
readable and its parent directories traversable by the consumer UID.
From that checkout's root, as the actual reader UID in the actual workload
mount context, run `python3 scripts/validation/validate_model_cache.py`
with `--json`, `--cache-dir`, `--repo-id`, `--revision`, and one `--require-file`
per needed file. The guide has a complete command for the public example.
4. Accept only exit `0` **and** `ok: true`. Record revision, `checked_files` and
Expand Down
5 changes: 4 additions & 1 deletion skills/serve-model/SKILL.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,10 @@ description: Use when serving a cached model on one GPU with vLLM, checking a lo

# Serve a model on one node

Run from the repository root on the allocated serving node. Read the
Use a DeepOps checkout on the allocated serving node (or inside the workload
container) with `scripts/validation/validate_model_cache.py` and
`scripts/validation/validate_vllm.py` readable and their parent directories
traversable by the consumer UID; run from that checkout's root. Read the
[vLLM quickstart](../../docs/model-workflows/vllm-quickstart.md) for the exact
installation and foreground launch commands. This skill does not allocate a GPU
or authorize a workload.
Expand Down
Loading