runpod-usage
Explain Runpod architecture and design choices: Pods versus Serverless, GPU/VRAM, image construction, storage, networking, and workload development. For creating or improving a complete template project use runpod-build-template; execute infrastructure with runpodctl/runpod-mcp and code-first work with runpod-flash.
- License 许可
- Apache-2.0
- 最近更新
- 2026-11-10
- Stars
- ★ 49
- Forks
- 10
01 前言 Front Matter
- name
- runpod-usage
- license
- Apache-2.0
- metadata
- { "author": "runpod", "version": "2.0.0", "concepts": [ "pod", "serverless-endpoint", "network-volume", "container-disk", "pod-volume-disk", "gpu-type", "exposed-port", "worker" ] }
- description
- Explain Runpod architecture and design choices: Pods versus Serverless, GPU/VRAM, image construction, storage, networking, and workload development. For creating or improving a complete template project use runpod-build-template; execute infrastructure with runpodctl/runpod-mcp and code-first work with runpod-flash.
02 资源文件 77
- 参考文档concepts/api-key.yaml2.7 KB
- 参考文档concepts/api-rate-limit.yaml2.5 KB
- 参考文档concepts/audit-log.yaml2.7 KB
- 参考文档concepts/billing-record.yaml4.9 KB
- 参考文档concepts/cloud-tier.yaml3.1 KB
- 参考文档concepts/container-disk.yaml3.2 KB
- 参考文档concepts/container-image.yaml4.2 KB
- 参考文档concepts/cpu-flavor.yaml3.6 KB
- 参考文档concepts/cpu-pod.yaml2.3 KB
- 参考文档concepts/credit-balance.yaml3.1 KB
- 参考文档concepts/data-center.yaml4.6 KB
- 参考文档concepts/endpoint-autoscaling.yaml5.8 KB
- 参考文档concepts/endpoint-build.yaml6.8 KB
- 参考文档concepts/endpoint-release.yaml3.4 KB
- 参考文档concepts/exposed-port.yaml5.2 KB
- 参考文档concepts/file-transfer.yaml3.9 KB
- 参考文档concepts/flash.yaml18.0 KB
- 参考文档concepts/flashboot.yaml2.4 KB
- 参考文档concepts/global-networking.yaml2.4 KB
- 参考文档concepts/global-volume.yaml7.4 KB
- 参考文档concepts/gpu-availability.yaml2.9 KB
- 参考文档concepts/gpu-pool.yaml2.0 KB
- 参考文档concepts/gpu-type.yaml4.2 KB
- 参考文档concepts/hub-repo.yaml4.7 KB
- 参考文档concepts/instant-cluster.yaml6.4 KB
- 参考文档concepts/job.yaml7.1 KB
- 参考文档concepts/log-stream.yaml2.3 KB
- 参考文档concepts/machine.yaml3.2 KB
- 参考文档concepts/model-store.yaml7.7 KB
- 参考文档concepts/network-volume-billing.yaml2.3 KB
- 参考文档concepts/network-volume.yaml8.9 KB
- 参考文档concepts/organization.yaml2.0 KB
- 参考文档concepts/pod-billing.yaml3.4 KB
- 参考文档concepts/pod-command-exec.yaml1.3 KB
- 参考文档concepts/pod-deployment.yaml6.7 KB
- 参考文档concepts/pod-migration.yaml1.9 KB
- 参考文档concepts/pod-ssh-access.yaml3.1 KB
- 参考文档concepts/pod-volume-disk.yaml5.8 KB
- 参考文档concepts/pod.yaml17.8 KB
- 参考文档concepts/public-endpoint.yaml2.3 KB
- 参考文档concepts/README.md8.5 KB
- 参考文档concepts/registry-credential.yaml2.8 KB
- 参考文档concepts/reservation-pool.yaml988 B
- 参考文档concepts/runpod-platform.yaml2.0 KB
- 参考文档concepts/runpod-secret.yaml4.4 KB
- 参考文档concepts/runpodctl.yaml5.5 KB
- 参考文档concepts/savings-plan.yaml1.8 KB
- 参考文档concepts/serverless-billing.yaml4.1 KB
- 参考文档concepts/serverless-endpoint.yaml14.9 KB
- 参考文档concepts/serverless-handler.yaml3.2 KB
- 参考文档concepts/spot-pod.yaml1.9 KB
- 参考文档concepts/ssh-key.yaml1.5 KB
- 参考文档concepts/template.yaml8.4 KB
- 参考文档concepts/volume-cache.yaml10.6 KB
- 参考文档concepts/worker.yaml5.9 KB
- 参考文档evals/concept-lookup-restart.eval.md1.2 KB
- 参考文档evals/cpu-threads-vs-vcpus.eval.md1.1 KB
- 参考文档evals/cuda-floor-on-create.eval.md1.6 KB
- 参考文档evals/fast-disk-for-installs.eval.md1.5 KB
- 参考文档evals/image-guidance.eval.md2.5 KB
- 参考文档evals/pod-service-loop.eval.md1.4 KB
- 参考文档evals/verify-with-real-request.eval.md1.3 KB
- 参考文档reference/building-images.md10.8 KB
- 参考文档reference/concepts.md6.0 KB
- 参考文档reference/development-loop.md4.8 KB
- 参考文档reference/docker.md6.6 KB
- 参考文档reference/endpoint-builds-and-releases.md2.5 KB
- 参考文档reference/endpoint-workflows.md5.5 KB
- 参考文档reference/getting-started.md8.4 KB
- 参考文档reference/gotchas.md15.7 KB
- 参考文档reference/gpu-selection.md9.8 KB
- 参考文档reference/networking.md5.3 KB
- 参考文档reference/on-pod-setup.md4.2 KB
- 参考文档reference/pod-workflows.md6.8 KB
- 参考文档reference/pods-and-machines.md2.8 KB
- 参考文档reference/secrets.md1.9 KB
- 参考文档reference/storage.md12.3 KB
03 SKILL.md 正文
Runpod usage (concepts)
Background knowledge for making the right choice before you act. This skill runs nothing — once you know what to do, execute with runpod-mcp/runpodctl (infra), runpod-flash (your own code), or runpod-companion-clis (models/images/data).
This skill explains; the golden paths demonstrate. When the question is really "how do I do X" rather than "how does X work", the verified end-to-end example is the faster answer — runpod/golden-paths/README.md. Read the concept here, then follow the path.
To author files for a custom template, use runpod-build-template; this lane supplies the shared concepts, not a competing packaging workflow.
Read the one reference file that matches the question:
| Question | Read |
|---|---|
First-run setup / auth — get + set RUNPOD_API_KEY, SSH, companion creds |
reference/getting-started.md |
| Pods vs serverless, workers, cold starts, FlashBoot, queue vs load-balanced | reference/concepts.md |
| The development loop for ANY workload (start here) — plan → prefer prebuilt → provision → verify → teardown | reference/development-loop.md |
| Stand up / iterate a workload on a pod — the pod sub-loop | reference/pod-workflows.md |
| Deploy / iterate a serverless endpoint — Hub vs flash vs custom, invoke + verify | reference/endpoint-workflows.md |
Install software on a pod — package hygiene, uv, non-interactive, caching |
reference/on-pod-setup.md |
Build a Docker image Runpod can run (handler contract, Dockerfile, --platform=linux/amd64) |
reference/docker.md |
| How to build an image well — base image, layering, bake-in vs volume, pod vs serverless (queue/LB) contract | reference/building-images.md |
| Where data lives — container disk vs network volume, model caching, S3 access | reference/storage.md |
| Which GPU / how much VRAM / which CUDA version / cost & availability / data centers | reference/gpu-selection.md |
| Why a stopped pod may not restart with a GPU — pods are bound to one machine; what else is per machine | reference/pods-and-machines.md |
| Endpoint releases, rolling updates, version overlap, GitHub builds | reference/endpoint-builds-and-releases.md |
| Storing API tokens and keys as secrets and referencing them from env vars | reference/secrets.md |
| Reaching a pod or endpoint over HTTP (proxy URLs, exposed ports) | reference/networking.md |
| Common mistakes and how to avoid them | reference/gotchas.md |
Exact facts: the concept files
The reference files explain. For a precise fact, or a rule an action must satisfy, read
the concept files in concepts/ next to this file. There is one YAML file per concept
(pod.yaml, network-volume.yaml, machine.yaml, …), each with its fields, states,
relations and rules, and every rule cites the public source it comes from.
grep -il "volume disk" concepts/*.yaml # find the concept by name or alias
grep -n "statement:" concepts/pod-volume-disk.yaml
rules[].statementis the fact.see:points at related rules on other concepts.- A rule with
conflict: truerecords two public sources that disagree. Give both readings. - A
kind: processfile explains a flow step by step.pod-deployment.yamlcovers deploy, stop and restart, including why a restart can fail while the data center has stock.
04 同仓库更多 Skills
runpod-vllm
Serve a Hugging Face model with vLLM on Runpod (Hub worker-vllm queue endpoint, load-balancing endpoint on a vllm/vllm-openai image, or a Pod), sized, CUDA-pinned and verified with a real OpenAI client. Use for any "deploy/serve/test this LLM with vLLM" request or a vLLM deployment that will not boot; defer to runpod-serverless-deploy for non-vLLM engines and runpod-endpoint-ops for an endpoint that already works.
runpodctl
Runpod CLI for managing GPU/CPU workloads from the terminal — pods, serverless endpoints, templates, network volumes, Hub deploys, models, SSH, and file transfer (send/receive, network-volume upload/download). Use for terminal/CI/scripting, SSH setup, `doctor`, or when the Runpod MCP tools are not connected; prefer runpod-mcp for structured tool calls in an MCP-enabled session.
runpod
Start here when the Runpod lane is unclear: picks the skill for a task (runpod-mcp and the journey playbooks it routes to, such as runpod-serverless-deploy, runpod-pod-deploy, runpod-pod-doctor and runpod-cost-audit; runpodctl, runpod-flash, runpod-companion-clis, runpod-usage, runpod-templates, runpod-build-template, runpod-migrate) and indexes two dozen end-to-end worked examples (golden paths). Use it before any multi-step or provisioning task, even when the lane is clear, to check for a matching golden path; for the Runpod MCP tools, runpod-mcp owns the answer contract, connection and tool rules.
runpod-templates
Find, use, and troubleshoot official Runpod Pod templates, including ComfyUI workflow model metadata repair. For creating or optimizing Dockerfiles and application template projects use runpod-build-template; deploy through runpod-mcp or runpodctl.
runpod-serverless-deploy
Bring any source (a HuggingFace repo, a ComfyUI workflow, a Hub release, a custom container image, a GGUF repo, a Civitai asset, or a community template) to a proven Runpod Serverless endpoint: pick the engine for the modality and model format, size the GPU from the model's real metadata, provision, warm, prove it with one real job, and hand back the URL with what it bills. Deploys an existing source through the Runpod MCP tools; code-first Python deploys (the Flash dev loop) are out of scope. Use when the user wants a model or worker served on Runpod Serverless, whatever the modality: text generation, speech-to-text or text-to-speech, image or video generation, embeddings, document processing, or their own handler image. For an LLM served with vLLM (Hub worker-vllm, a vllm/vllm-openai image, or a vLLM Pod), defer to runpod-vllm.
runpod-pod-doctor
Diagnose a Runpod Pod that is unreachable, GPU-blind or stuck, and perform a recovery action only when the user authorizes one. Use when an existing Pod misbehaves, through the Runpod MCP tools: its proxy URL answers 502, CUDA is not available inside the container, a restarted Pod has no GPU, the user wants a Pod's logs read, an account-wide check for stuck Pods, or the stop-versus-terminate decision for a Pod they already have. Read-only until the user asks for an action.