AGENT SKILL

runpod-usage

Explain Runpod architecture and design choices: Pods versus Serverless, GPU/VRAM, image construction, storage, networking, and workload development. For creating or improving a complete template project use runpod-build-template; execute infrastructure with runpodctl/runpod-mcp and code-first work with runpod-flash.

License 许可
Apache-2.0
最近更新
2026-11-10
Stars
★ 49
Forks
10

01 前言 Front Matter

name
runpod-usage
license
Apache-2.0
metadata
{ "author": "runpod", "version": "2.0.0", "concepts": [ "pod", "serverless-endpoint", "network-volume", "container-disk", "pod-volume-disk", "gpu-type", "exposed-port", "worker" ] }
description
Explain Runpod architecture and design choices: Pods versus Serverless, GPU/VRAM, image construction, storage, networking, and workload development. For creating or improving a complete template project use runpod-build-template; execute infrastructure with runpodctl/runpod-mcp and code-first work with runpod-flash.

02 资源文件 77

03 SKILL.md 正文

Runpod usage (concepts)

Background knowledge for making the right choice before you act. This skill runs nothing — once you know what to do, execute with runpod-mcp/runpodctl (infra), runpod-flash (your own code), or runpod-companion-clis (models/images/data).

This skill explains; the golden paths demonstrate. When the question is really "how do I do X" rather than "how does X work", the verified end-to-end example is the faster answer — runpod/golden-paths/README.md. Read the concept here, then follow the path.

To author files for a custom template, use runpod-build-template; this lane supplies the shared concepts, not a competing packaging workflow.

Read the one reference file that matches the question:

Question Read
First-run setup / auth — get + set RUNPOD_API_KEY, SSH, companion creds reference/getting-started.md
Pods vs serverless, workers, cold starts, FlashBoot, queue vs load-balanced reference/concepts.md
The development loop for ANY workload (start here) — plan → prefer prebuilt → provision → verify → teardown reference/development-loop.md
Stand up / iterate a workload on a pod — the pod sub-loop reference/pod-workflows.md
Deploy / iterate a serverless endpoint — Hub vs flash vs custom, invoke + verify reference/endpoint-workflows.md
Install software on a pod — package hygiene, uv, non-interactive, caching reference/on-pod-setup.md
Build a Docker image Runpod can run (handler contract, Dockerfile, --platform=linux/amd64) reference/docker.md
How to build an image well — base image, layering, bake-in vs volume, pod vs serverless (queue/LB) contract reference/building-images.md
Where data lives — container disk vs network volume, model caching, S3 access reference/storage.md
Which GPU / how much VRAM / which CUDA version / cost & availability / data centers reference/gpu-selection.md
Why a stopped pod may not restart with a GPU — pods are bound to one machine; what else is per machine reference/pods-and-machines.md
Endpoint releases, rolling updates, version overlap, GitHub builds reference/endpoint-builds-and-releases.md
Storing API tokens and keys as secrets and referencing them from env vars reference/secrets.md
Reaching a pod or endpoint over HTTP (proxy URLs, exposed ports) reference/networking.md
Common mistakes and how to avoid them reference/gotchas.md

Exact facts: the concept files

The reference files explain. For a precise fact, or a rule an action must satisfy, read the concept files in concepts/ next to this file. There is one YAML file per concept (pod.yaml, network-volume.yaml, machine.yaml, …), each with its fields, states, relations and rules, and every rule cites the public source it comes from.

grep -il "volume disk" concepts/*.yaml    # find the concept by name or alias
grep -n "statement:" concepts/pod-volume-disk.yaml
  • rules[].statement is the fact. see: points at related rules on other concepts.
  • A rule with conflict: true records two public sources that disagree. Give both readings.
  • A kind: process file explains a flow step by step. pod-deployment.yaml covers deploy, stop and restart, including why a restart can fail while the data center has stock.

04 同仓库更多 Skills

runpod
runpod/runpod-plugins-official

runpod-vllm

Serve a Hugging Face model with vLLM on Runpod (Hub worker-vllm queue endpoint, load-balancing endpoint on a vllm/vllm-openai image, or a Pod), sized, CUDA-pinned and verified with a real OpenAI client. Use for any "deploy/serve/test this LLM with vLLM" request or a vLLM deployment that will not boot; defer to runpod-serverless-deploy for non-vLLM engines and runpod-endpoint-ops for an endpoint that already works.

运维与部署图像与多媒体
★ 49
runpod
runpod/runpod-plugins-official

runpodctl

Runpod CLI for managing GPU/CPU workloads from the terminal — pods, serverless endpoints, templates, network volumes, Hub deploys, models, SSH, and file transfer (send/receive, network-volume upload/download). Use for terminal/CI/scripting, SSH setup, `doctor`, or when the Runpod MCP tools are not connected; prefer runpod-mcp for structured tool calls in an MCP-enabled session.

Skill与智能体开发
★ 49
runpod
runpod/runpod-plugins-official

runpod

Start here when the Runpod lane is unclear: picks the skill for a task (runpod-mcp and the journey playbooks it routes to, such as runpod-serverless-deploy, runpod-pod-deploy, runpod-pod-doctor and runpod-cost-audit; runpodctl, runpod-flash, runpod-companion-clis, runpod-usage, runpod-templates, runpod-build-template, runpod-migrate) and indexes two dozen end-to-end worked examples (golden paths). Use it before any multi-step or provisioning task, even when the lane is clear, to check for a matching golden path; for the Runpod MCP tools, runpod-mcp owns the answer contract, connection and tool rules.

Skill与智能体开发
★ 49
runpod
runpod/runpod-plugins-official

runpod-templates

Find, use, and troubleshoot official Runpod Pod templates, including ComfyUI workflow model metadata repair. For creating or optimizing Dockerfiles and application template projects use runpod-build-template; deploy through runpod-mcp or runpodctl.

Skill与智能体开发
★ 49
runpod
runpod/runpod-plugins-official

runpod-serverless-deploy

Bring any source (a HuggingFace repo, a ComfyUI workflow, a Hub release, a custom container image, a GGUF repo, a Civitai asset, or a community template) to a proven Runpod Serverless endpoint: pick the engine for the modality and model format, size the GPU from the model's real metadata, provision, warm, prove it with one real job, and hand back the URL with what it bills. Deploys an existing source through the Runpod MCP tools; code-first Python deploys (the Flash dev loop) are out of scope. Use when the user wants a model or worker served on Runpod Serverless, whatever the modality: text generation, speech-to-text or text-to-speech, image or video generation, embeddings, document processing, or their own handler image. For an LLM served with vLLM (Hub worker-vllm, a vllm/vllm-openai image, or a vLLM Pod), defer to runpod-vllm.

运维与部署图像与多媒体
★ 49
runpod
runpod/runpod-plugins-official

runpod-pod-doctor

Diagnose a Runpod Pod that is unreachable, GPU-blind or stuck, and perform a recovery action only when the user authorizes one. Use when an existing Pod misbehaves, through the Runpod MCP tools: its proxy URL answers 502, CUDA is not available inside the container, a restarted Pod has no GPU, the user wants a Pod's logs read, an account-wide check for stuck Pods, or the stop-versus-terminate decision for a Pod they already have. Read-only until the user asks for an action.

Skill与智能体开发
★ 49