[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M6QNHGZ9YB65QW0FMDDSQT7Z":3,"skill-same:01M6QNHGZ9YB65QW0FMDDSQT7Z":88},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":39,"linkOnly":40,"markdownContent":41,"markdownBody":42,"frontMatter":43,"refName":55,"commitSha":56,"skillDirectory":57,"forksCount":14,"repositoryHtmlUrl":58,"repositoryHomepageUrl":59,"ownerHtmlUrl":60,"ownerBlogUrl":61,"ownerDescription":62,"updatedAt":63,"install":64,"resources":77},"01M6QNHGZ9YB65QW0FMDDSQT7Z","skypilot-multi-cloud-orchestration",null,"Multi-cloud orchestration for ML workloads with automatic cost optimization. Use when you need to run training or batch jobs across multiple clouds, leverage spot instances with auto-recovery, or optimize GPU costs across providers.","Tashima-Tarsh\u002FDisha6.6","Tashima-Tarsh","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F269906498?v=4","01M6PBH98X03XERH0HFT4PFB1P","NITISH KUMAR","01M6PBH9DA0M6KM3Z12P848F0K",0,"MIT","https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fqc-skypilot\u002FSKILL.md",[],[19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38],"multi","cloud","multi cloud","skypilot multi cloud orchestration","orchestration","SkyPilot","cost","automatic","for","you","leverage","instances","auto","use","multi-cloud","batch","run","training","infrastructure","cost optimization","2026-11-10 10:12:30",false,"---\nname: skypilot-multi-cloud-orchestration\ndescription: Multi-cloud orchestration for ML workloads with automatic cost optimization. Use when you need to run training or batch jobs across multiple clouds, leverage spot instances with auto-recovery, or optimize GPU costs across providers.\nversion: 1.0.0\nauthor: Orchestra Research\nlicense: MIT\ntags: [Infrastructure, Multi-Cloud, Orchestration, GPU, Cost Optimization, SkyPilot]\ndependencies: [skypilot>=0.7.0]\ncategory: \"ai-research\"\n---\n\n# SkyPilot Multi-Cloud Orchestration\n\nComprehensive guide to running ML workloads across clouds with automatic cost optimization using SkyPilot.\n\n## When to use SkyPilot\n\n**Use SkyPilot when:**\n- Running ML workloads across multiple clouds (AWS, GCP, Azure, etc.)\n- Need cost optimization with automatic cloud\u002Fregion selection\n- Running long jobs on spot instances with auto-recovery\n- Managing distributed multi-node training\n- Want unified interface for 20+ cloud providers\n- Need to avoid vendor lock-in\n\n**Key features:**\n- **Multi-cloud**: AWS, GCP, Azure, Kubernetes, Lambda, RunPod, 20+ providers\n- **Cost optimization**: Automatic cheapest cloud\u002Fregion selection\n- **Spot instances**: 3-6x cost savings with automatic recovery\n- **Distributed training**: Multi-node jobs with gang scheduling\n- **Managed jobs**: Auto-recovery, checkpointing, fault tolerance\n- **Sky Serve**: Model serving with autoscaling\n\n**Use alternatives instead:**\n- **Modal**: For simpler serverless GPU with Python-native API\n- **RunPod**: For single-cloud persistent pods\n- **Kubernetes**: For existing K8s infrastructure\n- **Ray**: For pure Ray-based orchestration\n\n## Quick start\n\n### Installation\n\n```bash\npip install \"skypilot[aws,gcp,azure,kubernetes]\"\n\n# Verify cloud credentials\nsky check\n```\n\n### Hello World\n\nCreate `hello.yaml`:\n```yaml\nresources:\n  accelerators: T4:1\n\nrun: |\n  nvidia-smi\n  echo \"Hello from SkyPilot!\"\n```\n\nLaunch:\n```bash\nsky launch -c hello hello.yaml\n\n# SSH to cluster\nssh hello\n\n# Terminate\nsky down hello\n```\n\n## Core concepts\n\n### Task YAML structure\n\n```yaml\n# Task name (optional)\nname: my-task\n\n# Resource requirements\nresources:\n  cloud: aws              # Optional: auto-select if omitted\n  region: us-west-2       # Optional: auto-select if omitted\n  accelerators: A100:4    # GPU type and count\n  cpus: 8+                # Minimum CPUs\n  memory: 32+             # Minimum memory (GB)\n  use_spot: true          # Use spot instances\n  disk_size: 256          # Disk size (GB)\n\n# Number of nodes for distributed training\nnum_nodes: 2\n\n# Working directory (synced to ~\u002Fsky_workdir)\nworkdir: .\n\n# Setup commands (run once)\nsetup: |\n  pip install -r requirements.txt\n\n# Run commands\nrun: |\n  python train.py\n```\n\n### Key commands\n\n| Command | Purpose |\n|---------|---------|\n| `sky launch` | Launch cluster and run task |\n| `sky exec` | Run task on existing cluster |\n| `sky status` | Show cluster status |\n| `sky stop` | Stop cluster (preserve state) |\n| `sky down` | Terminate cluster |\n| `sky logs` | View task logs |\n| `sky queue` | Show job queue |\n| `sky jobs launch` | Launch managed job |\n| `sky serve up` | Deploy serving endpoint |\n\n## GPU configuration\n\n### Available accelerators\n\n```yaml\n# NVIDIA GPUs\naccelerators: T4:1\naccelerators: L4:1\naccelerators: A10G:1\naccelerators: L40S:1\naccelerators: A100:4\naccelerators: A100-80GB:8\naccelerators: H100:8\n\n# Cloud-specific\naccelerators: V100:4         # AWS\u002FGCP\naccelerators: TPU-v4-8       # GCP TPUs\n```\n\n### GPU fallbacks\n\n```yaml\nresources:\n  accelerators:\n    H100: 8\n    A100-80GB: 8\n    A100: 8\n  any_of:\n    - cloud: gcp\n    - cloud: aws\n    - cloud: azure\n```\n\n### Spot instances\n\n```yaml\nresources:\n  accelerators: A100:8\n  use_spot: true\n  spot_recovery: FAILOVER  # Auto-recover on preemption\n```\n\n## Cluster management\n\n### Launch and execute\n\n```bash\n# Launch new cluster\nsky launch -c mycluster task.yaml\n\n# Run on existing cluster (skip setup)\nsky exec mycluster another_task.yaml\n\n# Interactive SSH\nssh mycluster\n\n# Stream logs\nsky logs mycluster\n```\n\n### Autostop\n\n```yaml\nresources:\n  accelerators: A100:4\n  autostop:\n    idle_minutes: 30\n    down: true  # Terminate instead of stop\n```\n\n```bash\n# Set autostop via CLI\nsky autostop mycluster -i 30 --down\n```\n\n### Cluster status\n\n```bash\n# All clusters\nsky status\n\n# Detailed view\nsky status -a\n```\n\n## Distributed training\n\n### Multi-node setup\n\n```yaml\nresources:\n  accelerators: A100:8\n\nnum_nodes: 4  # 4 nodes × 8 GPUs = 32 GPUs total\n\nsetup: |\n  pip install torch torchvision\n\nrun: |\n  torchrun \\\n    --nnodes=$SKYPILOT_NUM_NODES \\\n    --nproc_per_node=$SKYPILOT_NUM_GPUS_PER_NODE \\\n    --node_rank=$SKYPILOT_NODE_RANK \\\n    --master_addr=$(echo \"$SKYPILOT_NODE_IPS\" | head -n1) \\\n    --master_port=12355 \\\n    train.py\n```\n\n### Environment variables\n\n| Variable | Description |\n|----------|-------------|\n| `SKYPILOT_NODE_RANK` | Node index (0 to num_nodes-1) |\n| `SKYPILOT_NODE_IPS` | Newline-separated IP addresses |\n| `SKYPILOT_NUM_NODES` | Total number of nodes |\n| `SKYPILOT_NUM_GPUS_PER_NODE` | GPUs per node |\n\n### Head-node-only execution\n\n```bash\nrun: |\n  if [ \"${SKYPILOT_NODE_RANK}\" == \"0\" ]; then\n    python orchestrate.py\n  fi\n```\n\n## Managed jobs\n\n### Spot recovery\n\n```bash\n# Launch managed job with spot recovery\nsky jobs launch -n my-job train.yaml\n```\n\n### Checkpointing\n\n```yaml\nname: training-job\n\nfile_mounts:\n  \u002Fcheckpoints:\n    name: my-checkpoints\n    store: s3\n    mode: MOUNT\n\nresources:\n  accelerators: A100:8\n  use_spot: true\n\nrun: |\n  python train.py \\\n    --checkpoint-dir \u002Fcheckpoints \\\n    --resume-from-latest\n```\n\n### Job management\n\n```bash\n# List jobs\nsky jobs queue\n\n# View logs\nsky jobs logs my-job\n\n# Cancel job\nsky jobs cancel my-job\n```\n\n## File mounts and storage\n\n### Local file sync\n\n```yaml\nworkdir: .\u002Fmy-project  # Synced to ~\u002Fsky_workdir\n\nfile_mounts:\n  \u002Fdata\u002Fconfig.yaml: .\u002Fconfig.yaml\n  ~\u002F.vimrc: ~\u002F.vimrc\n```\n\n### Cloud storage\n\n```yaml\nfile_mounts:\n  # Mount S3 bucket\n  \u002Fdatasets:\n    source: s3:\u002F\u002Fmy-bucket\u002Fdatasets\n    mode: MOUNT  # Stream from S3\n\n  # Copy GCS bucket\n  \u002Fmodels:\n    source: gs:\u002F\u002Fmy-bucket\u002Fmodels\n    mode: COPY  # Pre-fetch to disk\n\n  # Cached mount (fast writes)\n  \u002Foutputs:\n    name: my-outputs\n    store: s3\n    mode: MOUNT_CACHED\n```\n\n### Storage modes\n\n| Mode | Description | Best For |\n|------|-------------|----------|\n| `MOUNT` | Stream from cloud | Large datasets, read-heavy |\n| `COPY` | Pre-fetch to disk | Small files, random access |\n| `MOUNT_CACHED` | Cache with async upload | Checkpoints, outputs |\n\n## Sky Serve (Model Serving)\n\n### Basic service\n\n```yaml\n# service.yaml\nservice:\n  readiness_probe: \u002Fhealth\n  replica_policy:\n    min_replicas: 1\n    max_replicas: 10\n    target_qps_per_replica: 2.0\n\nresources:\n  accelerators: A100:1\n\nrun: |\n  python -m vllm.entrypoints.openai.api_server \\\n    --model meta-llama\u002FLlama-2-7b-chat-hf \\\n    --port 8000\n```\n\n```bash\n# Deploy\nsky serve up -n my-service service.yaml\n\n# Check status\nsky serve status\n\n# Get endpoint\nsky serve status my-service\n```\n\n### Autoscaling policies\n\n```yaml\nservice:\n  replica_policy:\n    min_replicas: 1\n    max_replicas: 10\n    target_qps_per_replica: 2.0\n    upscale_delay_seconds: 60\n    downscale_delay_seconds: 300\n  load_balancing_policy: round_robin\n```\n\n## Cost optimization\n\n### Automatic cloud selection\n\n```yaml\n# SkyPilot finds cheapest option\nresources:\n  accelerators: A100:8\n  # No cloud specified - auto-select cheapest\n```\n\n```bash\n# Show optimizer decision\nsky launch task.yaml --dryrun\n```\n\n### Cloud preferences\n\n```yaml\nresources:\n  accelerators: A100:8\n  any_of:\n    - cloud: gcp\n      region: us-central1\n    - cloud: aws\n      region: us-east-1\n    - cloud: azure\n```\n\n### Environment variables\n\n```yaml\nenvs:\n  HF_TOKEN: $HF_TOKEN  # Inherited from local env\n  WANDB_API_KEY: $WANDB_API_KEY\n\n# Or use secrets\nsecrets:\n  - HF_TOKEN\n  - WANDB_API_KEY\n```\n\n## Common workflows\n\n### Workflow 1: Fine-tuning with checkpoints\n\n```yaml\nname: llm-finetune\n\nfile_mounts:\n  \u002Fcheckpoints:\n    name: finetune-checkpoints\n    store: s3\n    mode: MOUNT_CACHED\n\nresources:\n  accelerators: A100:8\n  use_spot: true\n\nsetup: |\n  pip install transformers accelerate\n\nrun: |\n  python train.py \\\n    --checkpoint-dir \u002Fcheckpoints \\\n    --resume\n```\n\n### Workflow 2: Hyperparameter sweep\n\n```yaml\nname: hp-sweep-${RUN_ID}\n\nenvs:\n  RUN_ID: 0\n  LEARNING_RATE: 1e-4\n  BATCH_SIZE: 32\n\nresources:\n  accelerators: A100:1\n  use_spot: true\n\nrun: |\n  python train.py \\\n    --lr $LEARNING_RATE \\\n    --batch-size $BATCH_SIZE \\\n    --run-id $RUN_ID\n```\n\n```bash\n# Launch multiple jobs\nfor i in {1..10}; do\n  sky jobs launch sweep.yaml \\\n    --env RUN_ID=$i \\\n    --env LEARNING_RATE=$(python -c \"import random; print(10**random.uniform(-5,-3))\")\ndone\n```\n\n## Debugging\n\n```bash\n# SSH to cluster\nssh mycluster\n\n# View logs\nsky logs mycluster\n\n# Check job queue\nsky queue mycluster\n\n# View managed job logs\nsky jobs logs my-job\n```\n\n## Common issues\n\n| Issue | Solution |\n|-------|----------|\n| Quota exceeded | Request quota increase, try different region |\n| Spot preemption | Use `sky jobs launch` for auto-recovery |\n| Slow file sync | Use `MOUNT_CACHED` mode for outputs |\n| GPU not available | Use `any_of` for fallback clouds |\n\n## References\n\n- **[Advanced Usage](references\u002Fadvanced-usage.md)** - Multi-cloud, optimization, production patterns\n- **[Troubleshooting](references\u002Ftroubleshooting.md)** - Common issues and solutions\n\n## Resources\n\n- **Documentation**: https:\u002F\u002Fdocs.skypilot.co\n- **GitHub**: https:\u002F\u002Fgithub.com\u002Fskypilot-org\u002Fskypilot\n- **Slack**: https:\u002F\u002Fslack.skypilot.co\n- **Examples**: https:\u002F\u002Fgithub.com\u002Fskypilot-org\u002Fskypilot\u002Ftree\u002Fmaster\u002Fexamples\n","# SkyPilot Multi-Cloud Orchestration\n\nComprehensive guide to running ML workloads across clouds with automatic cost optimization using SkyPilot.\n\n## When to use SkyPilot\n\n**Use SkyPilot when:**\n- Running ML workloads across multiple clouds (AWS, GCP, Azure, etc.)\n- Need cost optimization with automatic cloud\u002Fregion selection\n- Running long jobs on spot instances with auto-recovery\n- Managing distributed multi-node training\n- Want unified interface for 20+ cloud providers\n- Need to avoid vendor lock-in\n\n**Key features:**\n- **Multi-cloud**: AWS, GCP, Azure, Kubernetes, Lambda, RunPod, 20+ providers\n- **Cost optimization**: Automatic cheapest cloud\u002Fregion selection\n- **Spot instances**: 3-6x cost savings with automatic recovery\n- **Distributed training**: Multi-node jobs with gang scheduling\n- **Managed jobs**: Auto-recovery, checkpointing, fault tolerance\n- **Sky Serve**: Model serving with autoscaling\n\n**Use alternatives instead:**\n- **Modal**: For simpler serverless GPU with Python-native API\n- **RunPod**: For single-cloud persistent pods\n- **Kubernetes**: For existing K8s infrastructure\n- **Ray**: For pure Ray-based orchestration\n\n## Quick start\n\n### Installation\n\n```bash\npip install \"skypilot[aws,gcp,azure,kubernetes]\"\n\n# Verify cloud credentials\nsky check\n```\n\n### Hello World\n\nCreate `hello.yaml`:\n```yaml\nresources:\n  accelerators: T4:1\n\nrun: |\n  nvidia-smi\n  echo \"Hello from SkyPilot!\"\n```\n\nLaunch:\n```bash\nsky launch -c hello hello.yaml\n\n# SSH to cluster\nssh hello\n\n# Terminate\nsky down hello\n```\n\n## Core concepts\n\n### Task YAML structure\n\n```yaml\n# Task name (optional)\nname: my-task\n\n# Resource requirements\nresources:\n  cloud: aws              # Optional: auto-select if omitted\n  region: us-west-2       # Optional: auto-select if omitted\n  accelerators: A100:4    # GPU type and count\n  cpus: 8+                # Minimum CPUs\n  memory: 32+             # Minimum memory (GB)\n  use_spot: true          # Use spot instances\n  disk_size: 256          # Disk size (GB)\n\n# Number of nodes for distributed training\nnum_nodes: 2\n\n# Working directory (synced to ~\u002Fsky_workdir)\nworkdir: .\n\n# Setup commands (run once)\nsetup: |\n  pip install -r requirements.txt\n\n# Run commands\nrun: |\n  python train.py\n```\n\n### Key commands\n\n| Command | Purpose |\n|---------|---------|\n| `sky launch` | Launch cluster and run task |\n| `sky exec` | Run task on existing cluster |\n| `sky status` | Show cluster status |\n| `sky stop` | Stop cluster (preserve state) |\n| `sky down` | Terminate cluster |\n| `sky logs` | View task logs |\n| `sky queue` | Show job queue |\n| `sky jobs launch` | Launch managed job |\n| `sky serve up` | Deploy serving endpoint |\n\n## GPU configuration\n\n### Available accelerators\n\n```yaml\n# NVIDIA GPUs\naccelerators: T4:1\naccelerators: L4:1\naccelerators: A10G:1\naccelerators: L40S:1\naccelerators: A100:4\naccelerators: A100-80GB:8\naccelerators: H100:8\n\n# Cloud-specific\naccelerators: V100:4         # AWS\u002FGCP\naccelerators: TPU-v4-8       # GCP TPUs\n```\n\n### GPU fallbacks\n\n```yaml\nresources:\n  accelerators:\n    H100: 8\n    A100-80GB: 8\n    A100: 8\n  any_of:\n    - cloud: gcp\n    - cloud: aws\n    - cloud: azure\n```\n\n### Spot instances\n\n```yaml\nresources:\n  accelerators: A100:8\n  use_spot: true\n  spot_recovery: FAILOVER  # Auto-recover on preemption\n```\n\n## Cluster management\n\n### Launch and execute\n\n```bash\n# Launch new cluster\nsky launch -c mycluster task.yaml\n\n# Run on existing cluster (skip setup)\nsky exec mycluster another_task.yaml\n\n# Interactive SSH\nssh mycluster\n\n# Stream logs\nsky logs mycluster\n```\n\n### Autostop\n\n```yaml\nresources:\n  accelerators: A100:4\n  autostop:\n    idle_minutes: 30\n    down: true  # Terminate instead of stop\n```\n\n```bash\n# Set autostop via CLI\nsky autostop mycluster -i 30 --down\n```\n\n### Cluster status\n\n```bash\n# All clusters\nsky status\n\n# Detailed view\nsky status -a\n```\n\n## Distributed training\n\n### Multi-node setup\n\n```yaml\nresources:\n  accelerators: A100:8\n\nnum_nodes: 4  # 4 nodes × 8 GPUs = 32 GPUs total\n\nsetup: |\n  pip install torch torchvision\n\nrun: |\n  torchrun \\\n    --nnodes=$SKYPILOT_NUM_NODES \\\n    --nproc_per_node=$SKYPILOT_NUM_GPUS_PER_NODE \\\n    --node_rank=$SKYPILOT_NODE_RANK \\\n    --master_addr=$(echo \"$SKYPILOT_NODE_IPS\" | head -n1) \\\n    --master_port=12355 \\\n    train.py\n```\n\n### Environment variables\n\n| Variable | Description |\n|----------|-------------|\n| `SKYPILOT_NODE_RANK` | Node index (0 to num_nodes-1) |\n| `SKYPILOT_NODE_IPS` | Newline-separated IP addresses |\n| `SKYPILOT_NUM_NODES` | Total number of nodes |\n| `SKYPILOT_NUM_GPUS_PER_NODE` | GPUs per node |\n\n### Head-node-only execution\n\n```bash\nrun: |\n  if [ \"${SKYPILOT_NODE_RANK}\" == \"0\" ]; then\n    python orchestrate.py\n  fi\n```\n\n## Managed jobs\n\n### Spot recovery\n\n```bash\n# Launch managed job with spot recovery\nsky jobs launch -n my-job train.yaml\n```\n\n### Checkpointing\n\n```yaml\nname: training-job\n\nfile_mounts:\n  \u002Fcheckpoints:\n    name: my-checkpoints\n    store: s3\n    mode: MOUNT\n\nresources:\n  accelerators: A100:8\n  use_spot: true\n\nrun: |\n  python train.py \\\n    --checkpoint-dir \u002Fcheckpoints \\\n    --resume-from-latest\n```\n\n### Job management\n\n```bash\n# List jobs\nsky jobs queue\n\n# View logs\nsky jobs logs my-job\n\n# Cancel job\nsky jobs cancel my-job\n```\n\n## File mounts and storage\n\n### Local file sync\n\n```yaml\nworkdir: .\u002Fmy-project  # Synced to ~\u002Fsky_workdir\n\nfile_mounts:\n  \u002Fdata\u002Fconfig.yaml: .\u002Fconfig.yaml\n  ~\u002F.vimrc: ~\u002F.vimrc\n```\n\n### Cloud storage\n\n```yaml\nfile_mounts:\n  # Mount S3 bucket\n  \u002Fdatasets:\n    source: s3:\u002F\u002Fmy-bucket\u002Fdatasets\n    mode: MOUNT  # Stream from S3\n\n  # Copy GCS bucket\n  \u002Fmodels:\n    source: gs:\u002F\u002Fmy-bucket\u002Fmodels\n    mode: COPY  # Pre-fetch to disk\n\n  # Cached mount (fast writes)\n  \u002Foutputs:\n    name: my-outputs\n    store: s3\n    mode: MOUNT_CACHED\n```\n\n### Storage modes\n\n| Mode | Description | Best For |\n|------|-------------|----------|\n| `MOUNT` | Stream from cloud | Large datasets, read-heavy |\n| `COPY` | Pre-fetch to disk | Small files, random access |\n| `MOUNT_CACHED` | Cache with async upload | Checkpoints, outputs |\n\n## Sky Serve (Model Serving)\n\n### Basic service\n\n```yaml\n# service.yaml\nservice:\n  readiness_probe: \u002Fhealth\n  replica_policy:\n    min_replicas: 1\n    max_replicas: 10\n    target_qps_per_replica: 2.0\n\nresources:\n  accelerators: A100:1\n\nrun: |\n  python -m vllm.entrypoints.openai.api_server \\\n    --model meta-llama\u002FLlama-2-7b-chat-hf \\\n    --port 8000\n```\n\n```bash\n# Deploy\nsky serve up -n my-service service.yaml\n\n# Check status\nsky serve status\n\n# Get endpoint\nsky serve status my-service\n```\n\n### Autoscaling policies\n\n```yaml\nservice:\n  replica_policy:\n    min_replicas: 1\n    max_replicas: 10\n    target_qps_per_replica: 2.0\n    upscale_delay_seconds: 60\n    downscale_delay_seconds: 300\n  load_balancing_policy: round_robin\n```\n\n## Cost optimization\n\n### Automatic cloud selection\n\n```yaml\n# SkyPilot finds cheapest option\nresources:\n  accelerators: A100:8\n  # No cloud specified - auto-select cheapest\n```\n\n```bash\n# Show optimizer decision\nsky launch task.yaml --dryrun\n```\n\n### Cloud preferences\n\n```yaml\nresources:\n  accelerators: A100:8\n  any_of:\n    - cloud: gcp\n      region: us-central1\n    - cloud: aws\n      region: us-east-1\n    - cloud: azure\n```\n\n### Environment variables\n\n```yaml\nenvs:\n  HF_TOKEN: $HF_TOKEN  # Inherited from local env\n  WANDB_API_KEY: $WANDB_API_KEY\n\n# Or use secrets\nsecrets:\n  - HF_TOKEN\n  - WANDB_API_KEY\n```\n\n## Common workflows\n\n### Workflow 1: Fine-tuning with checkpoints\n\n```yaml\nname: llm-finetune\n\nfile_mounts:\n  \u002Fcheckpoints:\n    name: finetune-checkpoints\n    store: s3\n    mode: MOUNT_CACHED\n\nresources:\n  accelerators: A100:8\n  use_spot: true\n\nsetup: |\n  pip install transformers accelerate\n\nrun: |\n  python train.py \\\n    --checkpoint-dir \u002Fcheckpoints \\\n    --resume\n```\n\n### Workflow 2: Hyperparameter sweep\n\n```yaml\nname: hp-sweep-${RUN_ID}\n\nenvs:\n  RUN_ID: 0\n  LEARNING_RATE: 1e-4\n  BATCH_SIZE: 32\n\nresources:\n  accelerators: A100:1\n  use_spot: true\n\nrun: |\n  python train.py \\\n    --lr $LEARNING_RATE \\\n    --batch-size $BATCH_SIZE \\\n    --run-id $RUN_ID\n```\n\n```bash\n# Launch multiple jobs\nfor i in {1..10}; do\n  sky jobs launch sweep.yaml \\\n    --env RUN_ID=$i \\\n    --env LEARNING_RATE=$(python -c \"import random; print(10**random.uniform(-5,-3))\")\ndone\n```\n\n## Debugging\n\n```bash\n# SSH to cluster\nssh mycluster\n\n# View logs\nsky logs mycluster\n\n# Check job queue\nsky queue mycluster\n\n# View managed job logs\nsky jobs logs my-job\n```\n\n## Common issues\n\n| Issue | Solution |\n|-------|----------|\n| Quota exceeded | Request quota increase, try different region |\n| Spot preemption | Use `sky jobs launch` for auto-recovery |\n| Slow file sync | Use `MOUNT_CACHED` mode for outputs |\n| GPU not available | Use `any_of` for fallback clouds |\n\n## References\n\n- **[Advanced Usage](references\u002Fadvanced-usage.md)** - Multi-cloud, optimization, production patterns\n- **[Troubleshooting](references\u002Ftroubleshooting.md)** - Common issues and solutions\n\n## Resources\n\n- **Documentation**: https:\u002F\u002Fdocs.skypilot.co\n- **GitHub**: https:\u002F\u002Fgithub.com\u002Fskypilot-org\u002Fskypilot\n- **Slack**: https:\u002F\u002Fslack.skypilot.co\n- **Examples**: https:\u002F\u002Fgithub.com\u002Fskypilot-org\u002Fskypilot\u002Ftree\u002Fmaster\u002Fexamples\n",{"name":5,"tags":44,"author":50,"license":15,"version":51,"category":52,"description":7,"dependencies":53},[45,46,47,48,49,24],"Infrastructure","Multi-Cloud","Orchestration","GPU","Cost Optimization","Orchestra Research","1.0.0","ai-research",[54],"skypilot>=0.7.0","main","0da4485785ee599388900be50db1635489d53056",".agents\u002Fskills\u002Fqc-skypilot","https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6","https:\u002F\u002Fdisha6.6.thenitishkr.in\u002F","https:\u002F\u002Fgithub.com\u002FTashima-Tarsh","www.thenitishkr","thenitishkr | AI • Cyber-security • Research\r\n","2026-11-08 03:33:25",{"source":8,"skillName":5,"commands":65,"prompt":75,"zipAvailable":76},[66,69,72],{"tool":67,"command":68},"npx","npx skills add Tashima-Tarsh\u002FDisha6.6 --skill skypilot-multi-cloud-orchestration",{"tool":70,"command":71},"bunx","bunx skills add Tashima-Tarsh\u002FDisha6.6 --skill skypilot-multi-cloud-orchestration",{"tool":73,"command":74},"pnpm","pnpm dlx skills add Tashima-Tarsh\u002FDisha6.6 --skill skypilot-multi-cloud-orchestration","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fqc-skypilot\u002FSKILL.md",true,[78,84],{"path":79,"resourceType":80,"resourceTypeDesc":81,"sizeBytes":82,"sourceHtmlUrl":83},"references\u002Fadvanced-usage.md","REFERENCE","参考文档",7469,"https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fqc-skypilot\u002Freferences\u002Fadvanced-usage.md",{"path":85,"resourceType":80,"resourceTypeDesc":81,"sizeBytes":86,"sourceHtmlUrl":87},"references\u002Ftroubleshooting.md",10493,"https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fqc-skypilot\u002Freferences\u002Ftroubleshooting.md",[89,120,144,171,194,218],{"skillNo":90,"name":91,"nameZh":6,"description":92,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":93,"categories":94,"keywords":100,"publishedAt":39},"01M6QRD07D4TGNDK6VJ4EHF8BV","youtube-full","Use when the user needs YouTube transcripts, video search, channel browsing, playlist extraction, or content monitoring. Trigger phrases: 'get the transcript for', 'search YouTube for', 'what are the latest videos on', 'list this playlist', 'monitor this channel', or any request involving a YouTube URL, video ID, or @handle. Do NOT use for downloading video or audio files, YouTube engagement data (likes, comments), or private\u002Fage-restricted videos.","https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fyoutube-full\u002FSKILL.md",[95],{"categoryNo":96,"categoryName":97,"taxonomyType":98,"taxonomyTypeDesc":99},"01JBSEEDCAT000000000000016","图像与多媒体","SCENARIO","使用场景",[101,102,103,104,105,106,107,108,109,110,111,112,113,114,115,116,27,117,118,119],"youtube full","youtube","full","transcript","search","monitoring","data","Video","Audio","list","files","do","get","age","trigger","URL","browsing","request","youtube transcripts",{"skillNo":121,"name":122,"nameZh":6,"description":123,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":124,"categories":125,"keywords":126,"publishedAt":39},"01M6QRCJ3112VYPA97YG7KGMC2","x-twitter-growth","X\u002FTwitter growth engine for building audience, crafting viral content, and analyzing engagement. Use when the user wants to grow on X\u002FTwitter, write tweets or threads, analyze their X profile, research competitors on X, plan a posting strategy, or optimize engagement. Complements social-content (generic multi-platform) with X-specific depth: algorithm mechanics, thread engineering, reply strategy, profile optimization, and competitive intelligence via web search.","https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fx-twitter-growth\u002FSKILL.md",[],[127,128,129,130,105,131,132,133,134,135,136,137,138,139,32,140,141,142,143,27],"twitter","x twitter growth","growth","research","content","engineering","plan","web search","competitors","analyze","engine","write","strategy","platform","grow","posting","competitive",{"skillNo":145,"name":146,"nameZh":6,"description":147,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":148,"categories":149,"keywords":153,"publishedAt":39},"01M6QRBN3EHQNJY42RERP7A149","write-a-skill","Create new agent skills with proper structure, progressive disclosure, and bundled resources. Use when user wants to create, write, build, or author a new skill.","https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fwrite-a-skill\u002FSKILL.md",[150],{"categoryNo":151,"categoryName":152,"taxonomyType":98,"taxonomyTypeDesc":99},"01JBSEEDCAT000000000000023","Skill与智能体开发",[154,138,155,156,157,158,159,160,32,161,162,55,163,164,165,166,167,168,169,170],"write a skill","github","create","https","productivity","matt pocock","direct","example","build","new skill","structure","new agent","resources","with","tree","progressive disclosure","author",{"skillNo":172,"name":173,"nameZh":6,"description":174,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":175,"categories":176,"keywords":177,"publishedAt":39},"01M6QRB6G8P33PNGAF9Y69EJ9T","wrap-up","Close out a launched Claude Managed Agent — recap every primitive the founder now owns, regenerate the single-file overview page, and suggest the next 1-2 upgrades. Use when the user says \"wrap up\", \"close this out\", \"what do I own now\", \"give me the summary\", \"recap the agent\", or when the orchestrator routes phase=wrap-up. primitives_inventory.py tables everything owned (agent, environment, session, memory, outcome, deployment); overview_page.py regenerates a self-contained .\u002Fmy-agent\u002Fagent-overview.html; upgrade_suggester.py ranks the next moves from recorded deferrals plus standing hardening steps. Companion to run-without-you; the last stop before phase=done.","https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fwrap-up\u002FSKILL.md",[],[178,179,180,181,182,35,183,184,185,32,186,112,187,188,189,190,28,191,192,193],"wrap up","up","wrap","gemini","deployment","file","hardening","closeout","stop","upgrade","founder","close","companion","tables","directions","phase",{"skillNo":195,"name":196,"nameZh":6,"description":197,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":198,"categories":199,"keywords":201,"publishedAt":39},"01M6QRA5AYC1RBFZ39GTWGS3N8","workflow-builder","Design and write deterministic multi-agent workflow scripts (.js files in .claude\u002Fworkflows\u002F) for Claude Code's Workflow tool. Use when a user wants to build, create, author, scaffold, or run a custom Claude Code workflow, orchestrate sub-agents (fan-out, pipeline, loop, judge-panel), or automate a repeatable multi-step task across fresh-context agents.","https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fworkflow-builder\u002FSKILL.md",[200],{"categoryNo":151,"categoryName":152,"taxonomyType":98,"taxonomyTypeDesc":99},[202,203,204,205,206,156,35,207,208,209,210,211,138,212,111,213,214,215,216,217],"workflow","workflow builder","builder","design","workflows","code","orchestrate","pipeline","loop","multi-agent","context","across","fresh","scripts","judge","claude code workflow",{"skillNo":219,"name":220,"nameZh":6,"description":221,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":222,"categories":223,"keywords":224,"publishedAt":39},"01M6QR7QMCZESKQA0ERW1E657M","weekly-review","Use when someone wants to run a weekly review, close open loops, audit stalled projects and commitments, get their system back to trusted, restart a lapsed review habit, or says \"\u002Fcs:weekly-review\". Walks David Allen's three-phase loop — GET CLEAR, GET CURRENT, GET CREATIVE — with deterministic scripts that inventory open loops, gate the checklist with named gaps, and score commitment health 0-100.","https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fweekly-review\u002FSKILL.md",[],[225,226,227,228,229,230,231,232,233,210,234,235,236,237,238,239,113,240,241,193],"review","weekly review","weekly","deterministic scripts","reflect","feeds","inventory","open","team","projects","project-management","scanner","conversation","back","project","sprint","cadence"]