[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M6QEZFZ8C0S935NJ4SPET34J":3,"skill-same:01M6QEZFZ8C0S935NJ4SPET34J":87},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":39,"linkOnly":40,"markdownContent":41,"markdownBody":42,"frontMatter":43,"refName":50,"commitSha":51,"skillDirectory":52,"forksCount":14,"repositoryHtmlUrl":53,"repositoryHomepageUrl":54,"ownerHtmlUrl":55,"ownerBlogUrl":56,"ownerDescription":57,"updatedAt":58,"install":59,"resources":72},"01M6QEZFZ8C0S935NJ4SPET34J","lambda-labs-gpu-cloud",null,"Reserved and on-demand GPU cloud instances for ML training and inference. Use when you need dedicated GPU instances with simple SSH access, persistent filesystems, or high-performance multi-node clusters for large-scale training.","Tashima-Tarsh\u002FDisha6.6","Tashima-Tarsh","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F269906498?v=4","01M6PBH98X03XERH0HFT4PFB1P","NITISH KUMAR","01M6PBH9DA0M6KM3Z12P848F0K",0,"MIT","https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fkal-lambda-labs-gpu-cloud\u002FSKILL.md",[],[19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38],"gpu","cloud","GPU Cloud","Lambda Labs","lambda","lambda labs gpu cloud","access","for","high","you","scale","client","high-performance","instances","use","inference","ssh","training","infrastructure","performance","2026-11-10 10:12:30",false,"---\nname: lambda-labs-gpu-cloud\ndescription: Reserved and on-demand GPU cloud instances for ML training and inference. Use when you need dedicated GPU instances with simple SSH access, persistent filesystems, or high-performance multi-node clusters for large-scale training.\nlicense: MIT\nmetadata:\n  version: 1.0.0\n  category: ml-inference-and-ops\n  maintainer: Kalaris Labs\n  tags: Infrastructure, GPU Cloud, Training, Inference, Lambda Labs\n  dependencies: lambda-cloud-client>=1.0.0\n---\n\n# Lambda Labs GPU Cloud\n\nComprehensive guide to running ML workloads on Lambda Labs GPU cloud with on-demand instances and 1-Click Clusters.\n\n## When to use Lambda Labs\n\n**Use Lambda Labs when:**\n- Need dedicated GPU instances with full SSH access\n- Running long training jobs (hours to days)\n- Want simple pricing with no egress fees\n- Need persistent storage across sessions\n- Require high-performance multi-node clusters (16-512 GPUs)\n- Want pre-installed ML stack (Lambda Stack with PyTorch, CUDA, NCCL)\n\n**Key features:**\n- **GPU variety**: B200, H100, GH200, A100, A10, A6000, V100\n- **Lambda Stack**: Pre-installed PyTorch, TensorFlow, CUDA, cuDNN, NCCL\n- **Persistent filesystems**: Keep data across instance restarts\n- **1-Click Clusters**: 16-512 GPU Slurm clusters with InfiniBand\n- **Simple pricing**: Pay-per-minute, no egress fees\n- **Global regions**: 12+ regions worldwide\n\n**Use alternatives instead:**\n- **Modal**: For serverless, auto-scaling workloads\n- **SkyPilot**: For multi-cloud orchestration and cost optimization\n- **RunPod**: For cheaper spot instances and serverless endpoints\n- **Vast.ai**: For GPU marketplace with lowest prices\n\n## Quick start\n\n### Account setup\n\n1. Create account at https:\u002F\u002Flambda.ai\n2. Add payment method\n3. Generate API key from dashboard\n4. Add SSH key (required before launching instances)\n\n### Launch via console\n\n1. Go to https:\u002F\u002Fcloud.lambda.ai\u002Finstances\n2. Click \"Launch instance\"\n3. Select GPU type and region\n4. Choose SSH key\n5. Optionally attach filesystem\n6. Launch and wait 3-15 minutes\n\n### Connect via SSH\n\n```bash\n# Get instance IP from console\nssh ubuntu@\u003CINSTANCE-IP>\n\n# Or with specific key\nssh -i ~\u002F.ssh\u002Flambda_key ubuntu@\u003CINSTANCE-IP>\n```\n\n## GPU instances\n\n### Available GPUs\n\n| GPU | VRAM | Price\u002FGPU\u002Fhr | Best For |\n|-----|------|--------------|----------|\n| B200 SXM6 | 180 GB | $4.99 | Largest models, fastest training |\n| H100 SXM | 80 GB | $2.99-3.29 | Large model training |\n| H100 PCIe | 80 GB | $2.49 | Cost-effective H100 |\n| GH200 | 96 GB | $1.49 | Single-GPU large models |\n| A100 80GB | 80 GB | $1.79 | Production training |\n| A100 40GB | 40 GB | $1.29 | Standard training |\n| A10 | 24 GB | $0.75 | Inference, fine-tuning |\n| A6000 | 48 GB | $0.80 | Good VRAM\u002Fprice ratio |\n| V100 | 16 GB | $0.55 | Budget training |\n\n### Instance configurations\n\n```\n8x GPU: Best for distributed training (DDP, FSDP)\n4x GPU: Large models, multi-GPU training\n2x GPU: Medium workloads\n1x GPU: Fine-tuning, inference, development\n```\n\n### Launch times\n\n- Single-GPU: 3-5 minutes\n- Multi-GPU: 10-15 minutes\n\n## Lambda Stack\n\nAll instances come with Lambda Stack pre-installed:\n\n```bash\n# Included software\n- Ubuntu 22.04 LTS\n- NVIDIA drivers (latest)\n- CUDA 12.x\n- cuDNN 8.x\n- NCCL (for multi-GPU)\n- PyTorch (latest)\n- TensorFlow (latest)\n- JAX\n- JupyterLab\n```\n\n### Verify installation\n\n```bash\n# Check GPU\nnvidia-smi\n\n# Check PyTorch\npython -c \"import torch; print(torch.cuda.is_available())\"\n\n# Check CUDA version\nnvcc --version\n```\n\n## Python API\n\nDetails, code examples and parameter tables: [references\u002Fpython-api.md](references\u002Fpython-api.md). Read it when this step applies.\n\n## CLI with curl\n\n### List instance types\n\n```bash\ncurl -u $LAMBDA_API_KEY: \\\n  https:\u002F\u002Fcloud.lambdalabs.com\u002Fapi\u002Fv1\u002Finstance-types | jq\n```\n\n### Launch instance\n\n```bash\ncurl -u $LAMBDA_API_KEY: \\\n  -X POST https:\u002F\u002Fcloud.lambdalabs.com\u002Fapi\u002Fv1\u002Finstance-operations\u002Flaunch \\\n  -H \"Content-Type: application\u002Fjson\" \\\n  -d '{\n    \"region_name\": \"us-west-1\",\n    \"instance_type_name\": \"gpu_1x_h100_sxm5\",\n    \"ssh_key_names\": [\"my-key\"]\n  }' | jq\n```\n\n### Terminate instance\n\n```bash\ncurl -u $LAMBDA_API_KEY: \\\n  -X POST https:\u002F\u002Fcloud.lambdalabs.com\u002Fapi\u002Fv1\u002Finstance-operations\u002Fterminate \\\n  -H \"Content-Type: application\u002Fjson\" \\\n  -d '{\"instance_ids\": [\"\u003CINSTANCE-ID>\"]}' | jq\n```\n\n## Persistent storage\n\n### Filesystems\n\nFilesystems persist data across instance restarts:\n\n```bash\n# Mount location\n\u002Flambda\u002Fnfs\u002F\u003CFILESYSTEM_NAME>\n\n# Example: save checkpoints\npython train.py --checkpoint-dir \u002Flambda\u002Fnfs\u002Fmy-storage\u002Fcheckpoints\n```\n\n### Create filesystem\n\n1. Go to Storage in Lambda console\n2. Click \"Create filesystem\"\n3. Select region (must match instance region)\n4. Name and create\n\n### Attach to instance\n\nFilesystems must be attached at instance launch time:\n- Via console: Select filesystem when launching\n- Via API: Include `file_system_names` in launch request\n\n### Best practices\n\n```bash\n# Store on filesystem (persists)\n\u002Flambda\u002Fnfs\u002Fstorage\u002F\n  ├── datasets\u002F\n  ├── checkpoints\u002F\n  ├── models\u002F\n  └── outputs\u002F\n\n# Local SSD (faster, ephemeral)\n\u002Fhome\u002Fubuntu\u002F\n  └── working\u002F  # Temporary files\n```\n\n## SSH configuration\n\n### Add SSH key\n\n```bash\n# Generate key locally\nssh-keygen -t ed25519 -f ~\u002F.ssh\u002Flambda_key\n\n# Add public key to Lambda console\n# Or via API\n```\n\n### Multiple keys\n\n```bash\n# On instance, add more keys\necho 'ssh-rsa AAAA...' >> ~\u002F.ssh\u002Fauthorized_keys\n```\n\n### Import from GitHub\n\n```bash\n# On instance\nssh-import-id gh:username\n```\n\n### SSH tunneling\n\n```bash\n# Forward Jupyter\nssh -L 8888:localhost:8888 ubuntu@\u003CIP>\n\n# Forward TensorBoard\nssh -L 6006:localhost:6006 ubuntu@\u003CIP>\n\n# Multiple ports\nssh -L 8888:localhost:8888 -L 6006:localhost:6006 ubuntu@\u003CIP>\n```\n\n## JupyterLab\n\n### Launch from console\n\n1. Go to Instances page\n2. Click \"Launch\" in Cloud IDE column\n3. JupyterLab opens in browser\n\n### Manual access\n\n```bash\n# On instance\njupyter lab --ip=0.0.0.0 --port=8888\n\n# From local machine with tunnel\nssh -L 8888:localhost:8888 ubuntu@\u003CIP>\n# Open http:\u002F\u002Flocalhost:8888\n```\n\n## Training workflows\n\n### Single-GPU training\n\n```bash\n# SSH to instance\nssh ubuntu@\u003CIP>\n\n# Clone repo\ngit clone https:\u002F\u002Fgithub.com\u002Fuser\u002Fproject\ncd project\n\n# Install dependencies\npip install -r requirements.txt\n\n# Train\npython train.py --epochs 100 --checkpoint-dir \u002Flambda\u002Fnfs\u002Fstorage\u002Fcheckpoints\n```\n\n### Multi-GPU training (single node)\n\n```python\n# train_ddp.py\nimport torch\nimport torch.distributed as dist\nfrom torch.nn.parallel import DistributedDataParallel as DDP\n\ndef main():\n    dist.init_process_group(\"nccl\")\n    rank = dist.get_rank()\n    device = rank % torch.cuda.device_count()\n\n    model = MyModel().to(device)\n    model = DDP(model, device_ids=[device])\n\n    # Training loop...\n\nif __name__ == \"__main__\":\n    main()\n```\n\n```bash\n# Launch with torchrun (8 GPUs)\ntorchrun --nproc_per_node=8 train_ddp.py\n```\n\n### Checkpoint to filesystem\n\n```python\nimport os\n\ncheckpoint_dir = \"\u002Flambda\u002Fnfs\u002Fmy-storage\u002Fcheckpoints\"\nos.makedirs(checkpoint_dir, exist_ok=True)\n\n# Save checkpoint\ntorch.save({\n    'epoch': epoch,\n    'model_state_dict': model.state_dict(),\n    'optimizer_state_dict': optimizer.state_dict(),\n    'loss': loss,\n}, f\"{checkpoint_dir}\u002Fcheckpoint_{epoch}.pt\")\n```\n\n## 1-Click Clusters\n\n### Overview\n\nHigh-performance Slurm clusters with:\n- 16-512 NVIDIA H100 or B200 GPUs\n- NVIDIA Quantum-2 400 Gb\u002Fs InfiniBand\n- GPUDirect RDMA at 3200 Gb\u002Fs\n- Pre-installed distributed ML stack\n\n### Included software\n\n- Ubuntu 22.04 LTS + Lambda Stack\n- NCCL, Open MPI\n- PyTorch with DDP and FSDP\n- TensorFlow\n- OFED drivers\n\n### Storage\n\n- 24 TB NVMe per compute node (ephemeral)\n- Lambda filesystems for persistent data\n\n### Multi-node training\n\n```bash\n# On Slurm cluster\nsrun --nodes=4 --ntasks-per-node=8 --gpus-per-node=8 \\\n  torchrun --nnodes=4 --nproc_per_node=8 \\\n  --rdzv_backend=c10d --rdzv_endpoint=$MASTER_ADDR:29500 \\\n  train.py\n```\n\n## Networking\n\n### Bandwidth\n\n- Inter-instance (same region): up to 200 Gbps\n- Internet outbound: 20 Gbps max\n\n### Firewall\n\n- Default: Only port 22 (SSH) open\n- Configure additional ports in Lambda console\n- ICMP traffic allowed by default\n\n### Private IPs\n\n```bash\n# Find private IP\nip addr show | grep 'inet '\n```\n\n## Common workflows\n\n### Workflow 1: Fine-tuning LLM\n\n```bash\n# 1. Launch 8x H100 instance with filesystem\n\n# 2. SSH and setup\nssh ubuntu@\u003CIP>\npip install transformers accelerate peft\n\n# 3. Download model to filesystem\npython -c \"\nfrom transformers import AutoModelForCausalLM\nmodel = AutoModelForCausalLM.from_pretrained('meta-llama\u002FLlama-2-7b-hf')\nmodel.save_pretrained('\u002Flambda\u002Fnfs\u002Fstorage\u002Fmodels\u002Fllama-2-7b')\n\"\n\n# 4. Fine-tune with checkpoints on filesystem\naccelerate launch --num_processes 8 train.py \\\n  --model_path \u002Flambda\u002Fnfs\u002Fstorage\u002Fmodels\u002Fllama-2-7b \\\n  --output_dir \u002Flambda\u002Fnfs\u002Fstorage\u002Foutputs \\\n  --checkpoint_dir \u002Flambda\u002Fnfs\u002Fstorage\u002Fcheckpoints\n```\n\n### Workflow 2: Batch inference\n\n```bash\n# 1. Launch A10 instance (cost-effective for inference)\n\n# 2. Run inference\npython inference.py \\\n  --model \u002Flambda\u002Fnfs\u002Fstorage\u002Fmodels\u002Ffine-tuned \\\n  --input \u002Flambda\u002Fnfs\u002Fstorage\u002Fdata\u002Finputs.jsonl \\\n  --output \u002Flambda\u002Fnfs\u002Fstorage\u002Fdata\u002Foutputs.jsonl\n```\n\n## Cost optimization\n\n### Choose right GPU\n\n| Task | Recommended GPU |\n|------|-----------------|\n| LLM fine-tuning (7B) | A100 40GB |\n| LLM fine-tuning (70B) | 8x H100 |\n| Inference | A10, A6000 |\n| Development | V100, A10 |\n| Maximum performance | B200 |\n\n### Reduce costs\n\n1. **Use filesystems**: Avoid re-downloading data\n2. **Checkpoint frequently**: Resume interrupted training\n3. **Right-size**: Don't over-provision GPUs\n4. **Terminate idle**: No auto-stop, manually terminate\n\n### Monitor usage\n\n- Dashboard shows real-time GPU utilization\n- API for programmatic monitoring\n\n## Common issues\n\n| Issue | Solution |\n|-------|----------|\n| Instance won't launch | Check region availability, try different GPU |\n| SSH connection refused | Wait for instance to initialize (3-15 min) |\n| Data lost after terminate | Use persistent filesystems |\n| Slow data transfer | Use filesystem in same region |\n| GPU not detected | Reboot instance, check drivers |\n\n## References\n\n- **[Advanced Usage](references\u002Fadvanced-usage.md)** - Multi-node training, API automation\n- **[Troubleshooting](references\u002Ftroubleshooting.md)** - Common issues and solutions\n\n## Resources\n\n- **Documentation**: https:\u002F\u002Fdocs.lambda.ai\n- **Console**: https:\u002F\u002Fcloud.lambda.ai\n- **Pricing**: https:\u002F\u002Flambda.ai\u002Finstances\n- **Support**: https:\u002F\u002Fsupport.lambdalabs.com\n- **Blog**: https:\u002F\u002Flambda.ai\u002Fblog\n\n## Related skills\n\n- `modal-serverless-gpu`: Serverless GPU cloud platform for running ML workloads.\n- `skypilot-multi-cloud-orchestration`: Multi-cloud orchestration for ML workloads with automatic cost optimization.\n- `modal`: Modal is a serverless cloud platform for running Python on demand, including on-demand GPUs.\n","# Lambda Labs GPU Cloud\n\nComprehensive guide to running ML workloads on Lambda Labs GPU cloud with on-demand instances and 1-Click Clusters.\n\n## When to use Lambda Labs\n\n**Use Lambda Labs when:**\n- Need dedicated GPU instances with full SSH access\n- Running long training jobs (hours to days)\n- Want simple pricing with no egress fees\n- Need persistent storage across sessions\n- Require high-performance multi-node clusters (16-512 GPUs)\n- Want pre-installed ML stack (Lambda Stack with PyTorch, CUDA, NCCL)\n\n**Key features:**\n- **GPU variety**: B200, H100, GH200, A100, A10, A6000, V100\n- **Lambda Stack**: Pre-installed PyTorch, TensorFlow, CUDA, cuDNN, NCCL\n- **Persistent filesystems**: Keep data across instance restarts\n- **1-Click Clusters**: 16-512 GPU Slurm clusters with InfiniBand\n- **Simple pricing**: Pay-per-minute, no egress fees\n- **Global regions**: 12+ regions worldwide\n\n**Use alternatives instead:**\n- **Modal**: For serverless, auto-scaling workloads\n- **SkyPilot**: For multi-cloud orchestration and cost optimization\n- **RunPod**: For cheaper spot instances and serverless endpoints\n- **Vast.ai**: For GPU marketplace with lowest prices\n\n## Quick start\n\n### Account setup\n\n1. Create account at https:\u002F\u002Flambda.ai\n2. Add payment method\n3. Generate API key from dashboard\n4. Add SSH key (required before launching instances)\n\n### Launch via console\n\n1. Go to https:\u002F\u002Fcloud.lambda.ai\u002Finstances\n2. Click \"Launch instance\"\n3. Select GPU type and region\n4. Choose SSH key\n5. Optionally attach filesystem\n6. Launch and wait 3-15 minutes\n\n### Connect via SSH\n\n```bash\n# Get instance IP from console\nssh ubuntu@\u003CINSTANCE-IP>\n\n# Or with specific key\nssh -i ~\u002F.ssh\u002Flambda_key ubuntu@\u003CINSTANCE-IP>\n```\n\n## GPU instances\n\n### Available GPUs\n\n| GPU | VRAM | Price\u002FGPU\u002Fhr | Best For |\n|-----|------|--------------|----------|\n| B200 SXM6 | 180 GB | $4.99 | Largest models, fastest training |\n| H100 SXM | 80 GB | $2.99-3.29 | Large model training |\n| H100 PCIe | 80 GB | $2.49 | Cost-effective H100 |\n| GH200 | 96 GB | $1.49 | Single-GPU large models |\n| A100 80GB | 80 GB | $1.79 | Production training |\n| A100 40GB | 40 GB | $1.29 | Standard training |\n| A10 | 24 GB | $0.75 | Inference, fine-tuning |\n| A6000 | 48 GB | $0.80 | Good VRAM\u002Fprice ratio |\n| V100 | 16 GB | $0.55 | Budget training |\n\n### Instance configurations\n\n```\n8x GPU: Best for distributed training (DDP, FSDP)\n4x GPU: Large models, multi-GPU training\n2x GPU: Medium workloads\n1x GPU: Fine-tuning, inference, development\n```\n\n### Launch times\n\n- Single-GPU: 3-5 minutes\n- Multi-GPU: 10-15 minutes\n\n## Lambda Stack\n\nAll instances come with Lambda Stack pre-installed:\n\n```bash\n# Included software\n- Ubuntu 22.04 LTS\n- NVIDIA drivers (latest)\n- CUDA 12.x\n- cuDNN 8.x\n- NCCL (for multi-GPU)\n- PyTorch (latest)\n- TensorFlow (latest)\n- JAX\n- JupyterLab\n```\n\n### Verify installation\n\n```bash\n# Check GPU\nnvidia-smi\n\n# Check PyTorch\npython -c \"import torch; print(torch.cuda.is_available())\"\n\n# Check CUDA version\nnvcc --version\n```\n\n## Python API\n\nDetails, code examples and parameter tables: [references\u002Fpython-api.md](references\u002Fpython-api.md). Read it when this step applies.\n\n## CLI with curl\n\n### List instance types\n\n```bash\ncurl -u $LAMBDA_API_KEY: \\\n  https:\u002F\u002Fcloud.lambdalabs.com\u002Fapi\u002Fv1\u002Finstance-types | jq\n```\n\n### Launch instance\n\n```bash\ncurl -u $LAMBDA_API_KEY: \\\n  -X POST https:\u002F\u002Fcloud.lambdalabs.com\u002Fapi\u002Fv1\u002Finstance-operations\u002Flaunch \\\n  -H \"Content-Type: application\u002Fjson\" \\\n  -d '{\n    \"region_name\": \"us-west-1\",\n    \"instance_type_name\": \"gpu_1x_h100_sxm5\",\n    \"ssh_key_names\": [\"my-key\"]\n  }' | jq\n```\n\n### Terminate instance\n\n```bash\ncurl -u $LAMBDA_API_KEY: \\\n  -X POST https:\u002F\u002Fcloud.lambdalabs.com\u002Fapi\u002Fv1\u002Finstance-operations\u002Fterminate \\\n  -H \"Content-Type: application\u002Fjson\" \\\n  -d '{\"instance_ids\": [\"\u003CINSTANCE-ID>\"]}' | jq\n```\n\n## Persistent storage\n\n### Filesystems\n\nFilesystems persist data across instance restarts:\n\n```bash\n# Mount location\n\u002Flambda\u002Fnfs\u002F\u003CFILESYSTEM_NAME>\n\n# Example: save checkpoints\npython train.py --checkpoint-dir \u002Flambda\u002Fnfs\u002Fmy-storage\u002Fcheckpoints\n```\n\n### Create filesystem\n\n1. Go to Storage in Lambda console\n2. Click \"Create filesystem\"\n3. Select region (must match instance region)\n4. Name and create\n\n### Attach to instance\n\nFilesystems must be attached at instance launch time:\n- Via console: Select filesystem when launching\n- Via API: Include `file_system_names` in launch request\n\n### Best practices\n\n```bash\n# Store on filesystem (persists)\n\u002Flambda\u002Fnfs\u002Fstorage\u002F\n  ├── datasets\u002F\n  ├── checkpoints\u002F\n  ├── models\u002F\n  └── outputs\u002F\n\n# Local SSD (faster, ephemeral)\n\u002Fhome\u002Fubuntu\u002F\n  └── working\u002F  # Temporary files\n```\n\n## SSH configuration\n\n### Add SSH key\n\n```bash\n# Generate key locally\nssh-keygen -t ed25519 -f ~\u002F.ssh\u002Flambda_key\n\n# Add public key to Lambda console\n# Or via API\n```\n\n### Multiple keys\n\n```bash\n# On instance, add more keys\necho 'ssh-rsa AAAA...' >> ~\u002F.ssh\u002Fauthorized_keys\n```\n\n### Import from GitHub\n\n```bash\n# On instance\nssh-import-id gh:username\n```\n\n### SSH tunneling\n\n```bash\n# Forward Jupyter\nssh -L 8888:localhost:8888 ubuntu@\u003CIP>\n\n# Forward TensorBoard\nssh -L 6006:localhost:6006 ubuntu@\u003CIP>\n\n# Multiple ports\nssh -L 8888:localhost:8888 -L 6006:localhost:6006 ubuntu@\u003CIP>\n```\n\n## JupyterLab\n\n### Launch from console\n\n1. Go to Instances page\n2. Click \"Launch\" in Cloud IDE column\n3. JupyterLab opens in browser\n\n### Manual access\n\n```bash\n# On instance\njupyter lab --ip=0.0.0.0 --port=8888\n\n# From local machine with tunnel\nssh -L 8888:localhost:8888 ubuntu@\u003CIP>\n# Open http:\u002F\u002Flocalhost:8888\n```\n\n## Training workflows\n\n### Single-GPU training\n\n```bash\n# SSH to instance\nssh ubuntu@\u003CIP>\n\n# Clone repo\ngit clone https:\u002F\u002Fgithub.com\u002Fuser\u002Fproject\ncd project\n\n# Install dependencies\npip install -r requirements.txt\n\n# Train\npython train.py --epochs 100 --checkpoint-dir \u002Flambda\u002Fnfs\u002Fstorage\u002Fcheckpoints\n```\n\n### Multi-GPU training (single node)\n\n```python\n# train_ddp.py\nimport torch\nimport torch.distributed as dist\nfrom torch.nn.parallel import DistributedDataParallel as DDP\n\ndef main():\n    dist.init_process_group(\"nccl\")\n    rank = dist.get_rank()\n    device = rank % torch.cuda.device_count()\n\n    model = MyModel().to(device)\n    model = DDP(model, device_ids=[device])\n\n    # Training loop...\n\nif __name__ == \"__main__\":\n    main()\n```\n\n```bash\n# Launch with torchrun (8 GPUs)\ntorchrun --nproc_per_node=8 train_ddp.py\n```\n\n### Checkpoint to filesystem\n\n```python\nimport os\n\ncheckpoint_dir = \"\u002Flambda\u002Fnfs\u002Fmy-storage\u002Fcheckpoints\"\nos.makedirs(checkpoint_dir, exist_ok=True)\n\n# Save checkpoint\ntorch.save({\n    'epoch': epoch,\n    'model_state_dict': model.state_dict(),\n    'optimizer_state_dict': optimizer.state_dict(),\n    'loss': loss,\n}, f\"{checkpoint_dir}\u002Fcheckpoint_{epoch}.pt\")\n```\n\n## 1-Click Clusters\n\n### Overview\n\nHigh-performance Slurm clusters with:\n- 16-512 NVIDIA H100 or B200 GPUs\n- NVIDIA Quantum-2 400 Gb\u002Fs InfiniBand\n- GPUDirect RDMA at 3200 Gb\u002Fs\n- Pre-installed distributed ML stack\n\n### Included software\n\n- Ubuntu 22.04 LTS + Lambda Stack\n- NCCL, Open MPI\n- PyTorch with DDP and FSDP\n- TensorFlow\n- OFED drivers\n\n### Storage\n\n- 24 TB NVMe per compute node (ephemeral)\n- Lambda filesystems for persistent data\n\n### Multi-node training\n\n```bash\n# On Slurm cluster\nsrun --nodes=4 --ntasks-per-node=8 --gpus-per-node=8 \\\n  torchrun --nnodes=4 --nproc_per_node=8 \\\n  --rdzv_backend=c10d --rdzv_endpoint=$MASTER_ADDR:29500 \\\n  train.py\n```\n\n## Networking\n\n### Bandwidth\n\n- Inter-instance (same region): up to 200 Gbps\n- Internet outbound: 20 Gbps max\n\n### Firewall\n\n- Default: Only port 22 (SSH) open\n- Configure additional ports in Lambda console\n- ICMP traffic allowed by default\n\n### Private IPs\n\n```bash\n# Find private IP\nip addr show | grep 'inet '\n```\n\n## Common workflows\n\n### Workflow 1: Fine-tuning LLM\n\n```bash\n# 1. Launch 8x H100 instance with filesystem\n\n# 2. SSH and setup\nssh ubuntu@\u003CIP>\npip install transformers accelerate peft\n\n# 3. Download model to filesystem\npython -c \"\nfrom transformers import AutoModelForCausalLM\nmodel = AutoModelForCausalLM.from_pretrained('meta-llama\u002FLlama-2-7b-hf')\nmodel.save_pretrained('\u002Flambda\u002Fnfs\u002Fstorage\u002Fmodels\u002Fllama-2-7b')\n\"\n\n# 4. Fine-tune with checkpoints on filesystem\naccelerate launch --num_processes 8 train.py \\\n  --model_path \u002Flambda\u002Fnfs\u002Fstorage\u002Fmodels\u002Fllama-2-7b \\\n  --output_dir \u002Flambda\u002Fnfs\u002Fstorage\u002Foutputs \\\n  --checkpoint_dir \u002Flambda\u002Fnfs\u002Fstorage\u002Fcheckpoints\n```\n\n### Workflow 2: Batch inference\n\n```bash\n# 1. Launch A10 instance (cost-effective for inference)\n\n# 2. Run inference\npython inference.py \\\n  --model \u002Flambda\u002Fnfs\u002Fstorage\u002Fmodels\u002Ffine-tuned \\\n  --input \u002Flambda\u002Fnfs\u002Fstorage\u002Fdata\u002Finputs.jsonl \\\n  --output \u002Flambda\u002Fnfs\u002Fstorage\u002Fdata\u002Foutputs.jsonl\n```\n\n## Cost optimization\n\n### Choose right GPU\n\n| Task | Recommended GPU |\n|------|-----------------|\n| LLM fine-tuning (7B) | A100 40GB |\n| LLM fine-tuning (70B) | 8x H100 |\n| Inference | A10, A6000 |\n| Development | V100, A10 |\n| Maximum performance | B200 |\n\n### Reduce costs\n\n1. **Use filesystems**: Avoid re-downloading data\n2. **Checkpoint frequently**: Resume interrupted training\n3. **Right-size**: Don't over-provision GPUs\n4. **Terminate idle**: No auto-stop, manually terminate\n\n### Monitor usage\n\n- Dashboard shows real-time GPU utilization\n- API for programmatic monitoring\n\n## Common issues\n\n| Issue | Solution |\n|-------|----------|\n| Instance won't launch | Check region availability, try different GPU |\n| SSH connection refused | Wait for instance to initialize (3-15 min) |\n| Data lost after terminate | Use persistent filesystems |\n| Slow data transfer | Use filesystem in same region |\n| GPU not detected | Reboot instance, check drivers |\n\n## References\n\n- **[Advanced Usage](references\u002Fadvanced-usage.md)** - Multi-node training, API automation\n- **[Troubleshooting](references\u002Ftroubleshooting.md)** - Common issues and solutions\n\n## Resources\n\n- **Documentation**: https:\u002F\u002Fdocs.lambda.ai\n- **Console**: https:\u002F\u002Fcloud.lambda.ai\n- **Pricing**: https:\u002F\u002Flambda.ai\u002Finstances\n- **Support**: https:\u002F\u002Fsupport.lambdalabs.com\n- **Blog**: https:\u002F\u002Flambda.ai\u002Fblog\n\n## Related skills\n\n- `modal-serverless-gpu`: Serverless GPU cloud platform for running ML workloads.\n- `skypilot-multi-cloud-orchestration`: Multi-cloud orchestration for ML workloads with automatic cost optimization.\n- `modal`: Modal is a serverless cloud platform for running Python on demand, including on-demand GPUs.\n",{"name":5,"license":15,"metadata":44,"description":7},{"tags":45,"version":46,"category":47,"maintainer":48,"dependencies":49},"Infrastructure, GPU Cloud, Training, Inference, Lambda Labs","1.0.0","ml-inference-and-ops","Kalaris Labs","lambda-cloud-client>=1.0.0","main","0da4485785ee599388900be50db1635489d53056",".agents\u002Fskills\u002Fkal-lambda-labs-gpu-cloud","https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6","https:\u002F\u002Fdisha6.6.thenitishkr.in\u002F","https:\u002F\u002Fgithub.com\u002FTashima-Tarsh","www.thenitishkr","thenitishkr | AI • Cyber-security • Research\r\n","2026-11-08 03:33:25",{"source":8,"skillName":5,"commands":60,"prompt":70,"zipAvailable":71},[61,64,67],{"tool":62,"command":63},"npx","npx skills add Tashima-Tarsh\u002FDisha6.6 --skill lambda-labs-gpu-cloud",{"tool":65,"command":66},"bunx","bunx skills add Tashima-Tarsh\u002FDisha6.6 --skill lambda-labs-gpu-cloud",{"tool":68,"command":69},"pnpm","pnpm dlx skills add Tashima-Tarsh\u002FDisha6.6 --skill lambda-labs-gpu-cloud","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fkal-lambda-labs-gpu-cloud\u002FSKILL.md",true,[73,79,83],{"path":74,"resourceType":75,"resourceTypeDesc":76,"sizeBytes":77,"sourceHtmlUrl":78},"references\u002Fadvanced-usage.md","REFERENCE","参考文档",15100,"https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fkal-lambda-labs-gpu-cloud\u002Freferences\u002Fadvanced-usage.md",{"path":80,"resourceType":75,"resourceTypeDesc":76,"sizeBytes":81,"sourceHtmlUrl":82},"references\u002Fpython-api.md",1765,"https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fkal-lambda-labs-gpu-cloud\u002Freferences\u002Fpython-api.md",{"path":84,"resourceType":75,"resourceTypeDesc":76,"sizeBytes":85,"sourceHtmlUrl":86},"references\u002Ftroubleshooting.md",11683,"https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fkal-lambda-labs-gpu-cloud\u002Freferences\u002Ftroubleshooting.md",[88,119,143,170,194,218],{"skillNo":89,"name":90,"nameZh":6,"description":91,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":92,"categories":93,"keywords":99,"publishedAt":39},"01M6QRD07D4TGNDK6VJ4EHF8BV","youtube-full","Use when the user needs YouTube transcripts, video search, channel browsing, playlist extraction, or content monitoring. Trigger phrases: 'get the transcript for', 'search YouTube for', 'what are the latest videos on', 'list this playlist', 'monitor this channel', or any request involving a YouTube URL, video ID, or @handle. Do NOT use for downloading video or audio files, YouTube engagement data (likes, comments), or private\u002Fage-restricted videos.","https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fyoutube-full\u002FSKILL.md",[94],{"categoryNo":95,"categoryName":96,"taxonomyType":97,"taxonomyTypeDesc":98},"01JBSEEDCAT000000000000016","图像与多媒体","SCENARIO","使用场景",[100,101,102,103,104,105,106,107,108,109,110,111,112,113,114,115,26,116,117,118],"youtube full","youtube","full","transcript","search","monitoring","data","Video","Audio","list","files","do","get","age","trigger","URL","browsing","request","youtube transcripts",{"skillNo":120,"name":121,"nameZh":6,"description":122,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":123,"categories":124,"keywords":125,"publishedAt":39},"01M6QRCJ3112VYPA97YG7KGMC2","x-twitter-growth","X\u002FTwitter growth engine for building audience, crafting viral content, and analyzing engagement. Use when the user wants to grow on X\u002FTwitter, write tweets or threads, analyze their X profile, research competitors on X, plan a posting strategy, or optimize engagement. Complements social-content (generic multi-platform) with X-specific depth: algorithm mechanics, thread engineering, reply strategy, profile optimization, and competitive intelligence via web search.","https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fx-twitter-growth\u002FSKILL.md",[],[126,127,128,129,104,130,131,132,133,134,135,136,137,138,33,139,140,141,142,26],"twitter","x twitter growth","growth","research","content","engineering","plan","web search","competitors","analyze","engine","write","strategy","platform","grow","posting","competitive",{"skillNo":144,"name":145,"nameZh":6,"description":146,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":147,"categories":148,"keywords":152,"publishedAt":39},"01M6QRBN3EHQNJY42RERP7A149","write-a-skill","Create new agent skills with proper structure, progressive disclosure, and bundled resources. Use when user wants to create, write, build, or author a new skill.","https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fwrite-a-skill\u002FSKILL.md",[149],{"categoryNo":150,"categoryName":151,"taxonomyType":97,"taxonomyTypeDesc":98},"01JBSEEDCAT000000000000023","Skill与智能体开发",[153,137,154,155,156,157,158,159,33,160,161,50,162,163,164,165,166,167,168,169],"write a skill","github","create","https","productivity","matt pocock","direct","example","build","new skill","structure","new agent","resources","with","tree","progressive disclosure","author",{"skillNo":171,"name":172,"nameZh":6,"description":173,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":174,"categories":175,"keywords":176,"publishedAt":39},"01M6QRB6G8P33PNGAF9Y69EJ9T","wrap-up","Close out a launched Claude Managed Agent — recap every primitive the founder now owns, regenerate the single-file overview page, and suggest the next 1-2 upgrades. Use when the user says \"wrap up\", \"close this out\", \"what do I own now\", \"give me the summary\", \"recap the agent\", or when the orchestrator routes phase=wrap-up. primitives_inventory.py tables everything owned (agent, environment, session, memory, outcome, deployment); overview_page.py regenerates a self-contained .\u002Fmy-agent\u002Fagent-overview.html; upgrade_suggester.py ranks the next moves from recorded deferrals plus standing hardening steps. Companion to run-without-you; the last stop before phase=done.","https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fwrap-up\u002FSKILL.md",[],[177,178,179,180,181,182,183,184,185,33,186,111,187,188,189,190,28,191,192,193],"wrap up","up","wrap","gemini","deployment","run","file","hardening","closeout","stop","upgrade","founder","close","companion","tables","directions","phase",{"skillNo":195,"name":196,"nameZh":6,"description":197,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":198,"categories":199,"keywords":201,"publishedAt":39},"01M6QRA5AYC1RBFZ39GTWGS3N8","workflow-builder","Design and write deterministic multi-agent workflow scripts (.js files in .claude\u002Fworkflows\u002F) for Claude Code's Workflow tool. Use when a user wants to build, create, author, scaffold, or run a custom Claude Code workflow, orchestrate sub-agents (fan-out, pipeline, loop, judge-panel), or automate a repeatable multi-step task across fresh-context agents.","https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fworkflow-builder\u002FSKILL.md",[200],{"categoryNo":150,"categoryName":151,"taxonomyType":97,"taxonomyTypeDesc":98},[202,203,204,205,206,155,182,207,208,209,210,211,137,212,110,213,214,215,216,217],"workflow","workflow builder","builder","design","workflows","code","orchestrate","pipeline","loop","multi-agent","context","across","fresh","scripts","judge","claude code workflow",{"skillNo":219,"name":220,"nameZh":6,"description":221,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":222,"categories":223,"keywords":224,"publishedAt":39},"01M6QR7QMCZESKQA0ERW1E657M","weekly-review","Use when someone wants to run a weekly review, close open loops, audit stalled projects and commitments, get their system back to trusted, restart a lapsed review habit, or says \"\u002Fcs:weekly-review\". Walks David Allen's three-phase loop — GET CLEAR, GET CURRENT, GET CREATIVE — with deterministic scripts that inventory open loops, gate the checklist with named gaps, and score commitment health 0-100.","https:\u002F\u002Fgithub.com\u002FTashima-Tarsh\u002FDisha6.6\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fweekly-review\u002FSKILL.md",[],[225,226,227,228,229,230,231,232,233,210,234,235,236,237,238,239,112,240,241,193],"review","weekly review","weekly","deterministic scripts","reflect","feeds","inventory","open","team","projects","project-management","scanner","conversation","back","project","sprint","cadence"]