[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M73AA997MK27KV18GQ98G53Z":3,"skill-same:01M73AA997MK27KV18GQ98G53Z":71},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":19,"linkOnly":20,"markdownContent":21,"markdownBody":22,"frontMatter":23,"refName":39,"commitSha":40,"skillDirectory":41,"forksCount":42,"repositoryHtmlUrl":43,"repositoryHomepageUrl":6,"ownerHtmlUrl":44,"ownerBlogUrl":45,"ownerDescription":6,"updatedAt":46,"install":47,"resources":60},"01M73AA997MK27KV18GQ98G53Z","miles-rl-training",null,"Provides guidance for enterprise-grade RL training using miles, a production-ready fork of slime. Use when training large MoE models with FP8\u002FINT4, needing train-inference alignment, or requiring speculative RL for maximum throughput.","qhjqhj00\u002Fresearch-skills-pool","qhjqhj00","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F29684092?v=4","01M72AE0ZGXVM5C57N512DGQG8","Tommy Chien","01M72AE107ESJMHT7QC5SXX144",3,"MIT","https:\u002F\u002Fgithub.com\u002Fqhjqhj00\u002Fresearch-skills-pool\u002Fblob\u002Fmaster\u002Fskills_collected\u002FOrchestra-Research--AI-research-SKILLs--06-post-training__miles\u002FSKILL.md",[],[],"2026-11-11 15:11:14",false,"---\nname: miles-rl-training\ndescription: Provides guidance for enterprise-grade RL training using miles, a production-ready fork of slime. Use when training large MoE models with FP8\u002FINT4, needing train-inference alignment, or requiring speculative RL for maximum throughput.\nversion: 1.0.0\nauthor: Orchestra Research\nlicense: MIT\ntags: [Reinforcement Learning, MoE, FP8, INT4, Enterprise, SGLang, Megatron-LM]\ndependencies: [sglang-router>=0.2.3, ray, torch>=2.0.0, transformers>=4.40.0]\n---\n\n# miles: Enterprise-Grade RL for Large-Scale Model Training\n\nmiles is a high-performance, enterprise-ready RL framework optimized for large-scale model post-training. Built as a production fork of slime, it addresses critical challenges in MoE training stability, low-precision training, and train-inference alignment.\n\n## When to Use miles\n\n**Choose miles when you need:**\n- Training 1TB+ MoE models (DeepSeek V3, Qwen3-MoE)\n- FP8 or INT4 quantization-aware training\n- Bit-wise identical train-inference alignment\n- Speculative RL for maximum throughput\n- Production stability with enterprise support\n\n**Consider alternatives when:**\n- You want the research-grade original → use **slime**\n- You need flexible backend swapping → use **verl**\n- You want PyTorch-native abstractions → use **torchforge**\n\n## Key Features\n\n### Low-Precision Training\n- **Unified FP8**: End-to-end FP8 for both inference and training\n- **INT4 QAT**: 1TB models on single-machine VRAM (H200)\n- **Rollout Routing Replay (R3)**: Bit-wise expert alignment for MoE\n\n### Performance Optimizations\n- **Speculative RL**: 25%+ rollout speedup with online SFT draft models\n- **Zero-Copy Weight Sync**: CUDA IPC zero-copy mapping\n- **Partial Rollout**: Recycle half-finished trajectories\n\n### Train-Inference Alignment\n- **TIS\u002FMIS**: Truncated\u002FMasked Importance Sampling for off-policy correction\n- **Kernel-level optimization**: FlashAttention-3, DeepGEMM integration\n\n## Installation\n\n```bash\n# Recommended: Docker\ndocker pull radixark\u002Fmiles:latest\ndocker run --rm --gpus all --ipc=host --shm-size=16g \\\n  -it radixark\u002Fmiles:latest \u002Fbin\u002Fbash\n\n# From source\ngit clone https:\u002F\u002Fgithub.com\u002Fradixark\u002Fmiles.git\ncd miles\npip install -r requirements.txt\npip install -e .\n```\n\n## Quick Start\n\nmiles inherits slime's configuration system. Basic training:\n\n```bash\npython train.py \\\n    --advantage-estimator grpo \\\n    --model-name qwen3-30b-a3b \\\n    --hf-checkpoint \u002Fpath\u002Fto\u002Fqwen3-30b-a3b-hf \\\n    --rollout-batch-size 512 \\\n    --n-samples-per-prompt 8\n```\n\n---\n\n## Workflow 1: Large MoE Training\n\nUse this workflow for training large MoE models like DeepSeek V3 or Qwen3-MoE.\n\n### Prerequisites Checklist\n- [ ] H100\u002FH200 GPUs with FP8 support\n- [ ] MoE model (DeepSeek V3, Qwen3-MoE)\n- [ ] Docker environment with miles\n\n### Step 1: Environment Setup\n\n```bash\n# FP8 block scaling (recommended for stability)\nexport NVTE_FP8_BLOCK_SCALING_FP32_SCALES=1\nexport CUDA_DEVICE_MAX_CONNECTIONS=1\n```\n\n### Step 2: Configure Training\n\n```bash\npython train.py \\\n    --actor-num-gpus-per-node 8 \\\n    --rollout-num-gpus 8 \\\n    --hf-checkpoint \u002Fpath\u002Fto\u002Fdeepseek-v3 \\\n    --advantage-estimator grpo \\\n    --tensor-model-parallel-size 8 \\\n    --expert-model-parallel-size 4 \\\n    --prompt-data \u002Fpath\u002Fto\u002Fdata.jsonl \\\n    --num-rollout 3000\n```\n\n### Verification Checklist\n- [ ] Model loads without errors\n- [ ] Routing decisions are consistent\n- [ ] No NaN\u002FInf in loss values\n\n---\n\n## Workflow 2: Speculative RL Training\n\nUse this workflow for maximum rollout throughput with EAGLE speculative decoding.\n\n### How Speculative RL Works\n\n1. Small draft model generates candidate tokens\n2. Target model verifies in parallel\n3. Draft model updated via online SFT to track policy\n\n### Step 1: Enable Speculative Decoding\n\nmiles supports EAGLE speculative decoding via SGLang:\n\n```bash\npython train.py \\\n    --actor-num-gpus-per-node 8 \\\n    --hf-checkpoint \u002Fpath\u002Fto\u002Ftarget-model \\\n    --sglang-speculative-algorithm EAGLE \\\n    --sglang-speculative-num-steps 3 \\\n    --sglang-speculative-eagle-topk 1 \\\n    --sglang-speculative-num-draft-tokens 4 \\\n    --sglang-speculative-draft-model-path \u002Fpath\u002Fto\u002Fdraft-model \\\n    --advantage-estimator grpo \\\n    --prompt-data \u002Fpath\u002Fto\u002Fdata.jsonl\n```\n\n### Step 2: Enable Online MTP Training (Optional)\n\nFor online SFT of draft model during training:\n\n```bash\n--mtp-num-layers 1 \\\n--enable-mtp-training \\\n--mtp-loss-scaling-factor 0.2\n```\n\n**Note**: Online MTP training requires a torch dist checkpoint with MTP weights. Add `--mtp-num-layers 1` during checkpoint conversion from HuggingFace.\n\n### Expected Speedup\n\n- **Standard rollout**: Baseline\n- **Speculative RL**: 25-40% faster rollout\n- **With partial rollout**: Additional 10-15% throughput\n\n---\n\n## Configuration Reference\n\nmiles inherits all slime arguments. See [slime API Reference](..\u002Fslime\u002Freferences\u002Fapi-reference.md) for the complete list.\n\n### Cluster Resources (from slime)\n\n```bash\n--actor-num-nodes 1\n--actor-num-gpus-per-node 8\n--rollout-num-gpus 8\n--rollout-num-gpus-per-engine 2\n--colocate\n```\n\n### Megatron Parallelism (from slime)\n\n```bash\n--tensor-model-parallel-size 8\n--pipeline-model-parallel-size 2\n--expert-model-parallel-size 4    # MoE expert parallelism\n```\n\n### Speculative Decoding (miles-specific)\n\n```bash\n--sglang-speculative-algorithm EAGLE\n--sglang-speculative-num-steps 3\n--sglang-speculative-eagle-topk 1\n--sglang-speculative-num-draft-tokens 4\n--sglang-enable-draft-weights-cpu-backup\n--sglang-speculative-draft-model-path \u002Fyour\u002Fdraft\u002Fmodel\u002Fpath\n```\n\n### Online MTP Training (miles-specific)\n\n```bash\n--mtp-num-layers 1\n--enable-mtp-training\n--mtp-loss-scaling-factor 0.2\n```\n\n---\n\n## Key Features (Conceptual)\n\nThe following features are documented in miles but specific CLI flags may vary. Consult the miles repository for latest configuration.\n\n### Unified FP8 Pipeline\n\nEnd-to-end FP8 sampling and training that eliminates quantization-induced discrepancy causing RL collapse in MoE models.\n\n### Rollout Routing Replay (R3)\n\nRecords expert routing decisions during SGLang inference and replays them during Megatron training for bit-wise expert alignment.\n\n**How R3 Works**:\n1. During SGLang inference, expert routing decisions are recorded\n2. Routing decisions stored in `sample.rollout_routed_experts`\n3. During Megatron training, routing is replayed instead of recomputed\n4. Ensures identical expert selection between train and inference\n\n### INT4 Quantization-Aware Training\n\nEnables single-machine deployment of 1TB+ models (e.g., on H200).\n\n**Memory Savings with INT4**:\n\n| Model Size | BF16 VRAM | INT4 VRAM | Reduction |\n|------------|-----------|-----------|-----------|\n| 70B | 140GB | 45GB | 3.1x |\n| 235B | 470GB | 150GB | 3.1x |\n| 671B | 1.3TB | 420GB | 3.1x |\n\n### Train-Inference Alignment\n\nmiles achieves \"exactly 0 KL divergence\" between training and inference through:\n- Flash Attention 3\n- DeepGEMM\n- Batch-invariant kernels from Thinking Machines Lab\n- `torch.compile` integration\n\n---\n\n## Sample Data Structure\n\nmiles uses the same `Sample` dataclass as slime with the `rollout_routed_experts` field for MoE routing replay:\n\n```python\n@dataclass\nclass Sample:\n    prompt: str | list[dict]\n    tokens: list[int]\n    response: str\n    reward: float | dict\n    loss_mask: list[int]\n    status: Status\n    metadata: dict\n    rollout_log_probs: list[float]\n    rollout_routed_experts: list[list[int]]  # MoE routing for R3\n```\n\nSee [slime API Reference](..\u002Fslime\u002Freferences\u002Fapi-reference.md) for the complete Sample definition.\n\n---\n\n## Common Issues and Solutions\n\n### Issue: FP8 Training Collapse\n\n**Symptoms**: Loss explodes, NaN values\n\n**Solutions**:\n- Use block scaling: `export NVTE_FP8_BLOCK_SCALING_FP32_SCALES=1`\n- Reduce learning rate: `--lr 5e-7`\n- Ensure MoE routing is consistent between train\u002Finference\n\n### Issue: Speculative Draft Drift\n\n**Symptoms**: Low acceptance rate over time\n\n**Solutions**:\n- Enable online MTP training to keep draft model aligned\n- Reduce speculative steps: `--sglang-speculative-num-steps 2`\n- Use CPU backup: `--sglang-enable-draft-weights-cpu-backup`\n\n### Issue: Train-Inference Mismatch\n\n**Symptoms**: Policy divergence, reward collapse\n\n**Solutions**:\n- Use TIS for off-policy correction: `--use-tis --tis-threshold 0.9`\n- Verify log probs match between SGLang and Megatron\n- Enable R3 for MoE models\n\n---\n\n## Supported Models\n\n| Family | Models | MoE Support |\n|--------|--------|-------------|\n| DeepSeek | R1, V3, V3.2 | Full |\n| Qwen | 2, 2.5, 3 (including MoE) | Full |\n| Llama | 3, 3.1, 3.3, 4 | Dense only |\n| Gemma | 2, 3, 3N | Dense only |\n| GLM | 4.5, 4.6, 4.7 | Dense only |\n| MiniMax | M2, M2.1 | Full |\n\n---\n\n## Resources\n\n- **GitHub**: https:\u002F\u002Fgithub.com\u002Fradixark\u002Fmiles\n- **Introduction Blog**: https:\u002F\u002Flmsys.org\u002Fblog\u002F2025-11-19-miles\u002F\n- **Slime (upstream)**: https:\u002F\u002Fgithub.com\u002FTHUDM\u002Fslime\n- **SGLang**: https:\u002F\u002Fgithub.com\u002Fsgl-project\u002Fsglang\n\n","# miles: Enterprise-Grade RL for Large-Scale Model Training\n\nmiles is a high-performance, enterprise-ready RL framework optimized for large-scale model post-training. Built as a production fork of slime, it addresses critical challenges in MoE training stability, low-precision training, and train-inference alignment.\n\n## When to Use miles\n\n**Choose miles when you need:**\n- Training 1TB+ MoE models (DeepSeek V3, Qwen3-MoE)\n- FP8 or INT4 quantization-aware training\n- Bit-wise identical train-inference alignment\n- Speculative RL for maximum throughput\n- Production stability with enterprise support\n\n**Consider alternatives when:**\n- You want the research-grade original → use **slime**\n- You need flexible backend swapping → use **verl**\n- You want PyTorch-native abstractions → use **torchforge**\n\n## Key Features\n\n### Low-Precision Training\n- **Unified FP8**: End-to-end FP8 for both inference and training\n- **INT4 QAT**: 1TB models on single-machine VRAM (H200)\n- **Rollout Routing Replay (R3)**: Bit-wise expert alignment for MoE\n\n### Performance Optimizations\n- **Speculative RL**: 25%+ rollout speedup with online SFT draft models\n- **Zero-Copy Weight Sync**: CUDA IPC zero-copy mapping\n- **Partial Rollout**: Recycle half-finished trajectories\n\n### Train-Inference Alignment\n- **TIS\u002FMIS**: Truncated\u002FMasked Importance Sampling for off-policy correction\n- **Kernel-level optimization**: FlashAttention-3, DeepGEMM integration\n\n## Installation\n\n```bash\n# Recommended: Docker\ndocker pull radixark\u002Fmiles:latest\ndocker run --rm --gpus all --ipc=host --shm-size=16g \\\n  -it radixark\u002Fmiles:latest \u002Fbin\u002Fbash\n\n# From source\ngit clone https:\u002F\u002Fgithub.com\u002Fradixark\u002Fmiles.git\ncd miles\npip install -r requirements.txt\npip install -e .\n```\n\n## Quick Start\n\nmiles inherits slime's configuration system. Basic training:\n\n```bash\npython train.py \\\n    --advantage-estimator grpo \\\n    --model-name qwen3-30b-a3b \\\n    --hf-checkpoint \u002Fpath\u002Fto\u002Fqwen3-30b-a3b-hf \\\n    --rollout-batch-size 512 \\\n    --n-samples-per-prompt 8\n```\n\n---\n\n## Workflow 1: Large MoE Training\n\nUse this workflow for training large MoE models like DeepSeek V3 or Qwen3-MoE.\n\n### Prerequisites Checklist\n- [ ] H100\u002FH200 GPUs with FP8 support\n- [ ] MoE model (DeepSeek V3, Qwen3-MoE)\n- [ ] Docker environment with miles\n\n### Step 1: Environment Setup\n\n```bash\n# FP8 block scaling (recommended for stability)\nexport NVTE_FP8_BLOCK_SCALING_FP32_SCALES=1\nexport CUDA_DEVICE_MAX_CONNECTIONS=1\n```\n\n### Step 2: Configure Training\n\n```bash\npython train.py \\\n    --actor-num-gpus-per-node 8 \\\n    --rollout-num-gpus 8 \\\n    --hf-checkpoint \u002Fpath\u002Fto\u002Fdeepseek-v3 \\\n    --advantage-estimator grpo \\\n    --tensor-model-parallel-size 8 \\\n    --expert-model-parallel-size 4 \\\n    --prompt-data \u002Fpath\u002Fto\u002Fdata.jsonl \\\n    --num-rollout 3000\n```\n\n### Verification Checklist\n- [ ] Model loads without errors\n- [ ] Routing decisions are consistent\n- [ ] No NaN\u002FInf in loss values\n\n---\n\n## Workflow 2: Speculative RL Training\n\nUse this workflow for maximum rollout throughput with EAGLE speculative decoding.\n\n### How Speculative RL Works\n\n1. Small draft model generates candidate tokens\n2. Target model verifies in parallel\n3. Draft model updated via online SFT to track policy\n\n### Step 1: Enable Speculative Decoding\n\nmiles supports EAGLE speculative decoding via SGLang:\n\n```bash\npython train.py \\\n    --actor-num-gpus-per-node 8 \\\n    --hf-checkpoint \u002Fpath\u002Fto\u002Ftarget-model \\\n    --sglang-speculative-algorithm EAGLE \\\n    --sglang-speculative-num-steps 3 \\\n    --sglang-speculative-eagle-topk 1 \\\n    --sglang-speculative-num-draft-tokens 4 \\\n    --sglang-speculative-draft-model-path \u002Fpath\u002Fto\u002Fdraft-model \\\n    --advantage-estimator grpo \\\n    --prompt-data \u002Fpath\u002Fto\u002Fdata.jsonl\n```\n\n### Step 2: Enable Online MTP Training (Optional)\n\nFor online SFT of draft model during training:\n\n```bash\n--mtp-num-layers 1 \\\n--enable-mtp-training \\\n--mtp-loss-scaling-factor 0.2\n```\n\n**Note**: Online MTP training requires a torch dist checkpoint with MTP weights. Add `--mtp-num-layers 1` during checkpoint conversion from HuggingFace.\n\n### Expected Speedup\n\n- **Standard rollout**: Baseline\n- **Speculative RL**: 25-40% faster rollout\n- **With partial rollout**: Additional 10-15% throughput\n\n---\n\n## Configuration Reference\n\nmiles inherits all slime arguments. See [slime API Reference](..\u002Fslime\u002Freferences\u002Fapi-reference.md) for the complete list.\n\n### Cluster Resources (from slime)\n\n```bash\n--actor-num-nodes 1\n--actor-num-gpus-per-node 8\n--rollout-num-gpus 8\n--rollout-num-gpus-per-engine 2\n--colocate\n```\n\n### Megatron Parallelism (from slime)\n\n```bash\n--tensor-model-parallel-size 8\n--pipeline-model-parallel-size 2\n--expert-model-parallel-size 4    # MoE expert parallelism\n```\n\n### Speculative Decoding (miles-specific)\n\n```bash\n--sglang-speculative-algorithm EAGLE\n--sglang-speculative-num-steps 3\n--sglang-speculative-eagle-topk 1\n--sglang-speculative-num-draft-tokens 4\n--sglang-enable-draft-weights-cpu-backup\n--sglang-speculative-draft-model-path \u002Fyour\u002Fdraft\u002Fmodel\u002Fpath\n```\n\n### Online MTP Training (miles-specific)\n\n```bash\n--mtp-num-layers 1\n--enable-mtp-training\n--mtp-loss-scaling-factor 0.2\n```\n\n---\n\n## Key Features (Conceptual)\n\nThe following features are documented in miles but specific CLI flags may vary. Consult the miles repository for latest configuration.\n\n### Unified FP8 Pipeline\n\nEnd-to-end FP8 sampling and training that eliminates quantization-induced discrepancy causing RL collapse in MoE models.\n\n### Rollout Routing Replay (R3)\n\nRecords expert routing decisions during SGLang inference and replays them during Megatron training for bit-wise expert alignment.\n\n**How R3 Works**:\n1. During SGLang inference, expert routing decisions are recorded\n2. Routing decisions stored in `sample.rollout_routed_experts`\n3. During Megatron training, routing is replayed instead of recomputed\n4. Ensures identical expert selection between train and inference\n\n### INT4 Quantization-Aware Training\n\nEnables single-machine deployment of 1TB+ models (e.g., on H200).\n\n**Memory Savings with INT4**:\n\n| Model Size | BF16 VRAM | INT4 VRAM | Reduction |\n|------------|-----------|-----------|-----------|\n| 70B | 140GB | 45GB | 3.1x |\n| 235B | 470GB | 150GB | 3.1x |\n| 671B | 1.3TB | 420GB | 3.1x |\n\n### Train-Inference Alignment\n\nmiles achieves \"exactly 0 KL divergence\" between training and inference through:\n- Flash Attention 3\n- DeepGEMM\n- Batch-invariant kernels from Thinking Machines Lab\n- `torch.compile` integration\n\n---\n\n## Sample Data Structure\n\nmiles uses the same `Sample` dataclass as slime with the `rollout_routed_experts` field for MoE routing replay:\n\n```python\n@dataclass\nclass Sample:\n    prompt: str | list[dict]\n    tokens: list[int]\n    response: str\n    reward: float | dict\n    loss_mask: list[int]\n    status: Status\n    metadata: dict\n    rollout_log_probs: list[float]\n    rollout_routed_experts: list[list[int]]  # MoE routing for R3\n```\n\nSee [slime API Reference](..\u002Fslime\u002Freferences\u002Fapi-reference.md) for the complete Sample definition.\n\n---\n\n## Common Issues and Solutions\n\n### Issue: FP8 Training Collapse\n\n**Symptoms**: Loss explodes, NaN values\n\n**Solutions**:\n- Use block scaling: `export NVTE_FP8_BLOCK_SCALING_FP32_SCALES=1`\n- Reduce learning rate: `--lr 5e-7`\n- Ensure MoE routing is consistent between train\u002Finference\n\n### Issue: Speculative Draft Drift\n\n**Symptoms**: Low acceptance rate over time\n\n**Solutions**:\n- Enable online MTP training to keep draft model aligned\n- Reduce speculative steps: `--sglang-speculative-num-steps 2`\n- Use CPU backup: `--sglang-enable-draft-weights-cpu-backup`\n\n### Issue: Train-Inference Mismatch\n\n**Symptoms**: Policy divergence, reward collapse\n\n**Solutions**:\n- Use TIS for off-policy correction: `--use-tis --tis-threshold 0.9`\n- Verify log probs match between SGLang and Megatron\n- Enable R3 for MoE models\n\n---\n\n## Supported Models\n\n| Family | Models | MoE Support |\n|--------|--------|-------------|\n| DeepSeek | R1, V3, V3.2 | Full |\n| Qwen | 2, 2.5, 3 (including MoE) | Full |\n| Llama | 3, 3.1, 3.3, 4 | Dense only |\n| Gemma | 2, 3, 3N | Dense only |\n| GLM | 4.5, 4.6, 4.7 | Dense only |\n| MiniMax | M2, M2.1 | Full |\n\n---\n\n## Resources\n\n- **GitHub**: https:\u002F\u002Fgithub.com\u002Fradixark\u002Fmiles\n- **Introduction Blog**: https:\u002F\u002Flmsys.org\u002Fblog\u002F2025-11-19-miles\u002F\n- **Slime (upstream)**: https:\u002F\u002Fgithub.com\u002FTHUDM\u002Fslime\n- **SGLang**: https:\u002F\u002Fgithub.com\u002Fsgl-project\u002Fsglang\n\n",{"name":5,"tags":24,"author":32,"license":15,"version":33,"description":7,"dependencies":34},[25,26,27,28,29,30,31],"Reinforcement Learning","MoE","FP8","INT4","Enterprise","SGLang","Megatron-LM","Orchestra Research","1.0.0",[35,36,37,38],"sglang-router>=0.2.3","ray","torch>=2.0.0","transformers>=4.40.0","master","c247302c836de6438d746b45670990eb71691166","skills_collected\u002FOrchestra-Research--AI-research-SKILLs--06-post-training__miles",1,"https:\u002F\u002Fgithub.com\u002Fqhjqhj00\u002Fresearch-skills-pool","https:\u002F\u002Fgithub.com\u002Fqhjqhj00","chien.io","2026-05-11 15:07:59",{"source":8,"skillName":5,"commands":48,"prompt":58,"zipAvailable":59},[49,52,55],{"tool":50,"command":51},"npx","npx skills add qhjqhj00\u002Fresearch-skills-pool --skill miles-rl-training",{"tool":53,"command":54},"bunx","bunx skills add qhjqhj00\u002Fresearch-skills-pool --skill miles-rl-training",{"tool":56,"command":57},"pnpm","pnpm dlx skills add qhjqhj00\u002Fresearch-skills-pool --skill miles-rl-training","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002Fqhjqhj00\u002Fresearch-skills-pool\u002Fblob\u002Fmaster\u002Fskills_collected\u002FOrchestra-Research--AI-research-SKILLs--06-post-training__miles\u002FSKILL.md",true,[61,67],{"path":62,"resourceType":63,"resourceTypeDesc":64,"sizeBytes":65,"sourceHtmlUrl":66},"references\u002Fapi-reference.md","REFERENCE","参考文档",4137,"https:\u002F\u002Fgithub.com\u002Fqhjqhj00\u002Fresearch-skills-pool\u002Fblob\u002Fmaster\u002Fskills_collected\u002FOrchestra-Research--AI-research-SKILLs--06-post-training__miles\u002Freferences\u002Fapi-reference.md",{"path":68,"resourceType":63,"resourceTypeDesc":64,"sizeBytes":69,"sourceHtmlUrl":70},"references\u002Ftroubleshooting.md",5814,"https:\u002F\u002Fgithub.com\u002Fqhjqhj00\u002Fresearch-skills-pool\u002Fblob\u002Fmaster\u002Fskills_collected\u002FOrchestra-Research--AI-research-SKILLs--06-post-training__miles\u002Freferences\u002Ftroubleshooting.md",[72,79,86,93,100,107],{"skillNo":73,"name":74,"nameZh":6,"description":75,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":76,"categories":77,"keywords":78,"publishedAt":19},"01M73JJB6EQPFPPVQK2Y9N67Q0","transformer-lens-interpretability","Provides guidance for mechanistic interpretability research using TransformerLens to inspect and manipulate transformer internals via HookPoints and activation caching. Use when reverse-engineering model algorithms, studying attention patterns, or performing activation patching experiments.","https:\u002F\u002Fgithub.com\u002Fqhjqhj00\u002Fresearch-skills-pool\u002Fblob\u002Fmaster\u002Ftop100-runs\u002F130-transformer-lens\u002FSKILL.md",[],[],{"skillNo":80,"name":81,"nameZh":6,"description":82,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":83,"categories":84,"keywords":85,"publishedAt":19},"01M73JHTANRRWEE9HP98TPEHAY","wiki-vitepress","Packages generated wiki Markdown into a VitePress static site with dark theme, dark-mode Mermaid diagrams with click-to-zoom, and production build output. Use when the user wants to create a browsable website from generated wiki pages.","https:\u002F\u002Fgithub.com\u002Fqhjqhj00\u002Fresearch-skills-pool\u002Fblob\u002Fmaster\u002Ftop100-runs\u002F126-wiki-vitepress\u002FSKILL.md",[],[],{"skillNo":87,"name":88,"nameZh":6,"description":89,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":90,"categories":91,"keywords":92,"publishedAt":19},"01M73JHJBMVFW46F1Y8K3SBF43","phoenix-observability","Open-source AI observability platform for LLM tracing, evaluation, and monitoring. Use when debugging LLM applications with detailed traces, running evaluations on datasets, or monitoring production AI systems with real-time insights.","https:\u002F\u002Fgithub.com\u002Fqhjqhj00\u002Fresearch-skills-pool\u002Fblob\u002Fmaster\u002Ftop100-runs\u002F124-phoenix\u002FSKILL.md",[],[],{"skillNo":94,"name":95,"nameZh":6,"description":96,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":97,"categories":98,"keywords":99,"publishedAt":19},"01M73JHFPA3A2806PMP42ZN86Q","frontend-ui-dark-ts","Build dark-themed React applications using Tailwind CSS with custom theming, glassmorphism effects, and Framer Motion animations. Use when creating dashboards, admin panels, or data-rich interfaces with a refined dark aesthetic.","https:\u002F\u002Fgithub.com\u002Fqhjqhj00\u002Fresearch-skills-pool\u002Fblob\u002Fmaster\u002Ftop100-runs\u002F123-frontend-ui-dark-ts\u002FSKILL.md",[],[],{"skillNo":101,"name":102,"nameZh":6,"description":103,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":104,"categories":105,"keywords":106,"publishedAt":19},"01M73JFVBVK57NRJS49TT2VDCT","tensorboard","Visualize training metrics, debug models with histograms, compare experiments, visualize model graphs, and profile performance with TensorBoard - Google's ML visualization toolkit","https:\u002F\u002Fgithub.com\u002Fqhjqhj00\u002Fresearch-skills-pool\u002Fblob\u002Fmaster\u002Ftop100-runs\u002F113-tensorboard\u002FSKILL.md",[],[],{"skillNo":108,"name":109,"nameZh":6,"description":110,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":111,"licenseFileUrl":6,"sourceHtmlUrl":112,"categories":113,"keywords":114,"publishedAt":19},"01M73JFF6PK6ZCN41C89J7HS2B","markdown-mermaid-writing","Comprehensive markdown and Mermaid diagram writing skill. Use when creating any scientific document, report, analysis, or visualization. Establishes text-based diagrams as the default documentation standard with full style guides (markdown + mermaid), 24 diagram type references, and 9 document templates.","Apache-2.0","https:\u002F\u002Fgithub.com\u002Fqhjqhj00\u002Fresearch-skills-pool\u002Fblob\u002Fmaster\u002Ftop100-runs\u002F110-markdown-mermaid-writing\u002FSKILL.md",[],[]]