[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M73A1HF1284PA65RPGNF21B7":3,"skill-same:01M73A1HF1284PA65RPGNF21B7":81},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":19,"linkOnly":20,"markdownContent":21,"markdownBody":22,"frontMatter":23,"refName":27,"commitSha":28,"skillDirectory":29,"forksCount":30,"repositoryHtmlUrl":31,"repositoryHomepageUrl":6,"ownerHtmlUrl":32,"ownerBlogUrl":33,"ownerDescription":6,"updatedAt":34,"install":35,"resources":48},"01M73A1HF1284PA65RPGNF21B7","pufferlib",null,"High-performance reinforcement learning framework optimized for speed and scale. Use when you need fast parallel training, vectorized environments, multi-agent systems, or integration with game environments (Atari, Procgen, NetHack). Achieves 2-10x speedups over standard implementations. For quick prototyping or standard algorithm implementations with extensive documentation, use stable-baselines3 instead.","qhjqhj00\u002Fresearch-skills-pool","qhjqhj00","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F29684092?v=4","01M72AE0ZGXVM5C57N512DGQG8","Tommy Chien","01M72AE107ESJMHT7QC5SXX144",3,"MIT","https:\u002F\u002Fgithub.com\u002Fqhjqhj00\u002Fresearch-skills-pool\u002Fblob\u002Fmaster\u002Fskills_collected\u002FK-Dense-AI--scientific-agent-skills--scientific-skills__pufferlib\u002FSKILL.md",[],[],"2026-11-11 15:11:14",false,"---\nname: pufferlib\ndescription: High-performance reinforcement learning framework optimized for speed and scale. Use when you need fast parallel training, vectorized environments, multi-agent systems, or integration with game environments (Atari, Procgen, NetHack). Achieves 2-10x speedups over standard implementations. For quick prototyping or standard algorithm implementations with extensive documentation, use stable-baselines3 instead.\nlicense: MIT license\nmetadata:\n    skill-author: K-Dense Inc.\n---\n\n# PufferLib - High-Performance Reinforcement Learning\n\n## Overview\n\nPufferLib is a high-performance reinforcement learning library designed for fast parallel environment simulation and training. It achieves training at millions of steps per second through optimized vectorization, native multi-agent support, and efficient PPO implementation (PuffeRL). The library provides the Ocean suite of 20+ environments and seamless integration with Gymnasium, PettingZoo, and specialized RL frameworks.\n\n## When to Use This Skill\n\nUse this skill when:\n- **Training RL agents** with PPO on any environment (single or multi-agent)\n- **Creating custom environments** using the PufferEnv API\n- **Optimizing performance** for parallel environment simulation (vectorization)\n- **Integrating existing environments** from Gymnasium, PettingZoo, Atari, Procgen, etc.\n- **Developing policies** with CNN, LSTM, or custom architectures\n- **Scaling RL** to millions of steps per second for faster experimentation\n- **Multi-agent RL** with native multi-agent environment support\n\n## Core Capabilities\n\n### 1. High-Performance Training (PuffeRL)\n\nPuffeRL is PufferLib's optimized PPO+LSTM training algorithm achieving 1M-4M steps\u002Fsecond.\n\n**Quick start training:**\n```bash\n# CLI training\npuffer train procgen-coinrun --train.device cuda --train.learning-rate 3e-4\n\n# Distributed training\ntorchrun --nproc_per_node=4 train.py\n```\n\n**Python training loop:**\n```python\nimport pufferlib\nfrom pufferlib import PuffeRL\n\n# Create vectorized environment\nenv = pufferlib.make('procgen-coinrun', num_envs=256)\n\n# Create trainer\ntrainer = PuffeRL(\n    env=env,\n    policy=my_policy,\n    device='cuda',\n    learning_rate=3e-4,\n    batch_size=32768\n)\n\n# Training loop\nfor iteration in range(num_iterations):\n    trainer.evaluate()  # Collect rollouts\n    trainer.train()     # Train on batch\n    trainer.mean_and_log()  # Log results\n```\n\n**For comprehensive training guidance**, read `references\u002Ftraining.md` for:\n- Complete training workflow and CLI options\n- Hyperparameter tuning with Protein\n- Distributed multi-GPU\u002Fmulti-node training\n- Logger integration (Weights & Biases, Neptune)\n- Checkpointing and resume training\n- Performance optimization tips\n- Curriculum learning patterns\n\n### 2. Environment Development (PufferEnv)\n\nCreate custom high-performance environments with the PufferEnv API.\n\n**Basic environment structure:**\n```python\nimport numpy as np\nfrom pufferlib import PufferEnv\n\nclass MyEnvironment(PufferEnv):\n    def __init__(self, buf=None):\n        super().__init__(buf)\n\n        # Define spaces\n        self.observation_space = self.make_space((4,))\n        self.action_space = self.make_discrete(4)\n\n        self.reset()\n\n    def reset(self):\n        # Reset state and return initial observation\n        return np.zeros(4, dtype=np.float32)\n\n    def step(self, action):\n        # Execute action, compute reward, check done\n        obs = self._get_observation()\n        reward = self._compute_reward()\n        done = self._is_done()\n        info = {}\n\n        return obs, reward, done, info\n```\n\n**Use the template script:** `scripts\u002Fenv_template.py` provides complete single-agent and multi-agent environment templates with examples of:\n- Different observation space types (vector, image, dict)\n- Action space variations (discrete, continuous, multi-discrete)\n- Multi-agent environment structure\n- Testing utilities\n\n**For complete environment development**, read `references\u002Fenvironments.md` for:\n- PufferEnv API details and in-place operation patterns\n- Observation and action space definitions\n- Multi-agent environment creation\n- Ocean suite (20+ pre-built environments)\n- Performance optimization (Python to C workflow)\n- Environment wrappers and best practices\n- Debugging and validation techniques\n\n### 3. Vectorization and Performance\n\nAchieve maximum throughput with optimized parallel simulation.\n\n**Vectorization setup:**\n```python\nimport pufferlib\n\n# Automatic vectorization\nenv = pufferlib.make('environment_name', num_envs=256, num_workers=8)\n\n# Performance benchmarks:\n# - Pure Python envs: 100k-500k SPS\n# - C-based envs: 100M+ SPS\n# - With training: 400k-4M total SPS\n```\n\n**Key optimizations:**\n- Shared memory buffers for zero-copy observation passing\n- Busy-wait flags instead of pipes\u002Fqueues\n- Surplus environments for async returns\n- Multiple environments per worker\n\n**For vectorization optimization**, read `references\u002Fvectorization.md` for:\n- Architecture and performance characteristics\n- Worker and batch size configuration\n- Serial vs multiprocessing vs async modes\n- Shared memory and zero-copy patterns\n- Hierarchical vectorization for large scale\n- Multi-agent vectorization strategies\n- Performance profiling and troubleshooting\n\n### 4. Policy Development\n\nBuild policies as standard PyTorch modules with optional utilities.\n\n**Basic policy structure:**\n```python\nimport torch.nn as nn\nfrom pufferlib.pytorch import layer_init\n\nclass Policy(nn.Module):\n    def __init__(self, observation_space, action_space):\n        super().__init__()\n\n        # Encoder\n        self.encoder = nn.Sequential(\n            layer_init(nn.Linear(obs_dim, 256)),\n            nn.ReLU(),\n            layer_init(nn.Linear(256, 256)),\n            nn.ReLU()\n        )\n\n        # Actor and critic heads\n        self.actor = layer_init(nn.Linear(256, num_actions), std=0.01)\n        self.critic = layer_init(nn.Linear(256, 1), std=1.0)\n\n    def forward(self, observations):\n        features = self.encoder(observations)\n        return self.actor(features), self.critic(features)\n```\n\n**For complete policy development**, read `references\u002Fpolicies.md` for:\n- CNN policies for image observations\n- Recurrent policies with optimized LSTM (3x faster inference)\n- Multi-input policies for complex observations\n- Continuous action policies\n- Multi-agent policies (shared vs independent parameters)\n- Advanced architectures (attention, residual)\n- Observation normalization and gradient clipping\n- Policy debugging and testing\n\n### 5. Environment Integration\n\nSeamlessly integrate environments from popular RL frameworks.\n\n**Gymnasium integration:**\n```python\nimport gymnasium as gym\nimport pufferlib\n\n# Wrap Gymnasium environment\ngym_env = gym.make('CartPole-v1')\nenv = pufferlib.emulate(gym_env, num_envs=256)\n\n# Or use make directly\nenv = pufferlib.make('gym-CartPole-v1', num_envs=256)\n```\n\n**PettingZoo multi-agent:**\n```python\n# Multi-agent environment\nenv = pufferlib.make('pettingzoo-knights-archers-zombies', num_envs=128)\n```\n\n**Supported frameworks:**\n- Gymnasium \u002F OpenAI Gym\n- PettingZoo (parallel and AEC)\n- Atari (ALE)\n- Procgen\n- NetHack \u002F MiniHack\n- Minigrid\n- Neural MMO\n- Crafter\n- GPUDrive\n- MicroRTS\n- Griddly\n- And more...\n\n**For integration details**, read `references\u002Fintegration.md` for:\n- Complete integration examples for each framework\n- Custom wrappers (observation, reward, frame stacking, action repeat)\n- Space flattening and unflattening\n- Environment registration\n- Compatibility patterns\n- Performance considerations\n- Integration debugging\n\n## Quick Start Workflow\n\n### For Training Existing Environments\n\n1. Choose environment from Ocean suite or compatible framework\n2. Use `scripts\u002Ftrain_template.py` as starting point\n3. Configure hyperparameters for your task\n4. Run training with CLI or Python script\n5. Monitor with Weights & Biases or Neptune\n6. Refer to `references\u002Ftraining.md` for optimization\n\n### For Creating Custom Environments\n\n1. Start with `scripts\u002Fenv_template.py`\n2. Define observation and action spaces\n3. Implement `reset()` and `step()` methods\n4. Test environment locally\n5. Vectorize with `pufferlib.emulate()` or `make()`\n6. Refer to `references\u002Fenvironments.md` for advanced patterns\n7. Optimize with `references\u002Fvectorization.md` if needed\n\n### For Policy Development\n\n1. Choose architecture based on observations:\n   - Vector observations → MLP policy\n   - Image observations → CNN policy\n   - Sequential tasks → LSTM policy\n   - Complex observations → Multi-input policy\n2. Use `layer_init` for proper weight initialization\n3. Follow patterns in `references\u002Fpolicies.md`\n4. Test with environment before full training\n\n### For Performance Optimization\n\n1. Profile current throughput (steps per second)\n2. Check vectorization configuration (num_envs, num_workers)\n3. Optimize environment code (in-place ops, numpy vectorization)\n4. Consider C implementation for critical paths\n5. Use `references\u002Fvectorization.md` for systematic optimization\n\n## Resources\n\n### scripts\u002F\n\n**train_template.py** - Complete training script template with:\n- Environment creation and configuration\n- Policy initialization\n- Logger integration (WandB, Neptune)\n- Training loop with checkpointing\n- Command-line argument parsing\n- Multi-GPU distributed training setup\n\n**env_template.py** - Environment implementation templates:\n- Single-agent PufferEnv example (grid world)\n- Multi-agent PufferEnv example (cooperative navigation)\n- Multiple observation\u002Faction space patterns\n- Testing utilities\n\n### references\u002F\n\n**training.md** - Comprehensive training guide:\n- Training workflow and CLI options\n- Hyperparameter configuration\n- Distributed training (multi-GPU, multi-node)\n- Monitoring and logging\n- Checkpointing\n- Protein hyperparameter tuning\n- Performance optimization\n- Common training patterns\n- Troubleshooting\n\n**environments.md** - Environment development guide:\n- PufferEnv API and characteristics\n- Observation and action spaces\n- Multi-agent environments\n- Ocean suite environments\n- Custom environment development workflow\n- Python to C optimization path\n- Third-party environment integration\n- Wrappers and best practices\n- Debugging\n\n**vectorization.md** - Vectorization optimization:\n- Architecture and key optimizations\n- Vectorization modes (serial, multiprocessing, async)\n- Worker and batch configuration\n- Shared memory and zero-copy patterns\n- Advanced vectorization (hierarchical, custom)\n- Multi-agent vectorization\n- Performance monitoring and profiling\n- Troubleshooting and best practices\n\n**policies.md** - Policy architecture guide:\n- Basic policy structure\n- CNN policies for images\n- LSTM policies with optimization\n- Multi-input policies\n- Continuous action policies\n- Multi-agent policies\n- Advanced architectures (attention, residual)\n- Observation processing and unflattening\n- Initialization and normalization\n- Debugging and testing\n\n**integration.md** - Framework integration guide:\n- Gymnasium integration\n- PettingZoo integration (parallel and AEC)\n- Third-party environments (Procgen, NetHack, Minigrid, etc.)\n- Custom wrappers (observation, reward, frame stacking, etc.)\n- Space conversion and unflattening\n- Environment registration\n- Compatibility patterns\n- Performance considerations\n- Debugging integration\n\n## Tips for Success\n\n1. **Start simple**: Begin with Ocean environments or Gymnasium integration before creating custom environments\n\n2. **Profile early**: Measure steps per second from the start to identify bottlenecks\n\n3. **Use templates**: `scripts\u002Ftrain_template.py` and `scripts\u002Fenv_template.py` provide solid starting points\n\n4. **Read references as needed**: Each reference file is self-contained and focused on a specific capability\n\n5. **Optimize progressively**: Start with Python, profile, then optimize critical paths with C if needed\n\n6. **Leverage vectorization**: PufferLib's vectorization is key to achieving high throughput\n\n7. **Monitor training**: Use WandB or Neptune to track experiments and identify issues early\n\n8. **Test environments**: Validate environment logic before scaling up training\n\n9. **Check existing environments**: Ocean suite provides 20+ pre-built environments\n\n10. **Use proper initialization**: Always use `layer_init` from `pufferlib.pytorch` for policies\n\n## Common Use Cases\n\n### Training on Standard Benchmarks\n```python\n# Atari\nenv = pufferlib.make('atari-pong', num_envs=256)\n\n# Procgen\nenv = pufferlib.make('procgen-coinrun', num_envs=256)\n\n# Minigrid\nenv = pufferlib.make('minigrid-empty-8x8', num_envs=256)\n```\n\n### Multi-Agent Learning\n```python\n# PettingZoo\nenv = pufferlib.make('pettingzoo-pistonball', num_envs=128)\n\n# Shared policy for all agents\npolicy = create_policy(env.observation_space, env.action_space)\ntrainer = PuffeRL(env=env, policy=policy)\n```\n\n### Custom Task Development\n```python\n# Create custom environment\nclass MyTask(PufferEnv):\n    # ... implement environment ...\n\n# Vectorize and train\nenv = pufferlib.emulate(MyTask, num_envs=256)\ntrainer = PuffeRL(env=env, policy=my_policy)\n```\n\n### High-Performance Optimization\n```python\n# Maximize throughput\nenv = pufferlib.make(\n    'my-env',\n    num_envs=1024,      # Large batch\n    num_workers=16,     # Many workers\n    envs_per_worker=64  # Optimize per worker\n)\n```\n\n## Installation\n\n```bash\nuv pip install pufferlib\n```\n\n## Documentation\n\n- Official docs: https:\u002F\u002Fpuffer.ai\u002Fdocs.html\n- GitHub: https:\u002F\u002Fgithub.com\u002FPufferAI\u002FPufferLib\n- Discord: Community support available\n\n","# PufferLib - High-Performance Reinforcement Learning\n\n## Overview\n\nPufferLib is a high-performance reinforcement learning library designed for fast parallel environment simulation and training. It achieves training at millions of steps per second through optimized vectorization, native multi-agent support, and efficient PPO implementation (PuffeRL). The library provides the Ocean suite of 20+ environments and seamless integration with Gymnasium, PettingZoo, and specialized RL frameworks.\n\n## When to Use This Skill\n\nUse this skill when:\n- **Training RL agents** with PPO on any environment (single or multi-agent)\n- **Creating custom environments** using the PufferEnv API\n- **Optimizing performance** for parallel environment simulation (vectorization)\n- **Integrating existing environments** from Gymnasium, PettingZoo, Atari, Procgen, etc.\n- **Developing policies** with CNN, LSTM, or custom architectures\n- **Scaling RL** to millions of steps per second for faster experimentation\n- **Multi-agent RL** with native multi-agent environment support\n\n## Core Capabilities\n\n### 1. High-Performance Training (PuffeRL)\n\nPuffeRL is PufferLib's optimized PPO+LSTM training algorithm achieving 1M-4M steps\u002Fsecond.\n\n**Quick start training:**\n```bash\n# CLI training\npuffer train procgen-coinrun --train.device cuda --train.learning-rate 3e-4\n\n# Distributed training\ntorchrun --nproc_per_node=4 train.py\n```\n\n**Python training loop:**\n```python\nimport pufferlib\nfrom pufferlib import PuffeRL\n\n# Create vectorized environment\nenv = pufferlib.make('procgen-coinrun', num_envs=256)\n\n# Create trainer\ntrainer = PuffeRL(\n    env=env,\n    policy=my_policy,\n    device='cuda',\n    learning_rate=3e-4,\n    batch_size=32768\n)\n\n# Training loop\nfor iteration in range(num_iterations):\n    trainer.evaluate()  # Collect rollouts\n    trainer.train()     # Train on batch\n    trainer.mean_and_log()  # Log results\n```\n\n**For comprehensive training guidance**, read `references\u002Ftraining.md` for:\n- Complete training workflow and CLI options\n- Hyperparameter tuning with Protein\n- Distributed multi-GPU\u002Fmulti-node training\n- Logger integration (Weights & Biases, Neptune)\n- Checkpointing and resume training\n- Performance optimization tips\n- Curriculum learning patterns\n\n### 2. Environment Development (PufferEnv)\n\nCreate custom high-performance environments with the PufferEnv API.\n\n**Basic environment structure:**\n```python\nimport numpy as np\nfrom pufferlib import PufferEnv\n\nclass MyEnvironment(PufferEnv):\n    def __init__(self, buf=None):\n        super().__init__(buf)\n\n        # Define spaces\n        self.observation_space = self.make_space((4,))\n        self.action_space = self.make_discrete(4)\n\n        self.reset()\n\n    def reset(self):\n        # Reset state and return initial observation\n        return np.zeros(4, dtype=np.float32)\n\n    def step(self, action):\n        # Execute action, compute reward, check done\n        obs = self._get_observation()\n        reward = self._compute_reward()\n        done = self._is_done()\n        info = {}\n\n        return obs, reward, done, info\n```\n\n**Use the template script:** `scripts\u002Fenv_template.py` provides complete single-agent and multi-agent environment templates with examples of:\n- Different observation space types (vector, image, dict)\n- Action space variations (discrete, continuous, multi-discrete)\n- Multi-agent environment structure\n- Testing utilities\n\n**For complete environment development**, read `references\u002Fenvironments.md` for:\n- PufferEnv API details and in-place operation patterns\n- Observation and action space definitions\n- Multi-agent environment creation\n- Ocean suite (20+ pre-built environments)\n- Performance optimization (Python to C workflow)\n- Environment wrappers and best practices\n- Debugging and validation techniques\n\n### 3. Vectorization and Performance\n\nAchieve maximum throughput with optimized parallel simulation.\n\n**Vectorization setup:**\n```python\nimport pufferlib\n\n# Automatic vectorization\nenv = pufferlib.make('environment_name', num_envs=256, num_workers=8)\n\n# Performance benchmarks:\n# - Pure Python envs: 100k-500k SPS\n# - C-based envs: 100M+ SPS\n# - With training: 400k-4M total SPS\n```\n\n**Key optimizations:**\n- Shared memory buffers for zero-copy observation passing\n- Busy-wait flags instead of pipes\u002Fqueues\n- Surplus environments for async returns\n- Multiple environments per worker\n\n**For vectorization optimization**, read `references\u002Fvectorization.md` for:\n- Architecture and performance characteristics\n- Worker and batch size configuration\n- Serial vs multiprocessing vs async modes\n- Shared memory and zero-copy patterns\n- Hierarchical vectorization for large scale\n- Multi-agent vectorization strategies\n- Performance profiling and troubleshooting\n\n### 4. Policy Development\n\nBuild policies as standard PyTorch modules with optional utilities.\n\n**Basic policy structure:**\n```python\nimport torch.nn as nn\nfrom pufferlib.pytorch import layer_init\n\nclass Policy(nn.Module):\n    def __init__(self, observation_space, action_space):\n        super().__init__()\n\n        # Encoder\n        self.encoder = nn.Sequential(\n            layer_init(nn.Linear(obs_dim, 256)),\n            nn.ReLU(),\n            layer_init(nn.Linear(256, 256)),\n            nn.ReLU()\n        )\n\n        # Actor and critic heads\n        self.actor = layer_init(nn.Linear(256, num_actions), std=0.01)\n        self.critic = layer_init(nn.Linear(256, 1), std=1.0)\n\n    def forward(self, observations):\n        features = self.encoder(observations)\n        return self.actor(features), self.critic(features)\n```\n\n**For complete policy development**, read `references\u002Fpolicies.md` for:\n- CNN policies for image observations\n- Recurrent policies with optimized LSTM (3x faster inference)\n- Multi-input policies for complex observations\n- Continuous action policies\n- Multi-agent policies (shared vs independent parameters)\n- Advanced architectures (attention, residual)\n- Observation normalization and gradient clipping\n- Policy debugging and testing\n\n### 5. Environment Integration\n\nSeamlessly integrate environments from popular RL frameworks.\n\n**Gymnasium integration:**\n```python\nimport gymnasium as gym\nimport pufferlib\n\n# Wrap Gymnasium environment\ngym_env = gym.make('CartPole-v1')\nenv = pufferlib.emulate(gym_env, num_envs=256)\n\n# Or use make directly\nenv = pufferlib.make('gym-CartPole-v1', num_envs=256)\n```\n\n**PettingZoo multi-agent:**\n```python\n# Multi-agent environment\nenv = pufferlib.make('pettingzoo-knights-archers-zombies', num_envs=128)\n```\n\n**Supported frameworks:**\n- Gymnasium \u002F OpenAI Gym\n- PettingZoo (parallel and AEC)\n- Atari (ALE)\n- Procgen\n- NetHack \u002F MiniHack\n- Minigrid\n- Neural MMO\n- Crafter\n- GPUDrive\n- MicroRTS\n- Griddly\n- And more...\n\n**For integration details**, read `references\u002Fintegration.md` for:\n- Complete integration examples for each framework\n- Custom wrappers (observation, reward, frame stacking, action repeat)\n- Space flattening and unflattening\n- Environment registration\n- Compatibility patterns\n- Performance considerations\n- Integration debugging\n\n## Quick Start Workflow\n\n### For Training Existing Environments\n\n1. Choose environment from Ocean suite or compatible framework\n2. Use `scripts\u002Ftrain_template.py` as starting point\n3. Configure hyperparameters for your task\n4. Run training with CLI or Python script\n5. Monitor with Weights & Biases or Neptune\n6. Refer to `references\u002Ftraining.md` for optimization\n\n### For Creating Custom Environments\n\n1. Start with `scripts\u002Fenv_template.py`\n2. Define observation and action spaces\n3. Implement `reset()` and `step()` methods\n4. Test environment locally\n5. Vectorize with `pufferlib.emulate()` or `make()`\n6. Refer to `references\u002Fenvironments.md` for advanced patterns\n7. Optimize with `references\u002Fvectorization.md` if needed\n\n### For Policy Development\n\n1. Choose architecture based on observations:\n   - Vector observations → MLP policy\n   - Image observations → CNN policy\n   - Sequential tasks → LSTM policy\n   - Complex observations → Multi-input policy\n2. Use `layer_init` for proper weight initialization\n3. Follow patterns in `references\u002Fpolicies.md`\n4. Test with environment before full training\n\n### For Performance Optimization\n\n1. Profile current throughput (steps per second)\n2. Check vectorization configuration (num_envs, num_workers)\n3. Optimize environment code (in-place ops, numpy vectorization)\n4. Consider C implementation for critical paths\n5. Use `references\u002Fvectorization.md` for systematic optimization\n\n## Resources\n\n### scripts\u002F\n\n**train_template.py** - Complete training script template with:\n- Environment creation and configuration\n- Policy initialization\n- Logger integration (WandB, Neptune)\n- Training loop with checkpointing\n- Command-line argument parsing\n- Multi-GPU distributed training setup\n\n**env_template.py** - Environment implementation templates:\n- Single-agent PufferEnv example (grid world)\n- Multi-agent PufferEnv example (cooperative navigation)\n- Multiple observation\u002Faction space patterns\n- Testing utilities\n\n### references\u002F\n\n**training.md** - Comprehensive training guide:\n- Training workflow and CLI options\n- Hyperparameter configuration\n- Distributed training (multi-GPU, multi-node)\n- Monitoring and logging\n- Checkpointing\n- Protein hyperparameter tuning\n- Performance optimization\n- Common training patterns\n- Troubleshooting\n\n**environments.md** - Environment development guide:\n- PufferEnv API and characteristics\n- Observation and action spaces\n- Multi-agent environments\n- Ocean suite environments\n- Custom environment development workflow\n- Python to C optimization path\n- Third-party environment integration\n- Wrappers and best practices\n- Debugging\n\n**vectorization.md** - Vectorization optimization:\n- Architecture and key optimizations\n- Vectorization modes (serial, multiprocessing, async)\n- Worker and batch configuration\n- Shared memory and zero-copy patterns\n- Advanced vectorization (hierarchical, custom)\n- Multi-agent vectorization\n- Performance monitoring and profiling\n- Troubleshooting and best practices\n\n**policies.md** - Policy architecture guide:\n- Basic policy structure\n- CNN policies for images\n- LSTM policies with optimization\n- Multi-input policies\n- Continuous action policies\n- Multi-agent policies\n- Advanced architectures (attention, residual)\n- Observation processing and unflattening\n- Initialization and normalization\n- Debugging and testing\n\n**integration.md** - Framework integration guide:\n- Gymnasium integration\n- PettingZoo integration (parallel and AEC)\n- Third-party environments (Procgen, NetHack, Minigrid, etc.)\n- Custom wrappers (observation, reward, frame stacking, etc.)\n- Space conversion and unflattening\n- Environment registration\n- Compatibility patterns\n- Performance considerations\n- Debugging integration\n\n## Tips for Success\n\n1. **Start simple**: Begin with Ocean environments or Gymnasium integration before creating custom environments\n\n2. **Profile early**: Measure steps per second from the start to identify bottlenecks\n\n3. **Use templates**: `scripts\u002Ftrain_template.py` and `scripts\u002Fenv_template.py` provide solid starting points\n\n4. **Read references as needed**: Each reference file is self-contained and focused on a specific capability\n\n5. **Optimize progressively**: Start with Python, profile, then optimize critical paths with C if needed\n\n6. **Leverage vectorization**: PufferLib's vectorization is key to achieving high throughput\n\n7. **Monitor training**: Use WandB or Neptune to track experiments and identify issues early\n\n8. **Test environments**: Validate environment logic before scaling up training\n\n9. **Check existing environments**: Ocean suite provides 20+ pre-built environments\n\n10. **Use proper initialization**: Always use `layer_init` from `pufferlib.pytorch` for policies\n\n## Common Use Cases\n\n### Training on Standard Benchmarks\n```python\n# Atari\nenv = pufferlib.make('atari-pong', num_envs=256)\n\n# Procgen\nenv = pufferlib.make('procgen-coinrun', num_envs=256)\n\n# Minigrid\nenv = pufferlib.make('minigrid-empty-8x8', num_envs=256)\n```\n\n### Multi-Agent Learning\n```python\n# PettingZoo\nenv = pufferlib.make('pettingzoo-pistonball', num_envs=128)\n\n# Shared policy for all agents\npolicy = create_policy(env.observation_space, env.action_space)\ntrainer = PuffeRL(env=env, policy=policy)\n```\n\n### Custom Task Development\n```python\n# Create custom environment\nclass MyTask(PufferEnv):\n    # ... implement environment ...\n\n# Vectorize and train\nenv = pufferlib.emulate(MyTask, num_envs=256)\ntrainer = PuffeRL(env=env, policy=my_policy)\n```\n\n### High-Performance Optimization\n```python\n# Maximize throughput\nenv = pufferlib.make(\n    'my-env',\n    num_envs=1024,      # Large batch\n    num_workers=16,     # Many workers\n    envs_per_worker=64  # Optimize per worker\n)\n```\n\n## Installation\n\n```bash\nuv pip install pufferlib\n```\n\n## Documentation\n\n- Official docs: https:\u002F\u002Fpuffer.ai\u002Fdocs.html\n- GitHub: https:\u002F\u002Fgithub.com\u002FPufferAI\u002FPufferLib\n- Discord: Community support available\n\n",{"name":5,"license":24,"metadata":25,"description":7},"MIT license",{"skill-author":26},"K-Dense Inc.","master","c247302c836de6438d746b45670990eb71691166","skills_collected\u002FK-Dense-AI--scientific-agent-skills--scientific-skills__pufferlib",1,"https:\u002F\u002Fgithub.com\u002Fqhjqhj00\u002Fresearch-skills-pool","https:\u002F\u002Fgithub.com\u002Fqhjqhj00","chien.io","2026-05-11 15:07:59",{"source":8,"skillName":5,"commands":36,"prompt":46,"zipAvailable":47},[37,40,43],{"tool":38,"command":39},"npx","npx skills add qhjqhj00\u002Fresearch-skills-pool --skill pufferlib",{"tool":41,"command":42},"bunx","bunx skills add qhjqhj00\u002Fresearch-skills-pool --skill pufferlib",{"tool":44,"command":45},"pnpm","pnpm dlx skills add qhjqhj00\u002Fresearch-skills-pool --skill pufferlib","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002Fqhjqhj00\u002Fresearch-skills-pool\u002Fblob\u002Fmaster\u002Fskills_collected\u002FK-Dense-AI--scientific-agent-skills--scientific-skills__pufferlib\u002FSKILL.md",true,[49,55,59,63,67,71,77],{"path":50,"resourceType":51,"resourceTypeDesc":52,"sizeBytes":53,"sourceHtmlUrl":54},"references\u002Fenvironments.md","REFERENCE","参考文档",12489,"https:\u002F\u002Fgithub.com\u002Fqhjqhj00\u002Fresearch-skills-pool\u002Fblob\u002Fmaster\u002Fskills_collected\u002FK-Dense-AI--scientific-agent-skills--scientific-skills__pufferlib\u002Freferences\u002Fenvironments.md",{"path":56,"resourceType":51,"resourceTypeDesc":52,"sizeBytes":57,"sourceHtmlUrl":58},"references\u002Fintegration.md",15165,"https:\u002F\u002Fgithub.com\u002Fqhjqhj00\u002Fresearch-skills-pool\u002Fblob\u002Fmaster\u002Fskills_collected\u002FK-Dense-AI--scientific-agent-skills--scientific-skills__pufferlib\u002Freferences\u002Fintegration.md",{"path":60,"resourceType":51,"resourceTypeDesc":52,"sizeBytes":61,"sourceHtmlUrl":62},"references\u002Fpolicies.md",19183,"https:\u002F\u002Fgithub.com\u002Fqhjqhj00\u002Fresearch-skills-pool\u002Fblob\u002Fmaster\u002Fskills_collected\u002FK-Dense-AI--scientific-agent-skills--scientific-skills__pufferlib\u002Freferences\u002Fpolicies.md",{"path":64,"resourceType":51,"resourceTypeDesc":52,"sizeBytes":65,"sourceHtmlUrl":66},"references\u002Ftraining.md",8127,"https:\u002F\u002Fgithub.com\u002Fqhjqhj00\u002Fresearch-skills-pool\u002Fblob\u002Fmaster\u002Fskills_collected\u002FK-Dense-AI--scientific-agent-skills--scientific-skills__pufferlib\u002Freferences\u002Ftraining.md",{"path":68,"resourceType":51,"resourceTypeDesc":52,"sizeBytes":69,"sourceHtmlUrl":70},"references\u002Fvectorization.md",12962,"https:\u002F\u002Fgithub.com\u002Fqhjqhj00\u002Fresearch-skills-pool\u002Fblob\u002Fmaster\u002Fskills_collected\u002FK-Dense-AI--scientific-agent-skills--scientific-skills__pufferlib\u002Freferences\u002Fvectorization.md",{"path":72,"resourceType":73,"resourceTypeDesc":74,"sizeBytes":75,"sourceHtmlUrl":76},"scripts\u002Fenv_template.py","SCRIPT","脚本",10157,"https:\u002F\u002Fgithub.com\u002Fqhjqhj00\u002Fresearch-skills-pool\u002Fblob\u002Fmaster\u002Fskills_collected\u002FK-Dense-AI--scientific-agent-skills--scientific-skills__pufferlib\u002Fscripts\u002Fenv_template.py",{"path":78,"resourceType":73,"resourceTypeDesc":74,"sizeBytes":79,"sourceHtmlUrl":80},"scripts\u002Ftrain_template.py",8027,"https:\u002F\u002Fgithub.com\u002Fqhjqhj00\u002Fresearch-skills-pool\u002Fblob\u002Fmaster\u002Fskills_collected\u002FK-Dense-AI--scientific-agent-skills--scientific-skills__pufferlib\u002Fscripts\u002Ftrain_template.py",[82,89,96,103,110,117],{"skillNo":83,"name":84,"nameZh":6,"description":85,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":86,"categories":87,"keywords":88,"publishedAt":19},"01M73JJB6EQPFPPVQK2Y9N67Q0","transformer-lens-interpretability","Provides guidance for mechanistic interpretability research using TransformerLens to inspect and manipulate transformer internals via HookPoints and activation caching. Use when reverse-engineering model algorithms, studying attention patterns, or performing activation patching experiments.","https:\u002F\u002Fgithub.com\u002Fqhjqhj00\u002Fresearch-skills-pool\u002Fblob\u002Fmaster\u002Ftop100-runs\u002F130-transformer-lens\u002FSKILL.md",[],[],{"skillNo":90,"name":91,"nameZh":6,"description":92,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":93,"categories":94,"keywords":95,"publishedAt":19},"01M73JHTANRRWEE9HP98TPEHAY","wiki-vitepress","Packages generated wiki Markdown into a VitePress static site with dark theme, dark-mode Mermaid diagrams with click-to-zoom, and production build output. Use when the user wants to create a browsable website from generated wiki pages.","https:\u002F\u002Fgithub.com\u002Fqhjqhj00\u002Fresearch-skills-pool\u002Fblob\u002Fmaster\u002Ftop100-runs\u002F126-wiki-vitepress\u002FSKILL.md",[],[],{"skillNo":97,"name":98,"nameZh":6,"description":99,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":100,"categories":101,"keywords":102,"publishedAt":19},"01M73JHJBMVFW46F1Y8K3SBF43","phoenix-observability","Open-source AI observability platform for LLM tracing, evaluation, and monitoring. Use when debugging LLM applications with detailed traces, running evaluations on datasets, or monitoring production AI systems with real-time insights.","https:\u002F\u002Fgithub.com\u002Fqhjqhj00\u002Fresearch-skills-pool\u002Fblob\u002Fmaster\u002Ftop100-runs\u002F124-phoenix\u002FSKILL.md",[],[],{"skillNo":104,"name":105,"nameZh":6,"description":106,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":107,"categories":108,"keywords":109,"publishedAt":19},"01M73JHFPA3A2806PMP42ZN86Q","frontend-ui-dark-ts","Build dark-themed React applications using Tailwind CSS with custom theming, glassmorphism effects, and Framer Motion animations. Use when creating dashboards, admin panels, or data-rich interfaces with a refined dark aesthetic.","https:\u002F\u002Fgithub.com\u002Fqhjqhj00\u002Fresearch-skills-pool\u002Fblob\u002Fmaster\u002Ftop100-runs\u002F123-frontend-ui-dark-ts\u002FSKILL.md",[],[],{"skillNo":111,"name":112,"nameZh":6,"description":113,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":114,"categories":115,"keywords":116,"publishedAt":19},"01M73JFVBVK57NRJS49TT2VDCT","tensorboard","Visualize training metrics, debug models with histograms, compare experiments, visualize model graphs, and profile performance with TensorBoard - Google's ML visualization toolkit","https:\u002F\u002Fgithub.com\u002Fqhjqhj00\u002Fresearch-skills-pool\u002Fblob\u002Fmaster\u002Ftop100-runs\u002F113-tensorboard\u002FSKILL.md",[],[],{"skillNo":118,"name":119,"nameZh":6,"description":120,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":121,"licenseFileUrl":6,"sourceHtmlUrl":122,"categories":123,"keywords":124,"publishedAt":19},"01M73JFF6PK6ZCN41C89J7HS2B","markdown-mermaid-writing","Comprehensive markdown and Mermaid diagram writing skill. Use when creating any scientific document, report, analysis, or visualization. Establishes text-based diagrams as the default documentation standard with full style guides (markdown + mermaid), 24 diagram type references, and 9 document templates.","Apache-2.0","https:\u002F\u002Fgithub.com\u002Fqhjqhj00\u002Fresearch-skills-pool\u002Fblob\u002Fmaster\u002Ftop100-runs\u002F110-markdown-mermaid-writing\u002FSKILL.md",[],[]]