[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M6PH75JZXY61A4G98SPTESNT":3,"skill-same:01M6PH75JZXY61A4G98SPTESNT":90},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":39,"linkOnly":40,"markdownContent":41,"markdownBody":42,"frontMatter":43,"refName":45,"commitSha":46,"skillDirectory":47,"forksCount":14,"repositoryHtmlUrl":48,"repositoryHomepageUrl":6,"ownerHtmlUrl":49,"ownerBlogUrl":50,"ownerDescription":6,"updatedAt":51,"install":52,"resources":65},"01M6PH75JZXY61A4G98SPTESNT","nemo-mbridge-perf-tp-dp-comm-overlap",null,"Operational guide for enabling TP, DP, and PP communication overlap in Megatron-Bridge, including config knobs, code anchors, pitfalls, and verification.","headmktlucca-ui\u002Fneuroads-lp","headmktlucca-ui","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F247379838?v=4","01M6PDVAV6M1W96D1SR1PDF8CS","NeuroAds","01M6PDVAZ4P281GNDKD45CYTF5",0,"Apache-2.0","https:\u002F\u002Fgithub.com\u002Fheadmktlucca-ui\u002Fneuroads-lp\u002Fblob\u002Fmain\u002F.agent\u002Fskills\u002Fnemo-mbridge-perf-tp-dp-comm-overlap\u002FSKILL.md",[],[19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38],"nemo mbridge perf tp dp comm overlap","perf","NeMo","comm","bridge","gather","sequence","reduce","for","pitfalls","pp","megatron","change","parallel","regression","tracing","communication","verification","code","config","2026-11-10 10:12:30",false,"---\nname: nemo-mbridge-perf-tp-dp-comm-overlap\ndescription: Operational guide for enabling TP, DP, and PP communication overlap in Megatron-Bridge, including config knobs, code anchors, pitfalls, and verification.\nlicense: Apache-2.0\nwhen_to_use: Enabling TP\u002FDP\u002FPP comm overlap, or tracing a throughput regression to a comm overlap config change; 'overlap_param_gather', 'overlap_grad_reduce', 'sequence-parallel overlap', 'TP overlap', 'DP overlap', 'comm overlap'.\n---\n\n# TP \u002F DP \u002F PP Communication Overlap Skill\n\nFor stable background and recommendation level, see:\n\n- @docs\u002Ftraining\u002Fcommunication-overlap.md\n\n## Enablement\n\nMinimal Bridge override:\n\n```python\nfrom megatron.bridge.training.comm_overlap import CommOverlapConfig\n\ncfg.model.tensor_model_parallel_size = 4\ncfg.model.sequence_parallel = True\ncfg.model.pipeline_model_parallel_size = 4\ncfg.model.virtual_pipeline_model_parallel_size = 2\n\ncfg.comm_overlap = CommOverlapConfig(\n    tp_comm_overlap=True,\n)\n\ncfg.ddp.use_distributed_optimizer = True\ncfg.ddp.overlap_grad_reduce = True\ncfg.ddp.overlap_param_gather = True\n```\n\nOptional TP preset:\n\n```python\nfrom megatron.bridge.training.comm_overlap import userbuffers_bf16_h100_h12288_tp4_mbs1_seqlen2048\n\ncfg.comm_overlap.tp_comm_overlap_cfg = userbuffers_bf16_h100_h12288_tp4_mbs1_seqlen2048\n```\n\nPrecision knobs belong to mixed precision:\n\n```python\ncfg.mixed_precision.grad_reduce_in_fp32 = False\ncfg.mixed_precision.fp8_param_gather = False\n```\n\n## Code Anchors\n\nBridge overlap gating:\n\n```439:449:src\u002Fmegatron\u002Fbridge\u002Ftraining\u002Fcomm_overlap.py\nif self.user_comm_overlap_cfg.tp_comm_overlap is True:\n    if model_cfg.tensor_model_parallel_size \u003C 2:\n        ...\n    elif not model_cfg.sequence_parallel:\n        ...\n    elif not HAVE_TE:\n        ...\n```\n\nPP overlap selection:\n\n```451:458:src\u002Fmegatron\u002Fbridge\u002Ftraining\u002Fcomm_overlap.py\nif model_cfg.pipeline_model_parallel_size > 1:\n    if vp_size > 1:\n        comm_overlap_cfg.overlap_p2p_comm = True\n        comm_overlap_cfg.batch_p2p_comm = False\n    else:\n        comm_overlap_cfg.overlap_p2p_comm = False\n        comm_overlap_cfg.batch_p2p_comm = True\n```\n\nDP overlap defaults:\n\n```572:579:src\u002Fmegatron\u002Fbridge\u002Ftraining\u002Fcomm_overlap.py\nif self.data_parallel_size > 1:\n    comm_overlap_cfg.bucket_size = 128 * 1024 * 1024\n    comm_overlap_cfg.overlap_grad_reduce = True\n    comm_overlap_cfg.overlap_param_gather = True\n```\n\nLaunch-time env tuning:\n\n```570:609:src\u002Fmegatron\u002Fbridge\u002Frecipes\u002Frun_plugins.py\nexecutor.env_vars[\"CUDA_DEVICE_MAX_CONNECTIONS\"] = str(cuda_device_max_connections)\n...\nexecutor.env_vars[\"NVTE_FWD_LAYERNORM_SM_MARGIN\"] = str(self.layernorm_sm_margin)\nexecutor.env_vars[\"NVTE_BWD_LAYERNORM_SM_MARGIN\"] = str(self.layernorm_sm_margin)\n```\n\n## Pitfalls\n\n1. TP overlap silently disables itself if `sequence_parallel=False` or Transformer Engine is unavailable.\n2. PP overlap is not enabled for all PP cases. Bridge only auto-selects `overlap_p2p_comm=True` when `PP > 1` and `VPP > 1`.\n3. `bucket_size` is a parameter-count knob, not a byte-size knob.\n4. `grad_reduce_in_fp32` and `fp8_param_gather` should be set through mixed precision, not as standalone DDP tuning first.\n5. `CUDA_DEVICE_MAX_CONNECTIONS` and LayerNorm SM margin are launch-time plugin settings, not `CommOverlapConfig` fields.\n\n## Verification\n\nUse the checked-in overlap unit coverage first:\n\n```bash\nuv run python -m pytest tests\u002Funit_tests\u002Ftraining\u002Ftest_comm_overlap.py -q\n```\n\nOptional second check if `nemo_run` is available:\n\n```bash\nuv run python -m pytest tests\u002Funit_tests\u002Frecipes\u002Ftest_run_plugins.py -q\n```\n\nSuccess criteria:\n\n- first command reports `26 passed`\n- second command validates plugin-owned env wiring when not skipped\n","# TP \u002F DP \u002F PP Communication Overlap Skill\n\nFor stable background and recommendation level, see:\n\n- @docs\u002Ftraining\u002Fcommunication-overlap.md\n\n## Enablement\n\nMinimal Bridge override:\n\n```python\nfrom megatron.bridge.training.comm_overlap import CommOverlapConfig\n\ncfg.model.tensor_model_parallel_size = 4\ncfg.model.sequence_parallel = True\ncfg.model.pipeline_model_parallel_size = 4\ncfg.model.virtual_pipeline_model_parallel_size = 2\n\ncfg.comm_overlap = CommOverlapConfig(\n    tp_comm_overlap=True,\n)\n\ncfg.ddp.use_distributed_optimizer = True\ncfg.ddp.overlap_grad_reduce = True\ncfg.ddp.overlap_param_gather = True\n```\n\nOptional TP preset:\n\n```python\nfrom megatron.bridge.training.comm_overlap import userbuffers_bf16_h100_h12288_tp4_mbs1_seqlen2048\n\ncfg.comm_overlap.tp_comm_overlap_cfg = userbuffers_bf16_h100_h12288_tp4_mbs1_seqlen2048\n```\n\nPrecision knobs belong to mixed precision:\n\n```python\ncfg.mixed_precision.grad_reduce_in_fp32 = False\ncfg.mixed_precision.fp8_param_gather = False\n```\n\n## Code Anchors\n\nBridge overlap gating:\n\n```439:449:src\u002Fmegatron\u002Fbridge\u002Ftraining\u002Fcomm_overlap.py\nif self.user_comm_overlap_cfg.tp_comm_overlap is True:\n    if model_cfg.tensor_model_parallel_size \u003C 2:\n        ...\n    elif not model_cfg.sequence_parallel:\n        ...\n    elif not HAVE_TE:\n        ...\n```\n\nPP overlap selection:\n\n```451:458:src\u002Fmegatron\u002Fbridge\u002Ftraining\u002Fcomm_overlap.py\nif model_cfg.pipeline_model_parallel_size > 1:\n    if vp_size > 1:\n        comm_overlap_cfg.overlap_p2p_comm = True\n        comm_overlap_cfg.batch_p2p_comm = False\n    else:\n        comm_overlap_cfg.overlap_p2p_comm = False\n        comm_overlap_cfg.batch_p2p_comm = True\n```\n\nDP overlap defaults:\n\n```572:579:src\u002Fmegatron\u002Fbridge\u002Ftraining\u002Fcomm_overlap.py\nif self.data_parallel_size > 1:\n    comm_overlap_cfg.bucket_size = 128 * 1024 * 1024\n    comm_overlap_cfg.overlap_grad_reduce = True\n    comm_overlap_cfg.overlap_param_gather = True\n```\n\nLaunch-time env tuning:\n\n```570:609:src\u002Fmegatron\u002Fbridge\u002Frecipes\u002Frun_plugins.py\nexecutor.env_vars[\"CUDA_DEVICE_MAX_CONNECTIONS\"] = str(cuda_device_max_connections)\n...\nexecutor.env_vars[\"NVTE_FWD_LAYERNORM_SM_MARGIN\"] = str(self.layernorm_sm_margin)\nexecutor.env_vars[\"NVTE_BWD_LAYERNORM_SM_MARGIN\"] = str(self.layernorm_sm_margin)\n```\n\n## Pitfalls\n\n1. TP overlap silently disables itself if `sequence_parallel=False` or Transformer Engine is unavailable.\n2. PP overlap is not enabled for all PP cases. Bridge only auto-selects `overlap_p2p_comm=True` when `PP > 1` and `VPP > 1`.\n3. `bucket_size` is a parameter-count knob, not a byte-size knob.\n4. `grad_reduce_in_fp32` and `fp8_param_gather` should be set through mixed precision, not as standalone DDP tuning first.\n5. `CUDA_DEVICE_MAX_CONNECTIONS` and LayerNorm SM margin are launch-time plugin settings, not `CommOverlapConfig` fields.\n\n## Verification\n\nUse the checked-in overlap unit coverage first:\n\n```bash\nuv run python -m pytest tests\u002Funit_tests\u002Ftraining\u002Ftest_comm_overlap.py -q\n```\n\nOptional second check if `nemo_run` is available:\n\n```bash\nuv run python -m pytest tests\u002Funit_tests\u002Frecipes\u002Ftest_run_plugins.py -q\n```\n\nSuccess criteria:\n\n- first command reports `26 passed`\n- second command validates plugin-owned env wiring when not skipped\n",{"name":5,"license":15,"description":7,"when_to_use":44},"Enabling TP\u002FDP\u002FPP comm overlap, or tracing a throughput regression to a comm overlap config change; 'overlap_param_gather', 'overlap_grad_reduce', 'sequence-parallel overlap', 'TP overlap', 'DP overlap', 'comm overlap'.","main","7a940b8e5af16c95e5c190a524421d32fc7445a9",".agent\u002Fskills\u002Fnemo-mbridge-perf-tp-dp-comm-overlap","https:\u002F\u002Fgithub.com\u002Fheadmktlucca-ui\u002Fneuroads-lp","https:\u002F\u002Fgithub.com\u002Fheadmktlucca-ui","https:\u002F\u002Fneuroads.com.br","2026-08-12 00:42:44",{"source":8,"skillName":5,"commands":53,"prompt":63,"zipAvailable":64},[54,57,60],{"tool":55,"command":56},"npx","npx skills add headmktlucca-ui\u002Fneuroads-lp --skill nemo-mbridge-perf-tp-dp-comm-overlap",{"tool":58,"command":59},"bunx","bunx skills add headmktlucca-ui\u002Fneuroads-lp --skill nemo-mbridge-perf-tp-dp-comm-overlap",{"tool":61,"command":62},"pnpm","pnpm dlx skills add headmktlucca-ui\u002Fneuroads-lp --skill nemo-mbridge-perf-tp-dp-comm-overlap","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002Fheadmktlucca-ui\u002Fneuroads-lp\u002Fblob\u002Fmain\u002F.agent\u002Fskills\u002Fnemo-mbridge-perf-tp-dp-comm-overlap\u002FSKILL.md",true,[66,72,76,80,84],{"path":67,"resourceType":68,"resourceTypeDesc":69,"sizeBytes":70,"sourceHtmlUrl":71},"BENCHMARK.md","REFERENCE","参考文档",4371,"https:\u002F\u002Fgithub.com\u002Fheadmktlucca-ui\u002Fneuroads-lp\u002Fblob\u002Fmain\u002F.agent\u002Fskills\u002Fnemo-mbridge-perf-tp-dp-comm-overlap\u002FBENCHMARK.md",{"path":73,"resourceType":68,"resourceTypeDesc":69,"sizeBytes":74,"sourceHtmlUrl":75},"card.yaml",2103,"https:\u002F\u002Fgithub.com\u002Fheadmktlucca-ui\u002Fneuroads-lp\u002Fblob\u002Fmain\u002F.agent\u002Fskills\u002Fnemo-mbridge-perf-tp-dp-comm-overlap\u002Fcard.yaml",{"path":77,"resourceType":68,"resourceTypeDesc":69,"sizeBytes":78,"sourceHtmlUrl":79},"evals\u002Fevals.json",1439,"https:\u002F\u002Fgithub.com\u002Fheadmktlucca-ui\u002Fneuroads-lp\u002Fblob\u002Fmain\u002F.agent\u002Fskills\u002Fnemo-mbridge-perf-tp-dp-comm-overlap\u002Fevals\u002Fevals.json",{"path":81,"resourceType":68,"resourceTypeDesc":69,"sizeBytes":82,"sourceHtmlUrl":83},"skill-card.md",3817,"https:\u002F\u002Fgithub.com\u002Fheadmktlucca-ui\u002Fneuroads-lp\u002Fblob\u002Fmain\u002F.agent\u002Fskills\u002Fnemo-mbridge-perf-tp-dp-comm-overlap\u002Fskill-card.md",{"path":85,"resourceType":86,"resourceTypeDesc":87,"sizeBytes":88,"sourceHtmlUrl":89},"skill.oms.sig","OTHER","其他",4833,"https:\u002F\u002Fgithub.com\u002Fheadmktlucca-ui\u002Fneuroads-lp\u002Fblob\u002Fmain\u002F.agent\u002Fskills\u002Fnemo-mbridge-perf-tp-dp-comm-overlap\u002Fskill.oms.sig",[91,118,142,168,186,220],{"skillNo":92,"name":93,"nameZh":6,"description":94,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":95,"licenseFileUrl":6,"sourceHtmlUrl":96,"categories":97,"keywords":106,"publishedAt":39},"01M6PTDCZTXTGSTX4RFK901YSZ","xunit-skill","Generates xUnit.net tests in C#. Covers Fact\u002FTheory, constructor injection, IClassFixture, and FluentAssertions. Use when user mentions \"xUnit\", \"[Fact]\", \"[Theory]\", \"Assert.Equal\", \"C# xUnit\". Triggers on: \"xUnit\", \"[Fact]\", \"[Theory]\", \"Assert.Equal C#\", \"xUnit.net\".","MIT","https:\u002F\u002Fgithub.com\u002Fheadmktlucca-ui\u002Fneuroads-lp\u002Fblob\u002Fmain\u002F.claude\u002Fskills\u002Fxunit-skill\u002FSKILL.md",[98,103],{"categoryNo":99,"categoryName":100,"taxonomyType":101,"taxonomyTypeDesc":102},"01JBSEEDCAT000000000000008","测试与质量","SCENARIO","使用场景",{"categoryNo":104,"categoryName":105,"taxonomyType":101,"taxonomyTypeDesc":102},"01JBSEEDCAT000000000000023","Skill与智能体开发",[107,108,109,110,111,112,113,114,115,116,117],"xunit","xunit skill","testing","injection","user","use","tests","triggers","unit","unit-testing","C#",{"skillNo":119,"name":120,"nameZh":6,"description":121,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":95,"licenseFileUrl":6,"sourceHtmlUrl":122,"categories":123,"keywords":126,"publishedAt":39},"01M6PTCB59ZTG5FTMWGPYEMMBP","xcuitest-skill","Generates XCUITest UI tests for iOS\u002FiPadOS apps in Swift. Apple's native testing framework for reliable, fast UI automation. Supports local simulators and TestMu AI cloud real devices. Use when user mentions \"XCUITest\", \"XCTest\", \"iOS UI test\", \"Swift test\", \"XCUIApplication\". Triggers on: \"XCUITest\", \"XCTest UI\", \"iOS UI test\", \"Swift UI test\", \"XCUIApplication\", \"TestMu\".","https:\u002F\u002Fgithub.com\u002Fheadmktlucca-ui\u002Fneuroads-lp\u002Fblob\u002Fmain\u002F.claude\u002Fskills\u002Fxcuitest-skill\u002FSKILL.md",[124,125],{"categoryNo":99,"categoryName":100,"taxonomyType":101,"taxonomyTypeDesc":102},{"categoryNo":104,"categoryName":105,"taxonomyType":101,"taxonomyTypeDesc":102},[127,128,109,129,130,131,132,133,112,134,135,136,137,138,113,114,139,140,27,141],"xcuitest","xcuitest skill","automation","test","testing framework","ios","devices","mobile","mobile-testing","ui test","local","apple","apps","native","objective",{"skillNo":143,"name":144,"nameZh":6,"description":145,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":95,"licenseFileUrl":6,"sourceHtmlUrl":146,"categories":147,"keywords":152,"publishedAt":39},"01M6PTATMNTY9NF4J7KSR76YK6","world-builder","Create and manage generative game zones for Dorothy's Pokemon-style world. Use this skill when creating, updating, or designing game worlds via MCP tools.","https:\u002F\u002Fgithub.com\u002Fheadmktlucca-ui\u002Fneuroads-lp\u002Fblob\u002Fmain\u002F.claude\u002Fskills\u002Fworld-builder\u002FSKILL.md",[148,151],{"categoryNo":149,"categoryName":150,"taxonomyType":101,"taxonomyTypeDesc":102},"01JBSEEDCAT000000000000015","视觉设计",{"categoryNo":104,"categoryName":105,"taxonomyType":101,"taxonomyTypeDesc":102},[153,154,155,156,157,158,159,160,112,161,162,163,164,165,166,27,167],"builder","world","world builder","MCP","create","mcp tools","Tools","game","pokemon","manage","style","via","theme","zone","generative",{"skillNo":169,"name":170,"nameZh":6,"description":171,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":95,"licenseFileUrl":6,"sourceHtmlUrl":172,"categories":173,"keywords":176,"publishedAt":39},"01M6PT9Z92JTSQEHE1QR0NNW5F","webdriverio-skill","Generates WebdriverIO (WDIO) automation tests in JavaScript or TypeScript. Supports local and TestMu AI cloud. Use when user mentions \"WebdriverIO\", \"WDIO\", \"wdio.conf\", \"browser.url\", \"$\", \"$$\". Triggers on: \"WebdriverIO\", \"WDIO\", \"wdio\", \"browser.$\".","https:\u002F\u002Fgithub.com\u002Fheadmktlucca-ui\u002Fneuroads-lp\u002Fblob\u002Fmain\u002F.claude\u002Fskills\u002Fwebdriverio-skill\u002FSKILL.md",[174,175],{"categoryNo":99,"categoryName":100,"taxonomyType":101,"taxonomyTypeDesc":102},{"categoryNo":104,"categoryName":105,"taxonomyType":101,"taxonomyTypeDesc":102},[177,109,178,129,179,180,181,182,111,112,183,137,113,114,184,185],"webdriverio skill","typescript","javascript","browser","cloud","e2e","e2e-testing","URL","conf",{"skillNo":187,"name":188,"nameZh":6,"description":189,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":95,"licenseFileUrl":6,"sourceHtmlUrl":190,"categories":191,"keywords":201,"publishedAt":39},"01M6PT9NVK36ZWCQ69YXK3FR4K","web-design-guidelines","Web platform design and accessibility guidelines. Use when building web interfaces, auditing accessibility, implementing responsive layouts, or reviewing web UI code. Triggers on tasks involving HTML, CSS, web components, WCAG compliance, responsive design, or web performance.","https:\u002F\u002Fgithub.com\u002Fheadmktlucca-ui\u002Fneuroads-lp\u002Fblob\u002Fmain\u002F.claude\u002Fskills\u002Fweb\u002FSKILL.md",[192,195,196],{"categoryNo":193,"categoryName":194,"taxonomyType":101,"taxonomyTypeDesc":102},"01JBSEEDCAT000000000000009","前端开发",{"categoryNo":149,"categoryName":150,"taxonomyType":101,"taxonomyTypeDesc":102},{"categoryNo":197,"categoryName":198,"taxonomyType":199,"taxonomyTypeDesc":200},"01JBSEEDCAT000000000000032","设计师","PROFESSION","适用职业",[202,203,204,205,206,207,208,209,210,211,37,212,213,214,215,216,217,218,114,219],"design","web","guidelines","web design guidelines","web design","css","performance","components","web components","tasks","web performance","ui","platform design","html","responsive design","responsive","platform","implementing",{"skillNo":221,"name":222,"nameZh":6,"description":223,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":95,"licenseFileUrl":6,"sourceHtmlUrl":224,"categories":225,"keywords":228,"publishedAt":39},"01M6PT9A3JKRE3X34276F2FW5R","watchos-design-guidelines","Apple Human Interface Guidelines for Apple Watch. Use when building watchOS apps, complications, or workout features. Triggers on tasks involving Watch UI, Digital Crown, glanceable interfaces, or wrist-based interactions.","https:\u002F\u002Fgithub.com\u002Fheadmktlucca-ui\u002Fneuroads-lp\u002Fblob\u002Fmain\u002F.claude\u002Fskills\u002Fwatchos\u002FSKILL.md",[226,227],{"categoryNo":149,"categoryName":150,"taxonomyType":101,"taxonomyTypeDesc":102},{"categoryNo":197,"categoryName":198,"taxonomyType":199,"taxonomyTypeDesc":200},[202,204,229,211,213,112,230,231,138,218,232,114,139,233,27,234,235],"watchos design guidelines","workout","human","watch","interface","platform-design","features"]