[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M6PSBB6P1J6R60WWDAGM8KFJ":3,"skill-same:01M6PSBB6P1J6R60WWDAGM8KFJ":100},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":39,"linkOnly":40,"markdownContent":41,"markdownBody":42,"frontMatter":43,"refName":55,"commitSha":56,"skillDirectory":57,"forksCount":14,"repositoryHtmlUrl":58,"repositoryHomepageUrl":6,"ownerHtmlUrl":59,"ownerBlogUrl":60,"ownerDescription":6,"updatedAt":61,"install":62,"resources":75},"01M6PSBB6P1J6R60WWDAGM8KFJ","tao-analyze-gaps-vlm-bcq",null,"Extract false-positive and false-negative gaps from VLM binary-classification-question (BCQ, yes\u002Fno) predictions. Use after running VLM evaluation when you have a predictions JSON and need to identify failure cases for DEFT root cause analysis on a binary-classification VLM workflow.","headmktlucca-ui\u002Fneuroads-lp","headmktlucca-ui","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F247379838?v=4","01M6PDVAV6M1W96D1SR1PDF8CS","NeuroAds","01M6PDVAZ4P281GNDKD45CYTF5",0,"Apache-2.0","https:\u002F\u002Fgithub.com\u002Fheadmktlucca-ui\u002Fneuroads-lp\u002Fblob\u002Fmain\u002F.claude\u002Fskills\u002Ftao-analyze-gaps-vlm-bcq\u002FSKILL.md",[],[19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38],"tao analyze gaps vlm bcq","vlm","gaps","tao","analyze","container","for","yes","you","predictions","false","docker","use","question","Bash","classification","analysis","NVIDIA","toolkit","workflow","2026-11-10 10:12:30",false,"---\nname: tao-analyze-gaps-vlm-bcq\ndescription: Extract false-positive and false-negative gaps from VLM binary-classification-question (BCQ, yes\u002Fno) predictions.\n  Use after running VLM evaluation when you have a predictions JSON and need to identify failure cases for DEFT root cause\n  analysis on a binary-classification VLM workflow.\nlicense: Apache-2.0\ncompatibility: Requires docker + nvidia-container-toolkit.\nmetadata:\n  author: NVIDIA Corporation\n  version: \"0.1.0\"\nallowed-tools: Read Bash\ntags:\n- gap-analysis\n- rcca\n- vlm\n- evaluation\n- false-positive\n- false-negative\n---\n\n# VLM Binary Classification Gap Analysis\n\nReads a VLM predictions JSON, compares each model response against ground truth, and writes FP\u002FFN failure cases to a JSONL file with a summary report.\n\n## Purpose\n\nAfter running a VLM on a binary yes\u002Fno evaluation task, the predictions need to be compared against ground truth to identify failure cases. This skill produces a structured list of FP (false positive) and FN (false negative) samples that downstream RCCA stages (e.g., cosmos generation, root cause analysis) consume to drive a DEFT iteration.\n\n## Usage\n\nInvoke the `vlm_bcq` action inside the TAO Toolkit data services container with Hydra-style key=value overrides:\n\n```bash\ngap_analysis vlm_bcq \\\n  predictions_json=\u002Fpath\u002Fto\u002Fresults.json \\\n  results_dir=\u002Fpath\u002Fto\u002Foutput\u002Fgaps\n```\n\nInclude `videos_dir` when `video_id` values in the predictions are relative paths:\n\n```bash\ngap_analysis vlm_bcq \\\n  predictions_json=\u002Fpath\u002Fto\u002Fresults.json \\\n  results_dir=\u002Fpath\u002Fto\u002Foutput\u002Fgaps \\\n  videos_dir=\u002Fpath\u002Fto\u002Fvideos\u002Froot\n```\n\nAfter the run, surface the FP\u002FFN counts from `kpi_gaps_report.txt` and point downstream stages at `kpi_gaps.jsonl`.\n\n## Inputs\n\n- **predictions_json**: Path to predictions JSON file. Must be a JSON array where each item has `video_id`, `response`, and `gt` fields. `response` and `gt` are parsed with word-boundary matching — `'yes'` or `'no'` anywhere in the string is recognized. Samples where both or neither are present are skipped with a warning.\n- **videos_dir** (optional): Base directory for resolving relative `video_id` paths. If omitted, `video_id` values are used as absolute paths.\n\n**Predictions JSON format:**\n```json\n[\n  {\n    \"video_id\": \"\u002Fpath\u002Fto\u002Fvideo.mp4\",\n    \"response\": \"Yes, there is a collision.\",\n    \"gt\": \"B. No\",\n    \"question\": \"Is there a collision?\"\n  }\n]\n```\n\n## Outputs\n\n- **kpi_gaps.jsonl**: One JSON object per line for each FP\u002FFN case. Fields: `video_id` (absolute path), `error_type` (`FP` or `FN`), `question`, `ground_truth`, `response`.\n- **kpi_gaps_report.txt**: Human-readable table with total FP\u002FFN counts.\n\nIf no gaps are found, no files are written and a message is logged.\n\n## Key Parameters\n\n| Parameter | Required | Description |\n|-----------|----------|-------------|\n| predictions_json | Yes | Path to predictions JSON file |\n| results_dir | Yes | Output directory; created if it does not exist |\n| videos_dir | No | Base directory for resolving relative `video_id` paths |\n\n## Error Patterns\n\n| Error | Cause | Fix |\n|-------|-------|-----|\n| `FileNotFoundError` | `predictions_json` does not exist | Check the path |\n| `ValueError: must be a JSON array` | Predictions file is not a list | Wrap predictions in `[...]` |\n| `ValueError: missing 'gt'\u002F'response'\u002F'video_id'` | A prediction item is missing a required field | Inspect and fix the predictions JSON |\n| Samples silently skipped | `response` or `gt` contains both or neither 'yes'\u002F'no' | Check logs for warnings; inspect those samples |\n","# VLM Binary Classification Gap Analysis\n\nReads a VLM predictions JSON, compares each model response against ground truth, and writes FP\u002FFN failure cases to a JSONL file with a summary report.\n\n## Purpose\n\nAfter running a VLM on a binary yes\u002Fno evaluation task, the predictions need to be compared against ground truth to identify failure cases. This skill produces a structured list of FP (false positive) and FN (false negative) samples that downstream RCCA stages (e.g., cosmos generation, root cause analysis) consume to drive a DEFT iteration.\n\n## Usage\n\nInvoke the `vlm_bcq` action inside the TAO Toolkit data services container with Hydra-style key=value overrides:\n\n```bash\ngap_analysis vlm_bcq \\\n  predictions_json=\u002Fpath\u002Fto\u002Fresults.json \\\n  results_dir=\u002Fpath\u002Fto\u002Foutput\u002Fgaps\n```\n\nInclude `videos_dir` when `video_id` values in the predictions are relative paths:\n\n```bash\ngap_analysis vlm_bcq \\\n  predictions_json=\u002Fpath\u002Fto\u002Fresults.json \\\n  results_dir=\u002Fpath\u002Fto\u002Foutput\u002Fgaps \\\n  videos_dir=\u002Fpath\u002Fto\u002Fvideos\u002Froot\n```\n\nAfter the run, surface the FP\u002FFN counts from `kpi_gaps_report.txt` and point downstream stages at `kpi_gaps.jsonl`.\n\n## Inputs\n\n- **predictions_json**: Path to predictions JSON file. Must be a JSON array where each item has `video_id`, `response`, and `gt` fields. `response` and `gt` are parsed with word-boundary matching — `'yes'` or `'no'` anywhere in the string is recognized. Samples where both or neither are present are skipped with a warning.\n- **videos_dir** (optional): Base directory for resolving relative `video_id` paths. If omitted, `video_id` values are used as absolute paths.\n\n**Predictions JSON format:**\n```json\n[\n  {\n    \"video_id\": \"\u002Fpath\u002Fto\u002Fvideo.mp4\",\n    \"response\": \"Yes, there is a collision.\",\n    \"gt\": \"B. No\",\n    \"question\": \"Is there a collision?\"\n  }\n]\n```\n\n## Outputs\n\n- **kpi_gaps.jsonl**: One JSON object per line for each FP\u002FFN case. Fields: `video_id` (absolute path), `error_type` (`FP` or `FN`), `question`, `ground_truth`, `response`.\n- **kpi_gaps_report.txt**: Human-readable table with total FP\u002FFN counts.\n\nIf no gaps are found, no files are written and a message is logged.\n\n## Key Parameters\n\n| Parameter | Required | Description |\n|-----------|----------|-------------|\n| predictions_json | Yes | Path to predictions JSON file |\n| results_dir | Yes | Output directory; created if it does not exist |\n| videos_dir | No | Base directory for resolving relative `video_id` paths |\n\n## Error Patterns\n\n| Error | Cause | Fix |\n|-------|-------|-----|\n| `FileNotFoundError` | `predictions_json` does not exist | Check the path |\n| `ValueError: must be a JSON array` | Predictions file is not a list | Wrap predictions in `[...]` |\n| `ValueError: missing 'gt'\u002F'response'\u002F'video_id'` | A prediction item is missing a required field | Inspect and fix the predictions JSON |\n| Samples silently skipped | `response` or `gt` contains both or neither 'yes'\u002F'no' | Check logs for warnings; inspect those samples |\n",{"name":5,"tags":44,"license":15,"metadata":50,"description":7,"allowed-tools":53,"compatibility":54},[45,46,20,47,48,49],"gap-analysis","rcca","evaluation","false-positive","false-negative",{"author":51,"version":52},"NVIDIA Corporation","0.1.0","Read Bash","Requires docker + nvidia-container-toolkit.","main","7a940b8e5af16c95e5c190a524421d32fc7445a9",".claude\u002Fskills\u002Ftao-analyze-gaps-vlm-bcq","https:\u002F\u002Fgithub.com\u002Fheadmktlucca-ui\u002Fneuroads-lp","https:\u002F\u002Fgithub.com\u002Fheadmktlucca-ui","https:\u002F\u002Fneuroads.com.br","2026-08-12 00:42:44",{"source":8,"skillName":5,"commands":63,"prompt":73,"zipAvailable":74},[64,67,70],{"tool":65,"command":66},"npx","npx skills add headmktlucca-ui\u002Fneuroads-lp --skill tao-analyze-gaps-vlm-bcq",{"tool":68,"command":69},"bunx","bunx skills add headmktlucca-ui\u002Fneuroads-lp --skill tao-analyze-gaps-vlm-bcq",{"tool":71,"command":72},"pnpm","pnpm dlx skills add headmktlucca-ui\u002Fneuroads-lp --skill tao-analyze-gaps-vlm-bcq","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002Fheadmktlucca-ui\u002Fneuroads-lp\u002Fblob\u002Fmain\u002F.claude\u002Fskills\u002Ftao-analyze-gaps-vlm-bcq\u002FSKILL.md",true,[76,82,86,90,94],{"path":77,"resourceType":78,"resourceTypeDesc":79,"sizeBytes":80,"sourceHtmlUrl":81},"BENCHMARK.md","REFERENCE","参考文档",4270,"https:\u002F\u002Fgithub.com\u002Fheadmktlucca-ui\u002Fneuroads-lp\u002Fblob\u002Fmain\u002F.claude\u002Fskills\u002Ftao-analyze-gaps-vlm-bcq\u002FBENCHMARK.md",{"path":83,"resourceType":78,"resourceTypeDesc":79,"sizeBytes":84,"sourceHtmlUrl":85},"evals\u002Fevals.json",830,"https:\u002F\u002Fgithub.com\u002Fheadmktlucca-ui\u002Fneuroads-lp\u002Fblob\u002Fmain\u002F.claude\u002Fskills\u002Ftao-analyze-gaps-vlm-bcq\u002Fevals\u002Fevals.json",{"path":87,"resourceType":78,"resourceTypeDesc":79,"sizeBytes":88,"sourceHtmlUrl":89},"references\u002Fskill_info.yaml",534,"https:\u002F\u002Fgithub.com\u002Fheadmktlucca-ui\u002Fneuroads-lp\u002Fblob\u002Fmain\u002F.claude\u002Fskills\u002Ftao-analyze-gaps-vlm-bcq\u002Freferences\u002Fskill_info.yaml",{"path":91,"resourceType":78,"resourceTypeDesc":79,"sizeBytes":92,"sourceHtmlUrl":93},"skill-card.md",3675,"https:\u002F\u002Fgithub.com\u002Fheadmktlucca-ui\u002Fneuroads-lp\u002Fblob\u002Fmain\u002F.claude\u002Fskills\u002Ftao-analyze-gaps-vlm-bcq\u002Fskill-card.md",{"path":95,"resourceType":96,"resourceTypeDesc":97,"sizeBytes":98,"sourceHtmlUrl":99},"skill.oms.sig","OTHER","其他",4837,"https:\u002F\u002Fgithub.com\u002Fheadmktlucca-ui\u002Fneuroads-lp\u002Fblob\u002Fmain\u002F.claude\u002Fskills\u002Ftao-analyze-gaps-vlm-bcq\u002Fskill.oms.sig",[101,127,151,177,195,230],{"skillNo":102,"name":103,"nameZh":6,"description":104,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":105,"licenseFileUrl":6,"sourceHtmlUrl":106,"categories":107,"keywords":116,"publishedAt":39},"01M6PTDCZTXTGSTX4RFK901YSZ","xunit-skill","Generates xUnit.net tests in C#. Covers Fact\u002FTheory, constructor injection, IClassFixture, and FluentAssertions. Use when user mentions \"xUnit\", \"[Fact]\", \"[Theory]\", \"Assert.Equal\", \"C# xUnit\". Triggers on: \"xUnit\", \"[Fact]\", \"[Theory]\", \"Assert.Equal C#\", \"xUnit.net\".","MIT","https:\u002F\u002Fgithub.com\u002Fheadmktlucca-ui\u002Fneuroads-lp\u002Fblob\u002Fmain\u002F.claude\u002Fskills\u002Fxunit-skill\u002FSKILL.md",[108,113],{"categoryNo":109,"categoryName":110,"taxonomyType":111,"taxonomyTypeDesc":112},"01JBSEEDCAT000000000000008","测试与质量","SCENARIO","使用场景",{"categoryNo":114,"categoryName":115,"taxonomyType":111,"taxonomyTypeDesc":112},"01JBSEEDCAT000000000000023","Skill与智能体开发",[117,118,119,120,121,31,122,123,124,125,126],"xunit","xunit skill","testing","injection","user","tests","triggers","unit","unit-testing","C#",{"skillNo":128,"name":129,"nameZh":6,"description":130,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":105,"licenseFileUrl":6,"sourceHtmlUrl":131,"categories":132,"keywords":135,"publishedAt":39},"01M6PTCB59ZTG5FTMWGPYEMMBP","xcuitest-skill","Generates XCUITest UI tests for iOS\u002FiPadOS apps in Swift. Apple's native testing framework for reliable, fast UI automation. Supports local simulators and TestMu AI cloud real devices. Use when user mentions \"XCUITest\", \"XCTest\", \"iOS UI test\", \"Swift test\", \"XCUIApplication\". Triggers on: \"XCUITest\", \"XCTest UI\", \"iOS UI test\", \"Swift UI test\", \"XCUIApplication\", \"TestMu\".","https:\u002F\u002Fgithub.com\u002Fheadmktlucca-ui\u002Fneuroads-lp\u002Fblob\u002Fmain\u002F.claude\u002Fskills\u002Fxcuitest-skill\u002FSKILL.md",[133,134],{"categoryNo":109,"categoryName":110,"taxonomyType":111,"taxonomyTypeDesc":112},{"categoryNo":114,"categoryName":115,"taxonomyType":111,"taxonomyTypeDesc":112},[136,137,119,138,139,140,141,142,31,143,144,145,146,147,122,123,148,149,25,150],"xcuitest","xcuitest skill","automation","test","testing framework","ios","devices","mobile","mobile-testing","ui test","local","apple","apps","native","objective",{"skillNo":152,"name":153,"nameZh":6,"description":154,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":105,"licenseFileUrl":6,"sourceHtmlUrl":155,"categories":156,"keywords":161,"publishedAt":39},"01M6PTATMNTY9NF4J7KSR76YK6","world-builder","Create and manage generative game zones for Dorothy's Pokemon-style world. Use this skill when creating, updating, or designing game worlds via MCP tools.","https:\u002F\u002Fgithub.com\u002Fheadmktlucca-ui\u002Fneuroads-lp\u002Fblob\u002Fmain\u002F.claude\u002Fskills\u002Fworld-builder\u002FSKILL.md",[157,160],{"categoryNo":158,"categoryName":159,"taxonomyType":111,"taxonomyTypeDesc":112},"01JBSEEDCAT000000000000015","视觉设计",{"categoryNo":114,"categoryName":115,"taxonomyType":111,"taxonomyTypeDesc":112},[162,163,164,165,166,167,168,169,31,170,171,172,173,174,175,25,176],"builder","world","world builder","MCP","create","mcp tools","Tools","game","pokemon","manage","style","via","theme","zone","generative",{"skillNo":178,"name":179,"nameZh":6,"description":180,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":105,"licenseFileUrl":6,"sourceHtmlUrl":181,"categories":182,"keywords":185,"publishedAt":39},"01M6PT9Z92JTSQEHE1QR0NNW5F","webdriverio-skill","Generates WebdriverIO (WDIO) automation tests in JavaScript or TypeScript. Supports local and TestMu AI cloud. Use when user mentions \"WebdriverIO\", \"WDIO\", \"wdio.conf\", \"browser.url\", \"$\", \"$$\". Triggers on: \"WebdriverIO\", \"WDIO\", \"wdio\", \"browser.$\".","https:\u002F\u002Fgithub.com\u002Fheadmktlucca-ui\u002Fneuroads-lp\u002Fblob\u002Fmain\u002F.claude\u002Fskills\u002Fwebdriverio-skill\u002FSKILL.md",[183,184],{"categoryNo":109,"categoryName":110,"taxonomyType":111,"taxonomyTypeDesc":112},{"categoryNo":114,"categoryName":115,"taxonomyType":111,"taxonomyTypeDesc":112},[186,119,187,138,188,189,190,191,121,31,192,146,122,123,193,194],"webdriverio skill","typescript","javascript","browser","cloud","e2e","e2e-testing","URL","conf",{"skillNo":196,"name":197,"nameZh":6,"description":198,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":105,"licenseFileUrl":6,"sourceHtmlUrl":199,"categories":200,"keywords":210,"publishedAt":39},"01M6PT9NVK36ZWCQ69YXK3FR4K","web-design-guidelines","Web platform design and accessibility guidelines. Use when building web interfaces, auditing accessibility, implementing responsive layouts, or reviewing web UI code. Triggers on tasks involving HTML, CSS, web components, WCAG compliance, responsive design, or web performance.","https:\u002F\u002Fgithub.com\u002Fheadmktlucca-ui\u002Fneuroads-lp\u002Fblob\u002Fmain\u002F.claude\u002Fskills\u002Fweb\u002FSKILL.md",[201,204,205],{"categoryNo":202,"categoryName":203,"taxonomyType":111,"taxonomyTypeDesc":112},"01JBSEEDCAT000000000000009","前端开发",{"categoryNo":158,"categoryName":159,"taxonomyType":111,"taxonomyTypeDesc":112},{"categoryNo":206,"categoryName":207,"taxonomyType":208,"taxonomyTypeDesc":209},"01JBSEEDCAT000000000000032","设计师","PROFESSION","适用职业",[211,212,213,214,215,216,217,218,219,220,221,222,223,224,225,226,227,228,123,229],"design","web","guidelines","web design guidelines","web design","css","performance","components","web components","tasks","code","web performance","ui","platform design","html","responsive design","responsive","platform","implementing",{"skillNo":231,"name":232,"nameZh":6,"description":233,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":105,"licenseFileUrl":6,"sourceHtmlUrl":234,"categories":235,"keywords":238,"publishedAt":39},"01M6PT9A3JKRE3X34276F2FW5R","watchos-design-guidelines","Apple Human Interface Guidelines for Apple Watch. Use when building watchOS apps, complications, or workout features. Triggers on tasks involving Watch UI, Digital Crown, glanceable interfaces, or wrist-based interactions.","https:\u002F\u002Fgithub.com\u002Fheadmktlucca-ui\u002Fneuroads-lp\u002Fblob\u002Fmain\u002F.claude\u002Fskills\u002Fwatchos\u002FSKILL.md",[236,237],{"categoryNo":158,"categoryName":159,"taxonomyType":111,"taxonomyTypeDesc":112},{"categoryNo":206,"categoryName":207,"taxonomyType":208,"taxonomyTypeDesc":209},[211,213,239,220,223,31,240,241,147,228,242,123,148,243,25,244,245],"watchos design guidelines","workout","human","watch","interface","platform-design","features"]