[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M6CBSDE3HJSST90PVZ7JGAAW":3,"skill-same:01M6CBSDE3HJSST90PVZ7JGAAW":80},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":26,"publishedAt":42,"linkOnly":43,"markdownContent":44,"markdownBody":45,"frontMatter":46,"refName":48,"commitSha":49,"skillDirectory":50,"forksCount":14,"repositoryHtmlUrl":51,"repositoryHomepageUrl":6,"ownerHtmlUrl":52,"ownerBlogUrl":53,"ownerDescription":54,"updatedAt":55,"install":56,"resources":69},"01M6CBSDE3HJSST90PVZ7JGAAW","agent-evaluation",null,"Testing and benchmarking LLM agents including behavioral testing, capability assessment, reliability metrics, and production monitoring—where even top agents achieve less than 50% on real-world benchmarks Use when: agent testing, agent evaluation, benchmark agents, agent reliability, test agent.","Gabriellmaia01\u002Fneuro-dose-assist","Gabriellmaia01","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F135177180?v=4","01M6CBRZEZC8G5C400AG3SPFNH","Gabriel","01M6CBRZK8MB7DWW0B4C82TV2G",0,"MIT","https:\u002F\u002Fgithub.com\u002FGabriellmaia01\u002Fneuro-dose-assist\u002Fblob\u002Fmain\u002F.agent\u002Fskills\u002Fskills\u002Fagent-evaluation\u002FSKILL.md",[18,23],{"categoryNo":19,"categoryName":20,"taxonomyType":21,"taxonomyTypeDesc":22},"01JBSEEDCAT000000000000008","测试与质量","SCENARIO","使用场景",{"categoryNo":24,"categoryName":25,"taxonomyType":21,"taxonomyTypeDesc":22},"01JBSEEDCAT000000000000023","Skill与智能体开发",[27,28,29,30,31,32,33,34,35,36,37,38,39,40,41],"agent evaluation","Evaluation","testing","test","benchmarking","assessment","benchmark","apache","metrics","monitoring","Production","llm agents","use","reliability","behavioral","2026-11-10 10:12:30",false,"---\nname: agent-evaluation\ndescription: \"Testing and benchmarking LLM agents including behavioral testing, capability assessment, reliability metrics, and production monitoring—where even top agents achieve less than 50% on real-world benchmarks Use when: agent testing, agent evaluation, benchmark agents, agent reliability, test agent.\"\nsource: vibeship-spawner-skills (Apache 2.0)\n---\n\n# Agent Evaluation\n\nYou're a quality engineer who has seen agents that aced benchmarks fail spectacularly in\nproduction. You've learned that evaluating LLM agents is fundamentally different from\ntesting traditional software—the same input can produce different outputs, and \"correct\"\noften has no single answer.\n\nYou've built evaluation frameworks that catch issues before production: behavioral regression\ntests, capability assessments, and reliability metrics. You understand that the goal isn't\n100% test pass rate—it\n\n## Capabilities\n\n- agent-testing\n- benchmark-design\n- capability-assessment\n- reliability-metrics\n- regression-testing\n\n## Requirements\n\n- testing-fundamentals\n- llm-fundamentals\n\n## Patterns\n\n### Statistical Test Evaluation\n\nRun tests multiple times and analyze result distributions\n\n### Behavioral Contract Testing\n\nDefine and test agent behavioral invariants\n\n### Adversarial Testing\n\nActively try to break agent behavior\n\n## Anti-Patterns\n\n### ❌ Single-Run Testing\n\n### ❌ Only Happy Path Tests\n\n### ❌ Output String Matching\n\n## ⚠️ Sharp Edges\n\n| Issue | Severity | Solution |\n|-------|----------|----------|\n| Agent scores well on benchmarks but fails in production | high | \u002F\u002F Bridge benchmark and production evaluation |\n| Same test passes sometimes, fails other times | high | \u002F\u002F Handle flaky tests in LLM agent evaluation |\n| Agent optimized for metric, not actual task | medium | \u002F\u002F Multi-dimensional evaluation to prevent gaming |\n| Test data accidentally used in training or prompts | critical | \u002F\u002F Prevent data leakage in agent evaluation |\n\n## Related Skills\n\nWorks well with: `multi-agent-orchestration`, `agent-communication`, `autonomous-agents`\n","# Agent Evaluation\n\nYou're a quality engineer who has seen agents that aced benchmarks fail spectacularly in\nproduction. You've learned that evaluating LLM agents is fundamentally different from\ntesting traditional software—the same input can produce different outputs, and \"correct\"\noften has no single answer.\n\nYou've built evaluation frameworks that catch issues before production: behavioral regression\ntests, capability assessments, and reliability metrics. You understand that the goal isn't\n100% test pass rate—it\n\n## Capabilities\n\n- agent-testing\n- benchmark-design\n- capability-assessment\n- reliability-metrics\n- regression-testing\n\n## Requirements\n\n- testing-fundamentals\n- llm-fundamentals\n\n## Patterns\n\n### Statistical Test Evaluation\n\nRun tests multiple times and analyze result distributions\n\n### Behavioral Contract Testing\n\nDefine and test agent behavioral invariants\n\n### Adversarial Testing\n\nActively try to break agent behavior\n\n## Anti-Patterns\n\n### ❌ Single-Run Testing\n\n### ❌ Only Happy Path Tests\n\n### ❌ Output String Matching\n\n## ⚠️ Sharp Edges\n\n| Issue | Severity | Solution |\n|-------|----------|----------|\n| Agent scores well on benchmarks but fails in production | high | \u002F\u002F Bridge benchmark and production evaluation |\n| Same test passes sometimes, fails other times | high | \u002F\u002F Handle flaky tests in LLM agent evaluation |\n| Agent optimized for metric, not actual task | medium | \u002F\u002F Multi-dimensional evaluation to prevent gaming |\n| Test data accidentally used in training or prompts | critical | \u002F\u002F Prevent data leakage in agent evaluation |\n\n## Related Skills\n\nWorks well with: `multi-agent-orchestration`, `agent-communication`, `autonomous-agents`\n",{"name":5,"source":47,"description":7},"vibeship-spawner-skills (Apache 2.0)","main","eac60cc6e0b6baa2a05a765a851fb10638f4e733",".agent\u002Fskills\u002Fskills\u002Fagent-evaluation","https:\u002F\u002Fgithub.com\u002FGabriellmaia01\u002Fneuro-dose-assist","https:\u002F\u002Fgithub.com\u002FGabriellmaia01","https:\u002F\u002Fportfolio-bice-theta-81.vercel.app\u002F","💻 Desenvolvimento De Software_\r\n\r\n⚙️ Engenharia De Software\r\n","2026-11-12 08:51:23",{"source":8,"skillName":5,"commands":57,"prompt":67,"zipAvailable":68},[58,61,64],{"tool":59,"command":60},"npx","npx skills add Gabriellmaia01\u002Fneuro-dose-assist --skill agent-evaluation",{"tool":62,"command":63},"bunx","bunx skills add Gabriellmaia01\u002Fneuro-dose-assist --skill agent-evaluation",{"tool":65,"command":66},"pnpm","pnpm dlx skills add Gabriellmaia01\u002Fneuro-dose-assist --skill agent-evaluation","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002FGabriellmaia01\u002Fneuro-dose-assist\u002Fblob\u002Fmain\u002F.agent\u002Fskills\u002Fskills\u002Fagent-evaluation\u002FSKILL.md",true,[70,76],{"path":71,"resourceType":72,"resourceTypeDesc":73,"sizeBytes":74,"sourceHtmlUrl":75},"SOURCE.md","REFERENCE","参考文档",203,"https:\u002F\u002Fgithub.com\u002Fjiayaoqijia\u002Fcryptoskill\u002Fblob\u002Fmain\u002Fskills\u002Fdefi\u002Fconvex-finance-agent\u002FSOURCE.md",{"path":77,"resourceType":72,"resourceTypeDesc":73,"sizeBytes":78,"sourceHtmlUrl":79},"TRUST.auto.yaml",2217,"https:\u002F\u002Fgithub.com\u002Fjiayaoqijia\u002Fcryptoskill\u002Fblob\u002Fmain\u002Fskills\u002Fdefi\u002Fconvex-finance-agent\u002FTRUST.auto.yaml",[81,108,133,154,174,192],{"skillNo":82,"name":83,"nameZh":6,"description":84,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":85,"licenseFileUrl":86,"sourceHtmlUrl":87,"categories":88,"keywords":93,"publishedAt":107},"01M6CCF29DKTVDQWVM0EJREXTV","webapp-testing","Toolkit for interacting with and testing local web applications using Playwright. Supports verifying frontend functionality, debugging UI behavior, capturing browser screenshots, and viewing browser logs.","Apache-2.0","https:\u002F\u002Fgithub.com\u002FGabriellmaia01\u002Fneuro-dose-assist\u002Fblob\u002Fmain\u002F.agent\u002Fskills\u002Fskills\u002Fwebapp-testing\u002FLICENSE.txt","https:\u002F\u002Fgithub.com\u002FGabriellmaia01\u002Fneuro-dose-assist\u002Fblob\u002Fmain\u002F.agent\u002Fskills\u002Fskills\u002Fwebapp-testing\u002FSKILL.md",[89,90],{"categoryNo":19,"categoryName":20,"taxonomyType":21,"taxonomyTypeDesc":22},{"categoryNo":91,"categoryName":92,"taxonomyType":21,"taxonomyTypeDesc":22},"01JBSEEDCAT000000000000009","前端开发",[94,95,29,96,97,98,99,100,101,102,103,104,105,106],"webapp","webapp testing","playwright","behavior","applications","logs","ui","browser","toolkit","debugging","web","screenshots","frontend","2026-11-11 15:11:14",{"skillNo":109,"name":110,"nameZh":6,"description":111,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":85,"licenseFileUrl":112,"sourceHtmlUrl":113,"categories":114,"keywords":116,"publishedAt":107},"01M6CCET439J7JD6CP2VJ1GWP1","web-artifacts-builder","Suite of tools for creating elaborate, multi-component claude.ai HTML artifacts using modern frontend web technologies (React, Tailwind CSS, shadcn\u002Fui). Use for complex artifacts requiring state management, routing, or shadcn\u002Fui components - not for simple single-file HTML\u002FJSX artifacts.","https:\u002F\u002Fgithub.com\u002FGabriellmaia01\u002Fneuro-dose-assist\u002Fblob\u002Fmain\u002F.agent\u002Fskills\u002Fskills\u002Fweb-artifacts-builder\u002FLICENSE.txt","https:\u002F\u002Fgithub.com\u002FGabriellmaia01\u002Fneuro-dose-assist\u002Fblob\u002Fmain\u002F.agent\u002Fskills\u002Fskills\u002Fweb-artifacts-builder\u002FSKILL.md",[115],{"categoryNo":91,"categoryName":92,"taxonomyType":21,"taxonomyTypeDesc":22},[117,118,119,104,120,121,106,122,100,123,124,125,126,127,128,129,130,131,132,39],"builder","artifacts builder","artifacts","web artifacts builder","Tailwind","Tools","file","state","state management","routing","component","react","components","css","management","single-file",{"skillNo":134,"name":135,"nameZh":6,"description":136,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":85,"licenseFileUrl":137,"sourceHtmlUrl":138,"categories":139,"keywords":143,"publishedAt":107},"01M6CCDCQNA65GZ5ZMWH5FQPB3","theme-factory","Toolkit for styling artifacts with a theme. These artifacts can be slides, docs, reportings, HTML landing pages, etc. There are 10 pre-set themes with colors\u002Ffonts that you can apply to any artifact that has been creating, or can generate a new theme on-the-fly.","https:\u002F\u002Fgithub.com\u002FGabriellmaia01\u002Fneuro-dose-assist\u002Fblob\u002Fmain\u002F.agent\u002Fskills\u002Fskills\u002Ftheme-factory\u002FLICENSE.txt","https:\u002F\u002Fgithub.com\u002FGabriellmaia01\u002Fneuro-dose-assist\u002Fblob\u002Fmain\u002F.agent\u002Fskills\u002Fskills\u002Ftheme-factory\u002FSKILL.md",[140],{"categoryNo":141,"categoryName":142,"taxonomyType":21,"taxonomyTypeDesc":22},"01JBSEEDCAT000000000000015","视觉设计",[144,145,146,102,147,148,149,150,151,119,152,153],"factory","theme factory","styling","html","landing","slides","fly","SET","generate","docs",{"skillNo":155,"name":156,"nameZh":6,"description":157,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":85,"licenseFileUrl":158,"sourceHtmlUrl":159,"categories":160,"keywords":167,"publishedAt":107},"01M6CCBRDWZJG6B82549AP9FNJ","slack-gif-creator","Knowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like \"make me a GIF of X doing Y for Slack.\"","https:\u002F\u002Fgithub.com\u002FGabriellmaia01\u002Fneuro-dose-assist\u002Fblob\u002Fmain\u002F.agent\u002Fskills\u002Fskills\u002Fslack-gif-creator\u002FLICENSE.txt","https:\u002F\u002Fgithub.com\u002FGabriellmaia01\u002Fneuro-dose-assist\u002Fblob\u002Fmain\u002F.agent\u002Fskills\u002Fskills\u002Fslack-gif-creator\u002FSKILL.md",[161,164],{"categoryNo":162,"categoryName":163,"taxonomyType":21,"taxonomyTypeDesc":22},"01JBSEEDCAT000000000000005","邮件与沟通",{"categoryNo":165,"categoryName":166,"taxonomyType":21,"taxonomyTypeDesc":22},"01JBSEEDCAT000000000000016","图像与多媒体",[168,169,170,39,171,172,173,122],"slack","slack gif creator","validation","knowledge","Animation","constraints",{"skillNo":175,"name":176,"nameZh":6,"description":177,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":85,"licenseFileUrl":178,"sourceHtmlUrl":179,"categories":180,"keywords":182,"publishedAt":107},"01M6CCBF73X6J4W7434Z6FWSX9","skill-creator","Guide for creating effective skills. This skill should be used when users want to create a new skill (or update an existing skill) that extends Claude's capabilities with specialized knowledge, workflows, or tool integrations.","https:\u002F\u002Fgithub.com\u002FGabriellmaia01\u002Fneuro-dose-assist\u002Fblob\u002Fmain\u002F.agent\u002Fskills\u002Fskills\u002Fskill-creator\u002FLICENSE.txt","https:\u002F\u002Fgithub.com\u002FGabriellmaia01\u002Fneuro-dose-assist\u002Fblob\u002Fmain\u002F.agent\u002Fskills\u002Fskills\u002Fskill-creator\u002FSKILL.md",[181],{"categoryNo":24,"categoryName":25,"taxonomyType":21,"taxonomyTypeDesc":22},[183,184,185,186,187,188,171,189,190,191],"skill creator","update","guide","specialized","integrations","tool","capabilities","create","workflows",{"skillNo":193,"name":194,"nameZh":6,"description":195,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":85,"licenseFileUrl":196,"sourceHtmlUrl":197,"categories":198,"keywords":200,"publishedAt":107},"01M6CC58BZPCH6R5E46RME74TC","mcp-builder","Guide for creating high-quality MCP (Model Context Protocol) servers that enable LLMs to interact with external services through well-designed tools. Use when building MCP servers to integrate external APIs or services, whether in Python (FastMCP) or Node\u002FTypeScript (MCP SDK).","https:\u002F\u002Fgithub.com\u002FGabriellmaia01\u002Fneuro-dose-assist\u002Fblob\u002Fmain\u002F.agent\u002Fskills\u002Fskills\u002Fmcp-builder\u002FLICENSE.txt","https:\u002F\u002Fgithub.com\u002FGabriellmaia01\u002Fneuro-dose-assist\u002Fblob\u002Fmain\u002F.agent\u002Fskills\u002Fskills\u002Fmcp-builder\u002FSKILL.md",[199],{"categoryNo":24,"categoryName":25,"taxonomyType":21,"taxonomyTypeDesc":22},[201,117,202,203,204,205,206,207,208,209,122,210,211,212,213,39,185,214,215,216],"mcp builder","MCP","sdk","model context protocol","fastmcp","protocol","typescript","python","llms","model","quality","node","integrate","mcp servers","context","services"]