[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M6N81G3304KB6FVCV6JJ2QNB":3,"skill-same:01M6N81G3304KB6FVCV6JJ2QNB":82},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":15,"categories":16,"keywords":17,"publishedAt":38,"linkOnly":39,"markdownContent":40,"markdownBody":41,"frontMatter":42,"refName":44,"commitSha":45,"skillDirectory":46,"forksCount":13,"repositoryHtmlUrl":47,"repositoryHomepageUrl":6,"ownerHtmlUrl":48,"ownerBlogUrl":6,"ownerDescription":6,"updatedAt":49,"install":50,"resources":63},"01M6N81G3304KB6FVCV6JJ2QNB","advanced-evaluation",null,"This skill should be used when the user asks to \"implement LLM-as-judge\", \"compare model outputs\", \"create evaluation rubrics\", \"mitigate evaluation bias\", or mentions direct scoring, pairwise comparison, position bias, evaluation pipelines, or automated quality assessment.","JackSmack1971\u002Fantigravity-meta","JackSmack1971","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F128181597?v=4","01M6KS1FH32N6WNWZ68JC9FFDJ","01M6N7JCBG1NDFN2ZNKGMKMFMQ",0,"MIT","https:\u002F\u002Fgithub.com\u002FJackSmack1971\u002Fantigravity-meta\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fadvanced-evaluation\u002FSKILL.md",[],[18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37],"advanced","Evaluation","advanced evaluation","wed","evaluation rubrics","comparison","judge","compare","position","as","bias","scoring","safe","community","quality","direct","model","create","assessment","implement","2026-11-10 10:12:30",false,"---\nname: advanced-evaluation\ndescription: This skill should be used when the user asks to \"implement LLM-as-judge\", \"compare model outputs\", \"create evaluation rubrics\", \"mitigate evaluation bias\", or mentions direct scoring, pairwise comparison, position bias, evaluation pipelines, or automated quality assessment.\nrisk: safe\nsource: community\ndate_added: 2026-03-18\n---\n\n# Advanced Evaluation\n\n## Overview\n\nImplement production-grade LLM-as-judge patterns to evaluate model outputs. This skill provides a taxonomy for choosing the right evaluation method and protocols for mitigating systematic biases.\n\n## ? Resources\n\n| Resource | Description |\n|----------|-------------|\n| [Evaluation Frameworks](file:\u002F\u002F\u002Fc:\u002Fworkspaces\u002Fantigravity-meta\u002F.agents\u002Fskills\u002Fadvanced-evaluation\u002Fresources\u002Fevaluation-frameworks.md) | Choosing between Direct Scoring and Pairwise Comparison. |\n| [Bias Mitigation](file:\u002F\u002F\u002Fc:\u002Fworkspaces\u002Fantigravity-meta\u002F.agents\u002Fskills\u002Fadvanced-evaluation\u002Fresources\u002Fbias-mitigation.md) | Protocols for Position, Length, and Verbosity bias. |\n| [Rubric Design](file:\u002F\u002F\u002Fc:\u002Fworkspaces\u002Fantigravity-meta\u002F.agents\u002Fskills\u002Fadvanced-evaluation\u002Fresources\u002Frubric-design.md) | Patterns for creating consistent grading standards. |\n| [Case Studies](file:\u002F\u002F\u002Fc:\u002Fworkspaces\u002Fantigravity-meta\u002F.agents\u002Fskills\u002Fadvanced-evaluation\u002Fresources\u002Fcase-studies.md) | Implementation examples for Accuracy, Tone, and Readability. |\n\n## Core Decision Framework\n\n### Direct Scoring\nBest for **objective** criteria (accuracy, format). Rates on a scale (1-5\u002F1-10).\n> See [Evaluation Frameworks](file:\u002F\u002F\u002Fc:\u002Fworkspaces\u002Fantigravity-meta\u002F.agents\u002Fskills\u002Fadvanced-evaluation\u002Fresources\u002Fevaluation-frameworks.md) for details.\n\n### Pairwise Comparison\nBest for **subjective** preference (style, tone, helpfulness). Compares two outputs directly.\n> Required: Always use [Bias Mitigation](file:\u002F\u002F\u002Fc:\u002Fworkspaces\u002Fantigravity-meta\u002F.agents\u002Fskills\u002Fadvanced-evaluation\u002Fresources\u002Fbias-mitigation.md) (Position Swap).\n\n## Best Practices\n1. **Justification First**: Always require the judge to provide evidence *before* the score.\n2. **Swap Positions**: When using pairwise comparison, run the evaluation twice with roles swapped.\n3. **Calibrate Confidence**: Adjust confidence values based on judge consistency and evidence quality.\n\n## Related Skills\n- `context-fundamentals`: Prompt structure for evaluation.\n- `tool-design`: Building evaluation infrastructure.\n\n## Summary\nBuild reliable evaluation systems by selecting the correct taxonomy and aggressively mitigating LLM biases.\n","# Advanced Evaluation\n\n## Overview\n\nImplement production-grade LLM-as-judge patterns to evaluate model outputs. This skill provides a taxonomy for choosing the right evaluation method and protocols for mitigating systematic biases.\n\n## ? Resources\n\n| Resource | Description |\n|----------|-------------|\n| [Evaluation Frameworks](file:\u002F\u002F\u002Fc:\u002Fworkspaces\u002Fantigravity-meta\u002F.agents\u002Fskills\u002Fadvanced-evaluation\u002Fresources\u002Fevaluation-frameworks.md) | Choosing between Direct Scoring and Pairwise Comparison. |\n| [Bias Mitigation](file:\u002F\u002F\u002Fc:\u002Fworkspaces\u002Fantigravity-meta\u002F.agents\u002Fskills\u002Fadvanced-evaluation\u002Fresources\u002Fbias-mitigation.md) | Protocols for Position, Length, and Verbosity bias. |\n| [Rubric Design](file:\u002F\u002F\u002Fc:\u002Fworkspaces\u002Fantigravity-meta\u002F.agents\u002Fskills\u002Fadvanced-evaluation\u002Fresources\u002Frubric-design.md) | Patterns for creating consistent grading standards. |\n| [Case Studies](file:\u002F\u002F\u002Fc:\u002Fworkspaces\u002Fantigravity-meta\u002F.agents\u002Fskills\u002Fadvanced-evaluation\u002Fresources\u002Fcase-studies.md) | Implementation examples for Accuracy, Tone, and Readability. |\n\n## Core Decision Framework\n\n### Direct Scoring\nBest for **objective** criteria (accuracy, format). Rates on a scale (1-5\u002F1-10).\n> See [Evaluation Frameworks](file:\u002F\u002F\u002Fc:\u002Fworkspaces\u002Fantigravity-meta\u002F.agents\u002Fskills\u002Fadvanced-evaluation\u002Fresources\u002Fevaluation-frameworks.md) for details.\n\n### Pairwise Comparison\nBest for **subjective** preference (style, tone, helpfulness). Compares two outputs directly.\n> Required: Always use [Bias Mitigation](file:\u002F\u002F\u002Fc:\u002Fworkspaces\u002Fantigravity-meta\u002F.agents\u002Fskills\u002Fadvanced-evaluation\u002Fresources\u002Fbias-mitigation.md) (Position Swap).\n\n## Best Practices\n1. **Justification First**: Always require the judge to provide evidence *before* the score.\n2. **Swap Positions**: When using pairwise comparison, run the evaluation twice with roles swapped.\n3. **Calibrate Confidence**: Adjust confidence values based on judge consistency and evidence quality.\n\n## Related Skills\n- `context-fundamentals`: Prompt structure for evaluation.\n- `tool-design`: Building evaluation infrastructure.\n\n## Summary\nBuild reliable evaluation systems by selecting the correct taxonomy and aggressively mitigating LLM biases.\n",{"name":5,"risk":30,"source":31,"date_added":43,"description":7},1773792000000,"main","d47cc0de4d70e7006abaebc8a07a7c7d626c6ccb",".agents\u002Fskills\u002Fadvanced-evaluation","https:\u002F\u002Fgithub.com\u002FJackSmack1971\u002Fantigravity-meta","https:\u002F\u002Fgithub.com\u002FJackSmack1971","2026-04-19 04:53:59",{"source":8,"skillName":5,"commands":51,"prompt":61,"zipAvailable":62},[52,55,58],{"tool":53,"command":54},"npx","npx skills add JackSmack1971\u002Fantigravity-meta --skill advanced-evaluation",{"tool":56,"command":57},"bunx","bunx skills add JackSmack1971\u002Fantigravity-meta --skill advanced-evaluation",{"tool":59,"command":60},"pnpm","pnpm dlx skills add JackSmack1971\u002Fantigravity-meta --skill advanced-evaluation","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002FJackSmack1971\u002Fantigravity-meta\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fadvanced-evaluation\u002FSKILL.md",true,[64,70,74,78],{"path":65,"resourceType":66,"resourceTypeDesc":67,"sizeBytes":68,"sourceHtmlUrl":69},"resources\u002Fbias-mitigation.md","REFERENCE","参考文档",2044,"https:\u002F\u002Fgithub.com\u002FJackSmack1971\u002Fantigravity-meta\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fadvanced-evaluation\u002Fresources\u002Fbias-mitigation.md",{"path":71,"resourceType":66,"resourceTypeDesc":67,"sizeBytes":72,"sourceHtmlUrl":73},"resources\u002Fcase-studies.md",2306,"https:\u002F\u002Fgithub.com\u002FJackSmack1971\u002Fantigravity-meta\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fadvanced-evaluation\u002Fresources\u002Fcase-studies.md",{"path":75,"resourceType":66,"resourceTypeDesc":67,"sizeBytes":76,"sourceHtmlUrl":77},"resources\u002Fevaluation-frameworks.md",1622,"https:\u002F\u002Fgithub.com\u002FJackSmack1971\u002Fantigravity-meta\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fadvanced-evaluation\u002Fresources\u002Fevaluation-frameworks.md",{"path":79,"resourceType":66,"resourceTypeDesc":67,"sizeBytes":80,"sourceHtmlUrl":81},"resources\u002Frubric-design.md",1485,"https:\u002F\u002Fgithub.com\u002FJackSmack1971\u002Fantigravity-meta\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fadvanced-evaluation\u002Fresources\u002Frubric-design.md",[83,104,130,154,173,189],{"skillNo":84,"name":85,"nameZh":6,"description":86,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":87,"categories":88,"keywords":89,"publishedAt":38},"01M6N8FMBDREJBRGQ37HAFBWWS","wcag-audit-patterns","Comprehensive guide to auditing web content against WCAG 2.2 guidelines with actionable remediation strategies.","https:\u002F\u002Fgithub.com\u002FJackSmack1971\u002Fantigravity-meta\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fwcag-audit-patterns\u002FSKILL.md",[],[90,91,92,93,94,95,96,97,98,99,100,101,102,103,30,31],"wcag audit","audit","patterns","wcag audit patterns","WCAG","with","web content","strategies","actionable","content","guidelines","web","remediation","guide",{"skillNo":105,"name":106,"nameZh":6,"description":107,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":108,"categories":109,"keywords":115,"publishedAt":38},"01M6N8FEJG7PTGF6G16JW4HJV1","unit-testing-test-generate","Generate comprehensive, maintainable unit tests across languages with strong coverage and edge case focus.","https:\u002F\u002Fgithub.com\u002FJackSmack1971\u002Fantigravity-meta\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Funit-testing-test-generate\u002FSKILL.md",[110],{"categoryNo":111,"categoryName":112,"taxonomyType":113,"taxonomyTypeDesc":114},"01JBSEEDCAT000000000000008","测试与质量","SCENARIO","使用场景",[116,117,118,119,120,121,122,123,124,95,125,126,127,128,31,129],"testing","test","generate","unit testing","unit testing test generate","unit","unit tests","case","unknown","edge","tests","across","focus","coverage",{"skillNo":131,"name":132,"nameZh":6,"description":133,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":134,"categories":135,"keywords":140,"publishedAt":38},"01M6N8FAAMS0QNTPD51FMYHAXE","testing-qa","Comprehensive testing and QA workflow covering unit testing, integration testing, E2E testing, browser automation, and quality assurance.","https:\u002F\u002Fgithub.com\u002FJackSmack1971\u002Fantigravity-meta\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Ftesting-qa\u002FSKILL.md",[136,137],{"categoryNo":111,"categoryName":112,"taxonomyType":113,"taxonomyTypeDesc":114},{"categoryNo":138,"categoryName":139,"taxonomyType":113,"taxonomyTypeDesc":114},"01JBSEEDCAT000000000000023","Skill与智能体开发",[141,116,142,143,119,32,144,145,121,146,147,148,149,150,151,30,152,153],"qa","testing qa","quality assurance","bundle","integration testing","e2e","integration","browser","personal","automation","workflow","browser automation","e2e testing",{"skillNo":155,"name":156,"nameZh":6,"description":157,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":158,"categories":159,"keywords":161,"publishedAt":38},"01M6N8EXMACVX27C0TXFT0E48Q","test-fixing","Systematically identify and fix all failing tests using smart grouping strategies. Use when explicitly asks to fix tests (\"fix these tests\", \"make tests pass\"), reports test failures (\"tests are failing\", \"test suite is broken\"), or completes implementation and wants tests passing.","https:\u002F\u002Fgithub.com\u002FJackSmack1971\u002Fantigravity-meta\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Ftest-fixing\u002FSKILL.md",[160],{"categoryNo":111,"categoryName":112,"taxonomyType":113,"taxonomyTypeDesc":114},[162,117,31,163,164,126,97,165,166,167,168,169,170,171,172,30],"test fixing","suite","make","grouping","make tests","implementation","reports","test suite","use","fix","broken",{"skillNo":174,"name":175,"nameZh":6,"description":176,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":177,"categories":178,"keywords":180,"publishedAt":38},"01M6N8ERMMBFTRRNK0T7H2S6R2","test-driven-development","Use when implementing any feature or bugfix, before writing implementation code","https:\u002F\u002Fgithub.com\u002FJackSmack1971\u002Fantigravity-meta\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Ftest-driven-development\u002FSKILL.md",[179],{"categoryNo":111,"categoryName":112,"taxonomyType":113,"taxonomyTypeDesc":114},[181,182,183,117,184,185,31,167,170,186,187,188,124],"driven","development","test driven development","bugfix","feature","code","writing","implementing",{"skillNo":190,"name":191,"nameZh":6,"description":192,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":193,"categories":194,"keywords":199,"publishedAt":38},"01M6N8EKRM0XQX5BKR8NJ2YAGF","terraform-infrastructure","Terraform infrastructure as code workflow for provisioning cloud resources, creating reusable modules, and managing infrastructure at scale.","https:\u002F\u002Fgithub.com\u002FJackSmack1971\u002Fantigravity-meta\u002Fblob\u002Fmain\u002F.agents\u002Fskills\u002Fterraform-infrastructure\u002FSKILL.md",[195,198],{"categoryNo":196,"categoryName":197,"taxonomyType":113,"taxonomyTypeDesc":114},"01JBSEEDCAT000000000000011","运维与部署",{"categoryNo":138,"categoryName":139,"taxonomyType":113,"taxonomyTypeDesc":114},[200,201,202,203,204,205,206,144,27,207,208,209,210,211,186,151,30,149],"terraform","infrastructure","terraform infrastructure","resources","for","at","scale","reusable","modules","provisioning","cloud","infrastructure as code"]