[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M7B5TZ7SZEXWA7C48KPMVTQ8":3,"skill-same:01M7B5TZ7SZEXWA7C48KPMVTQ8":47},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":19,"linkOnly":20,"markdownContent":21,"markdownBody":22,"frontMatter":23,"refName":24,"commitSha":25,"skillDirectory":26,"forksCount":27,"repositoryHtmlUrl":28,"repositoryHomepageUrl":29,"ownerHtmlUrl":30,"ownerBlogUrl":31,"ownerDescription":6,"updatedAt":32,"install":33,"resources":46},"01M7B5TZ7SZEXWA7C48KPMVTQ8","modelopt-accessing-mlflow",null,"Query and browse evaluation results stored in MLflow. Use when the user wants to look up runs by invocation ID, compare metrics across models, fetch artifacts (configs, logs, results), or set up the MLflow MCP server. ALWAYS triggers on mentions of MLflow, experiment results, run comparison, invocation IDs in the context of results, or MLflow MCP setup.","NVIDIA\u002FModel-Optimizer","NVIDIA","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F1728152?v=4","01M6BXXZYTRNBXSTRXNNBB356H","NVIDIA Corporation","01M6BXY02X3PRVHNNATDHA2D0W",5604,"Apache-2.0","https:\u002F\u002Fgithub.com\u002FNVIDIA\u002FModel-Optimizer\u002Fblob\u002Fmain\u002Fskills\u002Fmodelopt-accessing-mlflow\u002FSKILL.md",[],[],"2026-11-15 14:19:17",false,"---\nname: modelopt-accessing-mlflow\ndescription: Query and browse evaluation results stored in MLflow. Use when the user wants to look up runs by invocation ID, compare metrics across models, fetch artifacts (configs, logs, results), or set up the MLflow MCP server. ALWAYS triggers on mentions of MLflow, experiment results, run comparison, invocation IDs in the context of results, or MLflow MCP setup.\nlicense: Apache-2.0\n# Vendored verbatim from NVIDIA NeMo Evaluator (commit 8fa16b2)\n# https:\u002F\u002Fgithub.com\u002FNVIDIA-NeMo\u002FEvaluator\u002Ftree\u002F8fa16b237d11e213ea665d5bad6b44d393762317\u002Fpackages\u002Fnemo-evaluator-launcher\u002F.claude\u002Fskills\u002Faccessing-mlflow\n# To re-sync: .claude\u002Fscripts\u002Fsync-upstream-skills.sh\n# Note: this skill depends on the mlflow-mcp MCP server (https:\u002F\u002Fgithub.com\u002Fkkruglik\u002Fmlflow-mcp)\n# configured in the user's Claude Code setup.\n---\n\n# Accessing MLflow\n\n## MCP Server\n\n[mlflow-mcp](https:\u002F\u002Fgithub.com\u002Fkkruglik\u002Fmlflow-mcp) gives agents direct access to MLflow — query runs, compare metrics, browse artifacts, all through natural language.\n\n## ID Convention\n\nWhen the user provides a hex ID (e.g. `71f3f3199ea5e1f0`) without specifying what it is, assume it is an **invocation_id** (not an MLflow run_id). An invocation_id identifies a launcher invocation and is stored as both a tag and a param on MLflow runs. One invocation can produce multiple MLflow runs (one per task). You may need to search across multiple experiments if you don't know which experiment the run belongs to.\n\n## Querying Runs\n\n```python\n# Find runs by invocation_id\nMLflow:search_runs_by_tags(experiment_id, {\"invocation_id\": \"\u003Cinvocation_id>\"})\n\n# Query for example model\u002Ftask runs\nMLflow:query_runs(experiment_id, \"tags.model LIKE '%\u003Cmodel>%'\")\nMLflow:query_runs(experiment_id, \"tags.task_name LIKE '%\u003Ctask_name>%'\")\n\n# Get a config from run's artifacts\nMLflow:get_artifact_content(run_id, \"config.yml\")\n\n# Get nested stats from run's artifacts\nMLflow:get_artifact_content(run_id, \"artifacts\u002Feval_factory_metrics.json\")\n```\n\nNOTE: You WILL NOT find PENDING, RUNNING, KILLED, or FAILED runs in MLflow! Only SUCCESSFUL runs are exported to MLflow.\n\n## Workflow Tips\n\nWhen comparing metrics across runs, fetch the data via MCP, then run the computation in Python for exact results rather than doing math in-context:\n\n```bash\nuv run --with pandas python3 \u003C\u003C 'EOF'\nimport pandas as pd\n# ... compute deltas, averages, etc.\nEOF\n```\n\n## Artifacts Structure\n\n```\n\u003Charness>.\u003Ctask>\u002F\n├── artifacts\u002F\n│   ├── config.yml                # Fully resolved config used during the evaluation\n│   ├── launcher_unresolved_config.yaml # Unresolved config passed to the launcher\n│   ├── results.yml               # All results in YAML format\n│   ├── eval_factory_metrics.json # Runtime stats (latency, tokens count, memory)\n│   ├── report.html               # Request-Response Pairs samples in HTML format (if enabled)\n│   └── report.json               # Request-Response Pairs samples in JSON format (if enabled)\n└── logs\u002F\n    ├── client-*.log              # Evaluation client\n    ├── server-*-N.log            # Deployment per node\n    ├── slurm-*.log               # Slurm job\n    └── proxy-*.log               # Request proxy\n```\n\n## Troubleshooting\n\nIf the MLflow MCP server fails to load or its tools are unavailable:\n\n1. **`uvx` not found** — install [uv](https:\u002F\u002Fdocs.astral.sh\u002Fuv\u002Fgetting-started\u002Finstallation\u002F):\n   ```bash\n   curl -LsSf https:\u002F\u002Fastral.sh\u002Fuv\u002Finstall.sh | sh\n   ```\n2. **MCP server not configured** — add the config and restart the agent:\n\n   **For Claude Code** — add to `.claude\u002Fsettings.json` (project or user level), under `\"mcpServers\"`:\n   ```json\n   \"MLflow\": {\n     \"command\": \"uvx\",\n     \"args\": [\"mlflow-mcp\"],\n     \"env\": {\n       \"MLFLOW_TRACKING_URI\": \"https:\u002F\u002F\u003Cyour-mlflow-server>\u002F\"\n     }\n   }\n   ```\n\n   **For Cursor** — edit `~\u002F.cursor\u002Fmcp.json` (Settings > Tools & MCP > New MCP Server):\n   ```json\n   {\n     \"mcpServers\": {\n       \"MLflow\": {\n         \"command\": \"uvx\",\n         \"args\": [\"mlflow-mcp\"],\n         \"env\": {\n           \"MLFLOW_TRACKING_URI\": \"https:\u002F\u002F\u003Cyour-mlflow-server>\u002F\"\n         }\n       }\n     }\n   }\n   ```\n","# Accessing MLflow\n\n## MCP Server\n\n[mlflow-mcp](https:\u002F\u002Fgithub.com\u002Fkkruglik\u002Fmlflow-mcp) gives agents direct access to MLflow — query runs, compare metrics, browse artifacts, all through natural language.\n\n## ID Convention\n\nWhen the user provides a hex ID (e.g. `71f3f3199ea5e1f0`) without specifying what it is, assume it is an **invocation_id** (not an MLflow run_id). An invocation_id identifies a launcher invocation and is stored as both a tag and a param on MLflow runs. One invocation can produce multiple MLflow runs (one per task). You may need to search across multiple experiments if you don't know which experiment the run belongs to.\n\n## Querying Runs\n\n```python\n# Find runs by invocation_id\nMLflow:search_runs_by_tags(experiment_id, {\"invocation_id\": \"\u003Cinvocation_id>\"})\n\n# Query for example model\u002Ftask runs\nMLflow:query_runs(experiment_id, \"tags.model LIKE '%\u003Cmodel>%'\")\nMLflow:query_runs(experiment_id, \"tags.task_name LIKE '%\u003Ctask_name>%'\")\n\n# Get a config from run's artifacts\nMLflow:get_artifact_content(run_id, \"config.yml\")\n\n# Get nested stats from run's artifacts\nMLflow:get_artifact_content(run_id, \"artifacts\u002Feval_factory_metrics.json\")\n```\n\nNOTE: You WILL NOT find PENDING, RUNNING, KILLED, or FAILED runs in MLflow! Only SUCCESSFUL runs are exported to MLflow.\n\n## Workflow Tips\n\nWhen comparing metrics across runs, fetch the data via MCP, then run the computation in Python for exact results rather than doing math in-context:\n\n```bash\nuv run --with pandas python3 \u003C\u003C 'EOF'\nimport pandas as pd\n# ... compute deltas, averages, etc.\nEOF\n```\n\n## Artifacts Structure\n\n```\n\u003Charness>.\u003Ctask>\u002F\n├── artifacts\u002F\n│   ├── config.yml                # Fully resolved config used during the evaluation\n│   ├── launcher_unresolved_config.yaml # Unresolved config passed to the launcher\n│   ├── results.yml               # All results in YAML format\n│   ├── eval_factory_metrics.json # Runtime stats (latency, tokens count, memory)\n│   ├── report.html               # Request-Response Pairs samples in HTML format (if enabled)\n│   └── report.json               # Request-Response Pairs samples in JSON format (if enabled)\n└── logs\u002F\n    ├── client-*.log              # Evaluation client\n    ├── server-*-N.log            # Deployment per node\n    ├── slurm-*.log               # Slurm job\n    └── proxy-*.log               # Request proxy\n```\n\n## Troubleshooting\n\nIf the MLflow MCP server fails to load or its tools are unavailable:\n\n1. **`uvx` not found** — install [uv](https:\u002F\u002Fdocs.astral.sh\u002Fuv\u002Fgetting-started\u002Finstallation\u002F):\n   ```bash\n   curl -LsSf https:\u002F\u002Fastral.sh\u002Fuv\u002Finstall.sh | sh\n   ```\n2. **MCP server not configured** — add the config and restart the agent:\n\n   **For Claude Code** — add to `.claude\u002Fsettings.json` (project or user level), under `\"mcpServers\"`:\n   ```json\n   \"MLflow\": {\n     \"command\": \"uvx\",\n     \"args\": [\"mlflow-mcp\"],\n     \"env\": {\n       \"MLFLOW_TRACKING_URI\": \"https:\u002F\u002F\u003Cyour-mlflow-server>\u002F\"\n     }\n   }\n   ```\n\n   **For Cursor** — edit `~\u002F.cursor\u002Fmcp.json` (Settings > Tools & MCP > New MCP Server):\n   ```json\n   {\n     \"mcpServers\": {\n       \"MLflow\": {\n         \"command\": \"uvx\",\n         \"args\": [\"mlflow-mcp\"],\n         \"env\": {\n           \"MLFLOW_TRACKING_URI\": \"https:\u002F\u002F\u003Cyour-mlflow-server>\u002F\"\n         }\n       }\n     }\n   }\n   ```\n",{"name":5,"license":15,"description":7},"main","e169b4c2bc62a32c45aaef793cde7599dee2c1b2","skills\u002Fmodelopt-accessing-mlflow",806,"https:\u002F\u002Fgithub.com\u002FNVIDIA\u002FModel-Optimizer","https:\u002F\u002Fnvidia.github.io\u002FModel-Optimizer\u002F","https:\u002F\u002Fgithub.com\u002FNVIDIA","https:\u002F\u002Fnvidia.com","2026-11-15 02:45:59",{"source":8,"skillName":5,"commands":34,"prompt":44,"zipAvailable":45},[35,38,41],{"tool":36,"command":37},"npx","npx skills add NVIDIA\u002FModel-Optimizer --skill modelopt-accessing-mlflow",{"tool":39,"command":40},"bunx","bunx skills add NVIDIA\u002FModel-Optimizer --skill modelopt-accessing-mlflow",{"tool":42,"command":43},"pnpm","pnpm dlx skills add NVIDIA\u002FModel-Optimizer --skill modelopt-accessing-mlflow","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002FNVIDIA\u002FModel-Optimizer\u002Fblob\u002Fmain\u002Fskills\u002Fmodelopt-accessing-mlflow\u002FSKILL.md",true,[],[48,55,62,69,76,83],{"skillNo":49,"name":50,"nameZh":6,"description":51,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":52,"categories":53,"keywords":54,"publishedAt":19},"01M7B5XD9M965H2TAV4ZJMPF6N","modelopt-speculative-decoding","Train, debug, and validate a speculative decoding draft model (EAGLE3, DFlash, DSpark, Domino) through the ModelOpt launcher pipeline. Use when the user wants to add a new model to a draft-training pipeline, asks why a pipeline run failed, wants experiment logs reviewed, or wants to check whether a run's acceptance rate meets threshold. Triggers on \"EAGLE3\", \"DFlash\", \"DSpark\", \"Domino\", \"draft model\", \"acceptance rate\", \"speculative decoding pipeline\". Do NOT use for quantizing a model (use modelopt-ptq) or serving a checkpoint (use modelopt-deployment).","https:\u002F\u002Fgithub.com\u002FNVIDIA\u002FModel-Optimizer\u002Fblob\u002Fmain\u002Fskills\u002Fmodelopt-speculative-decoding\u002FSKILL.md",[],[],{"skillNo":56,"name":57,"nameZh":6,"description":58,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":59,"categories":60,"keywords":61,"publishedAt":19},"01M7B5X9SG5FHW174VFK979DQ9","modelopt-run-agentx","Run the AgentX agentic serving benchmark with the SemiAnalysis harness. Use for AgentX setup, dataset downloads, concurrency sweeps, or serving latency and throughput comparisons.","https:\u002F\u002Fgithub.com\u002FNVIDIA\u002FModel-Optimizer\u002Fblob\u002Fmain\u002Fskills\u002Fmodelopt-run-agentx\u002FSKILL.md",[],[],{"skillNo":63,"name":64,"nameZh":6,"description":65,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":66,"categories":67,"keywords":68,"publishedAt":19},"01M7B5X4C0XGVA8N0BXF9N4HCX","modelopt-release-cherry-pick","Audit merged bug-fix PRs and release NVBugs for missing cherry-pick labels, then cherry-pick labeled PRs into a release branch and open a PR. Use when asked to \"cherry-pick PRs for release\u002FX.Y.Z\", \"pick PRs to release branch\", \"verify cherry-pick labels\", or \"cherry-pick labeled PRs\".","https:\u002F\u002Fgithub.com\u002FNVIDIA\u002FModel-Optimizer\u002Fblob\u002Fmain\u002Fskills\u002Fmodelopt-release-cherry-pick\u002FSKILL.md",[],[],{"skillNo":70,"name":71,"nameZh":6,"description":72,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":73,"categories":74,"keywords":75,"publishedAt":19},"01M7B5WXMDYXCK43YA5ZEF7ECY","modelopt-quant-recipe-search","Use when the user asks to find, search for, or optimize the best quantization recipe for a model, including direct requests like \"find the best quantization recipe and generate a PTQ checkpoint.\" Guides the multi-candidate loop: choose compute-vs-memory success metrics, select ModelOpt recipe baselines, design AutoQuant\u002Fmanual recipe deltas, interpret sensitivity, and decide next candidates. Do NOT use for a single known PTQ recipe run (use modelopt-ptq), serving (use modelopt-deployment), creating\u002Frunning evals (use modelopt-evaluation or modelopt-launching-evals), monitoring jobs (use modelopt-monitor), MLflow browsing (use modelopt-accessing-mlflow), or comparing completed baseline-vs-candidate scores only (use modelopt-compare-results).","https:\u002F\u002Fgithub.com\u002FNVIDIA\u002FModel-Optimizer\u002Fblob\u002Fmain\u002Fskills\u002Fmodelopt-quant-recipe-search\u002FSKILL.md",[],[],{"skillNo":77,"name":78,"nameZh":6,"description":79,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":80,"categories":81,"keywords":82,"publishedAt":19},"01M7B5WRMPZE23YXCFMZBM8KJA","modelopt-qad","Run explicitly requested ModelOpt Quantization-Aware Distillation (QAD) through Megatron Bridge (recommended) or Hugging Face Transformers to recover a measured BF16-to-PTQ accuracy gap. Use only when the user explicitly asks for QAD, including its topology, data preparation, launch, resume, checkpoint export, or recovery decisions.","https:\u002F\u002Fgithub.com\u002FNVIDIA\u002FModel-Optimizer\u002Fblob\u002Fmain\u002Fskills\u002Fmodelopt-qad\u002FSKILL.md",[],[],{"skillNo":84,"name":85,"nameZh":6,"description":86,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":87,"categories":88,"keywords":89,"publishedAt":19},"01M7B5WJHB4D787EZCY4RNN44T","modelopt-ptq","Use when the user asks to \"quantize a model\", \"run PTQ\", \"post-training quantization\", \"NVFP4 quantization\", \"FP8 quantization\", \"INT8 quantization\", \"INT4 AWQ\", \"quantize LLM\", \"quantize MoE\", \"quantize VLM\", or needs to produce a quantized HuggingFace checkpoint from a pretrained model using ModelOpt. Do NOT use for multi-candidate recipe exploration or optimization (use modelopt-quant-recipe-search).","https:\u002F\u002Fgithub.com\u002FNVIDIA\u002FModel-Optimizer\u002Fblob\u002Fmain\u002Fskills\u002Fmodelopt-ptq\u002FSKILL.md",[],[]]