[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M6MFCGDH24H8A66DTPRWHXZG":3,"skill-same:01M6MFCGDH24H8A66DTPRWHXZG":88},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":38,"linkOnly":39,"markdownContent":40,"markdownBody":41,"frontMatter":42,"refName":67,"commitSha":68,"skillDirectory":69,"forksCount":70,"repositoryHtmlUrl":71,"repositoryHomepageUrl":6,"ownerHtmlUrl":72,"ownerBlogUrl":6,"ownerDescription":6,"updatedAt":73,"install":74,"resources":87},"01M6MFCGDH24H8A66DTPRWHXZG","obliteratus",null,"Remove refusal behaviors from open-weight LLMs using OBLITERATUS — mechanistic interpretability techniques (diff-in-means, SVD, whitened SVD, LEACE, SAE decomposition, etc.) to excise guardrails while preserving reasoning. 9 CLI methods, 28 analysis modules, 116 model presets across 5 compute tiers, tournament evaluation, and telemetry-driven recommendations. Use when a user wants to uncensor, abliterate, or remove refusal from an LLM.","ibragimov-oasis\u002Fvibe-coder","ibragimov-oasis","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F240665573?v=4","01M6DF78Y45R8228FHAZ7G6JXM","IBRAGIMOV MUKHAMMADJON","01M6K5ZYR8TDPAFG4R6693E2A6",3,"MIT","https:\u002F\u002Fgithub.com\u002Fibragimov-oasis\u002Fvibe-coder\u002Fblob\u002Fmain\u002Fvc-kit\u002Fcontent\u002FCOMBINED\u002FCOMBINED\u002FREPO_DOCS\u002F02-hermes-agent\u002Fskills\u002Fmlops\u002Finference\u002Fobliteratus\u002FSKILL.md",[],[5,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37],"modules","Interpretability","GGUF","Bitsandbytes","Accelerate","recommendations","decomposition","across","methods","cli","diff","remove","model","open","analysis","Guardrails","Transformers","Evaluation","llms","2026-11-10 10:12:30",false,"---\nname: obliteratus\ndescription: Remove refusal behaviors from open-weight LLMs using OBLITERATUS — mechanistic interpretability techniques (diff-in-means, SVD, whitened SVD, LEACE, SAE decomposition, etc.) to excise guardrails while preserving reasoning. 9 CLI methods, 28 analysis modules, 116 model presets across 5 compute tiers, tournament evaluation, and telemetry-driven recommendations. Use when a user wants to uncensor, abliterate, or remove refusal from an LLM.\nversion: 2.0.0\nauthor: Hermes Agent\nlicense: MIT\ndependencies: [obliteratus, torch, transformers, bitsandbytes, accelerate, safetensors]\nmetadata:\n  hermes:\n    tags: [Abliteration, Uncensoring, Refusal-Removal, LLM, Weight-Projection, SVD, Mechanistic-Interpretability, HuggingFace, Model-Surgery]\n    related_skills: [vllm, gguf, huggingface-tokenizers]\n---\n\n# OBLITERATUS Skill\n\nRemove refusal behaviors (guardrails) from open-weight LLMs without retraining or fine-tuning. Uses mechanistic interpretability techniques — including diff-in-means, SVD, whitened SVD, LEACE concept erasure, SAE decomposition, Bayesian kernel projection, and more — to identify and surgically excise refusal directions from model weights while preserving reasoning capabilities.\n\n**License warning:** OBLITERATUS is AGPL-3.0. NEVER import it as a Python library. Always invoke via CLI (`obliteratus` command) or subprocess. This keeps Hermes Agent's MIT license clean.\n\n## When to Use This Skill\n\nTrigger when the user:\n- Wants to \"uncensor\" or \"abliterate\" an LLM\n- Asks about removing refusal\u002Fguardrails from a model\n- Wants to create an uncensored version of Llama, Qwen, Mistral, etc.\n- Mentions \"refusal removal\", \"abliteration\", \"weight projection\"\n- Wants to analyze how a model's refusal mechanism works\n- References OBLITERATUS, abliterator, or refusal directions\n\n## Step 1: Installation\n\nCheck if already installed:\n```bash\nobliteratus --version 2>\u002Fdev\u002Fnull && echo \"INSTALLED\" || echo \"NOT INSTALLED\"\n```\n\nIf not installed, clone and install from GitHub:\n```bash\ngit clone https:\u002F\u002Fgithub.com\u002Felder-plinius\u002FOBLITERATUS.git\ncd OBLITERATUS\npip install -e .\n# For Gradio web UI support:\n# pip install -e \".[spaces]\"\n```\n\n**IMPORTANT:** Confirm with user before installing. This pulls in ~5-10GB of dependencies (PyTorch, Transformers, bitsandbytes, etc.).\n\n## Step 2: Check Hardware\n\nBefore anything, check what GPU is available:\n```bash\npython3 -c \"\nimport torch\nif torch.cuda.is_available():\n    gpu = torch.cuda.get_device_name(0)\n    vram = torch.cuda.get_device_properties(0).total_memory \u002F 1024**3\n    print(f'GPU: {gpu}')\n    print(f'VRAM: {vram:.1f} GB')\n    if vram \u003C 4: print('TIER: tiny (models under 1B)')\n    elif vram \u003C 8: print('TIER: small (models 1-4B)')\n    elif vram \u003C 16: print('TIER: medium (models 4-9B with 4bit quant)')\n    elif vram \u003C 32: print('TIER: large (models 8-32B with 4bit quant)')\n    else: print('TIER: frontier (models 32B+)')\nelse:\n    print('NO GPU - only tiny models (under 1B) on CPU')\n\"\n```\n\n### VRAM Requirements (with 4-bit quantization)\n\n| VRAM     | Max Model Size  | Example Models                              |\n|:---------|:----------------|:--------------------------------------------|\n| CPU only | ~1B params      | GPT-2, TinyLlama, SmolLM                    |\n| 4-8 GB   | ~4B params      | Qwen2.5-1.5B, Phi-3.5 mini, Llama 3.2 3B   |\n| 8-16 GB  | ~9B params      | Llama 3.1 8B, Mistral 7B, Gemma 2 9B       |\n| 24 GB    | ~32B params     | Qwen3-32B, Llama 3.1 70B (tight), Command-R |\n| 48 GB+   | ~72B+ params    | Qwen2.5-72B, DeepSeek-R1                    |\n| Multi-GPU| 200B+ params    | Llama 3.1 405B, DeepSeek-V3 (685B MoE)      |\n\n## Step 3: Browse Available Models & Get Recommendations\n\n```bash\n# Browse models by compute tier\nobliteratus models --tier medium\n\n# Get architecture info for a specific model\nobliteratus info \u003Cmodel_name>\n\n# Get telemetry-driven recommendation for best method & params\nobliteratus recommend \u003Cmodel_name>\nobliteratus recommend \u003Cmodel_name> --insights  # global cross-architecture rankings\n```\n\n## Step 4: Choose a Method\n\n### Method Selection Guide\n**Default \u002F recommended for most cases: `advanced`.** It uses multi-direction SVD with norm-preserving projection and is well-tested.\n\n| Situation                         | Recommended Method | Why                                      |\n|:----------------------------------|:-------------------|:-----------------------------------------|\n| Default \u002F most models             | `advanced`         | Multi-direction SVD, norm-preserving, reliable |\n| Quick test \u002F prototyping          | `basic`            | Fast, simple, good enough to evaluate    |\n| Dense model (Llama, Mistral)      | `advanced`         | Multi-direction, norm-preserving         |\n| MoE model (DeepSeek, Mixtral)     | `nuclear`          | Expert-granular, handles MoE complexity  |\n| Reasoning model (R1 distills)     | `surgical`         | CoT-aware, preserves chain-of-thought    |\n| Stubborn refusals persist         | `aggressive`       | Whitened SVD + head surgery + jailbreak   |\n| Want reversible changes           | Use steering vectors (see Analysis section) |\n| Maximum quality, time no object   | `optimized`        | Bayesian search for best parameters      |\n| Experimental auto-detection       | `informed`         | Auto-detects alignment type — experimental, may not always outperform advanced |\n\n### 9 CLI Methods\n- **basic** — Single refusal direction via diff-in-means. Fast (~5-10 min for 8B).\n- **advanced** (DEFAULT, RECOMMENDED) — Multiple SVD directions, norm-preserving projection, 2 refinement passes. Medium speed (~10-20 min).\n- **aggressive** — Whitened SVD + jailbreak-contrastive + attention head surgery. Higher risk of coherence damage.\n- **spectral_cascade** — DCT frequency-domain decomposition. Research\u002Fnovel approach.\n- **informed** — Runs analysis DURING abliteration to auto-configure. Experimental — slower and less predictable than advanced.\n- **surgical** — SAE features + neuron masking + head surgery + per-expert. Very slow (~1-2 hrs). Best for reasoning models.\n- **optimized** — Bayesian hyperparameter search (Optuna TPE). Longest runtime but finds optimal parameters.\n- **inverted** — Flips the refusal direction. Model becomes actively willing.\n- **nuclear** — Maximum force combo for stubborn MoE models. Expert-granular.\n\n### Direction Extraction Methods (--direction-method flag)\n- **diff_means** (default) — Simple difference-in-means between refused\u002Fcomplied activations. Robust.\n- **svd** — Multi-direction SVD extraction. Better for complex alignment.\n- **leace** — LEACE (Linear Erasure via Closed-form Estimation). Optimal linear erasure.\n\n### 4 Python-API-Only Methods\n(NOT available via CLI — require Python import, which violates AGPL boundary. Mention to user only if they explicitly want to use OBLITERATUS as a library in their own AGPL project.)\n- failspy, gabliteration, heretic, rdo\n\n## Step 5: Run Abliteration\n\n### Standard usage\n```bash\n# Default method (advanced) — recommended for most models\nobliteratus obliterate \u003Cmodel_name> --method advanced --output-dir .\u002Fabliterated-models\n\n# With 4-bit quantization (saves VRAM)\nobliteratus obliterate \u003Cmodel_name> --method advanced --quantization 4bit --output-dir .\u002Fabliterated-models\n\n# Large models (70B+) — conservative defaults\nobliteratus obliterate \u003Cmodel_name> --method advanced --quantization 4bit --large-model --output-dir .\u002Fabliterated-models\n```\n\n### Fine-tuning parameters\n```bash\nobliteratus obliterate \u003Cmodel_name> \\\n  --method advanced \\\n  --direction-method diff_means \\\n  --n-directions 4 \\\n  --refinement-passes 2 \\\n  --regularization 0.1 \\\n  --quantization 4bit \\\n  --output-dir .\u002Fabliterated-models \\\n  --contribute  # opt-in telemetry for community research\n```\n\n### Key flags\n| Flag | Description | Default |\n|:-----|:------------|:--------|\n| `--method` | Abliteration method | advanced |\n| `--direction-method` | Direction extraction | diff_means |\n| `--n-directions` | Number of refusal directions (1-32) | method-dependent |\n| `--refinement-passes` | Iterative passes (1-5) | 2 |\n| `--regularization` | Regularization strength (0.0-1.0) | 0.1 |\n| `--quantization` | Load in 4bit or 8bit | none (full precision) |\n| `--large-model` | Conservative defaults for 120B+ | false |\n| `--output-dir` | Where to save the abliterated model | .\u002Fobliterated_model |\n| `--contribute` | Share anonymized results for research | false |\n| `--verify-sample-size` | Number of test prompts for refusal check | 20 |\n| `--dtype` | Model dtype (float16, bfloat16) | auto |\n\n### Other execution modes\n```bash\n# Interactive guided mode (hardware → model → preset)\nobliteratus interactive\n\n# Web UI (Gradio)\nobliteratus ui --port 7860\n\n# Run a full ablation study from YAML config\nobliteratus run config.yaml --preset quick\n\n# Tournament: pit all methods against each other\nobliteratus tourney \u003Cmodel_name>\n```\n\n## Step 6: Verify Results\n\nAfter abliteration, check the output metrics:\n\n| Metric | Good Value | Warning |\n|:-------|:-----------|:--------|\n| Refusal rate | \u003C 5% (ideally ~0%) | > 10% means refusals persist |\n| Perplexity change | \u003C 10% increase | > 15% means coherence damage |\n| KL divergence | \u003C 0.1 | > 0.5 means significant distribution shift |\n| Coherence | High \u002F passes qualitative check | Degraded responses, repetition |\n\n### If refusals persist (> 10%)\n1. Try `aggressive` method\n2. Increase `--n-directions` (e.g., 8 or 16)\n3. Add `--refinement-passes 3`\n4. Try `--direction-method svd` instead of diff_means\n\n### If coherence is damaged (perplexity > 15% increase)\n1. Reduce `--n-directions` (try 2)\n2. Increase `--regularization` (try 0.3)\n3. Reduce `--refinement-passes` to 1\n4. Try `basic` method (gentler)\n\n## Step 7: Use the Abliterated Model\n\nThe output is a standard HuggingFace model directory.\n\n```bash\n# Test locally with transformers\npython3 -c \"\nfrom transformers import AutoModelForCausalLM, AutoTokenizer\nmodel = AutoModelForCausalLM.from_pretrained('.\u002Fabliterated-models\u002F\u003Cmodel>')\ntokenizer = AutoTokenizer.from_pretrained('.\u002Fabliterated-models\u002F\u003Cmodel>')\ninputs = tokenizer('How do I pick a lock?', return_tensors='pt')\noutputs = model.generate(**inputs, max_new_tokens=200)\nprint(tokenizer.decode(outputs[0], skip_special_tokens=True))\n\"\n\n# Upload to HuggingFace Hub\nhuggingface-cli upload \u003Cusername>\u002F\u003Cmodel-name>-abliterated .\u002Fabliterated-models\u002F\u003Cmodel>\n\n# Serve with vLLM\nvllm serve .\u002Fabliterated-models\u002F\u003Cmodel>\n```\n\n## CLI Command Reference\n\n| Command | Description |\n|:--------|:------------|\n| `obliteratus obliterate` | Main abliteration command |\n| `obliteratus info \u003Cmodel>` | Print model architecture details |\n| `obliteratus models --tier \u003Ctier>` | Browse curated models by compute tier |\n| `obliteratus recommend \u003Cmodel>` | Telemetry-driven method\u002Fparam suggestion |\n| `obliteratus interactive` | Guided setup wizard |\n| `obliteratus tourney \u003Cmodel>` | Tournament: all methods head-to-head |\n| `obliteratus run \u003Cconfig.yaml>` | Execute ablation study from YAML |\n| `obliteratus strategies` | List all registered ablation strategies |\n| `obliteratus report \u003Cresults.json>` | Regenerate visual reports |\n| `obliteratus ui` | Launch Gradio web interface |\n| `obliteratus aggregate` | Summarize community telemetry data |\n\n## Analysis Modules\n\nOBLITERATUS includes 28 analysis modules for mechanistic interpretability.\nSee `skill_view(name=\"obliteratus\", file_path=\"references\u002Fanalysis-modules.md\")` for the full reference.\n\n### Quick analysis commands\n```bash\n# Run specific analysis modules\nobliteratus run analysis-config.yaml --preset quick\n\n# Key modules to run first:\n# - alignment_imprint: Fingerprint DPO\u002FRLHF\u002FCAI\u002FSFT alignment method\n# - concept_geometry: Single direction vs polyhedral cone\n# - logit_lens: Which layer decides to refuse\n# - anti_ouroboros: Self-repair risk score\n# - causal_tracing: Causally necessary components\n```\n\n### Steering Vectors (Reversible Alternative)\nInstead of permanent weight modification, use inference-time steering:\n```python\n# Python API only — for user's own projects\nfrom obliteratus.analysis.steering_vectors import SteeringVectorFactory, SteeringHookManager\n```\n\n## Ablation Strategies\n\nBeyond direction-based abliteration, OBLITERATUS includes structural ablation strategies:\n- **Embedding Ablation** — Target embedding layer components\n- **FFN Ablation** — Feed-forward network block removal\n- **Head Pruning** — Attention head pruning\n- **Layer Removal** — Full layer removal\n\nList all available: `obliteratus strategies`\n\n## Evaluation\n\nOBLITERATUS includes built-in evaluation tools:\n- Refusal rate benchmarking\n- Perplexity comparison (before\u002Fafter)\n- LM Eval Harness integration for academic benchmarks\n- Head-to-head competitor comparison\n- Baseline performance tracking\n\n## Platform Support\n\n- **CUDA** — Full support (NVIDIA GPUs)\n- **Apple Silicon (MLX)** — Supported via MLX backend\n- **CPU** — Supported for tiny models (\u003C 1B params)\n\n## YAML Config Templates\n\nLoad templates for reproducible runs via `skill_view`:\n- `templates\u002Fabliteration-config.yaml` — Standard single-model config\n- `templates\u002Fanalysis-study.yaml` — Pre-abliteration analysis study\n- `templates\u002Fbatch-abliteration.yaml` — Multi-model batch processing\n\n## Telemetry\n\nOBLITERATUS can optionally contribute anonymized run data to a global research dataset.\nEnable with `--contribute` flag. No personal data is collected — only model name, method, metrics.\n\n## Common Pitfalls\n\n1. **Don't use `informed` as default** — it's experimental and slower. Use `advanced` for reliable results.\n2. **Models under ~1B respond poorly to abliteration** — their refusal behaviors are shallow and fragmented, making clean direction extraction difficult. Expect partial results (20-40% remaining refusal). Models 3B+ have cleaner refusal directions and respond much better (often 0% refusal with `advanced`).\n3. **`aggressive` can make things worse** — on small models it can damage coherence and actually increase refusal rate. Only use it if `advanced` leaves > 10% refusals on a 3B+ model.\n4. **Always check perplexity** — if it spikes > 15%, the model is damaged. Reduce aggressiveness.\n5. **MoE models need special handling** — use `nuclear` method for Mixtral, DeepSeek-MoE, etc.\n6. **Quantized models can't be re-quantized** — abliterate the full-precision model, then quantize the output.\n7. **VRAM estimation is approximate** — 4-bit quant helps but peak usage can spike during extraction.\n8. **Reasoning models are sensitive** — use `surgical` for R1 distills to preserve chain-of-thought.\n9. **Check `obliteratus recommend`** — telemetry data may have better parameters than defaults.\n10. **AGPL license** — never `import obliteratus` in MIT\u002FApache projects. CLI invocation only.\n11. **Large models (70B+)** — always use `--large-model` flag for conservative defaults.\n12. **Spectral certification RED is common** — the spectral check often flags \"incomplete\" even when practical refusal rate is 0%. Check actual refusal rate rather than relying on spectral certification alone.\n\n## Complementary Skills\n\n- **vllm** — Serve abliterated models with high throughput\n- **gguf** — Convert abliterated models to GGUF for llama.cpp\n- **huggingface-tokenizers** — Work with model tokenizers\n\n## ? Связи\n\n- [[000 - Map of Maps]] — REPO_DOCS\n- [[000 - Map of Maps]] — Map of Maps\n\n","# OBLITERATUS Skill\n\nRemove refusal behaviors (guardrails) from open-weight LLMs without retraining or fine-tuning. Uses mechanistic interpretability techniques — including diff-in-means, SVD, whitened SVD, LEACE concept erasure, SAE decomposition, Bayesian kernel projection, and more — to identify and surgically excise refusal directions from model weights while preserving reasoning capabilities.\n\n**License warning:** OBLITERATUS is AGPL-3.0. NEVER import it as a Python library. Always invoke via CLI (`obliteratus` command) or subprocess. This keeps Hermes Agent's MIT license clean.\n\n## When to Use This Skill\n\nTrigger when the user:\n- Wants to \"uncensor\" or \"abliterate\" an LLM\n- Asks about removing refusal\u002Fguardrails from a model\n- Wants to create an uncensored version of Llama, Qwen, Mistral, etc.\n- Mentions \"refusal removal\", \"abliteration\", \"weight projection\"\n- Wants to analyze how a model's refusal mechanism works\n- References OBLITERATUS, abliterator, or refusal directions\n\n## Step 1: Installation\n\nCheck if already installed:\n```bash\nobliteratus --version 2>\u002Fdev\u002Fnull && echo \"INSTALLED\" || echo \"NOT INSTALLED\"\n```\n\nIf not installed, clone and install from GitHub:\n```bash\ngit clone https:\u002F\u002Fgithub.com\u002Felder-plinius\u002FOBLITERATUS.git\ncd OBLITERATUS\npip install -e .\n# For Gradio web UI support:\n# pip install -e \".[spaces]\"\n```\n\n**IMPORTANT:** Confirm with user before installing. This pulls in ~5-10GB of dependencies (PyTorch, Transformers, bitsandbytes, etc.).\n\n## Step 2: Check Hardware\n\nBefore anything, check what GPU is available:\n```bash\npython3 -c \"\nimport torch\nif torch.cuda.is_available():\n    gpu = torch.cuda.get_device_name(0)\n    vram = torch.cuda.get_device_properties(0).total_memory \u002F 1024**3\n    print(f'GPU: {gpu}')\n    print(f'VRAM: {vram:.1f} GB')\n    if vram \u003C 4: print('TIER: tiny (models under 1B)')\n    elif vram \u003C 8: print('TIER: small (models 1-4B)')\n    elif vram \u003C 16: print('TIER: medium (models 4-9B with 4bit quant)')\n    elif vram \u003C 32: print('TIER: large (models 8-32B with 4bit quant)')\n    else: print('TIER: frontier (models 32B+)')\nelse:\n    print('NO GPU - only tiny models (under 1B) on CPU')\n\"\n```\n\n### VRAM Requirements (with 4-bit quantization)\n\n| VRAM     | Max Model Size  | Example Models                              |\n|:---------|:----------------|:--------------------------------------------|\n| CPU only | ~1B params      | GPT-2, TinyLlama, SmolLM                    |\n| 4-8 GB   | ~4B params      | Qwen2.5-1.5B, Phi-3.5 mini, Llama 3.2 3B   |\n| 8-16 GB  | ~9B params      | Llama 3.1 8B, Mistral 7B, Gemma 2 9B       |\n| 24 GB    | ~32B params     | Qwen3-32B, Llama 3.1 70B (tight), Command-R |\n| 48 GB+   | ~72B+ params    | Qwen2.5-72B, DeepSeek-R1                    |\n| Multi-GPU| 200B+ params    | Llama 3.1 405B, DeepSeek-V3 (685B MoE)      |\n\n## Step 3: Browse Available Models & Get Recommendations\n\n```bash\n# Browse models by compute tier\nobliteratus models --tier medium\n\n# Get architecture info for a specific model\nobliteratus info \u003Cmodel_name>\n\n# Get telemetry-driven recommendation for best method & params\nobliteratus recommend \u003Cmodel_name>\nobliteratus recommend \u003Cmodel_name> --insights  # global cross-architecture rankings\n```\n\n## Step 4: Choose a Method\n\n### Method Selection Guide\n**Default \u002F recommended for most cases: `advanced`.** It uses multi-direction SVD with norm-preserving projection and is well-tested.\n\n| Situation                         | Recommended Method | Why                                      |\n|:----------------------------------|:-------------------|:-----------------------------------------|\n| Default \u002F most models             | `advanced`         | Multi-direction SVD, norm-preserving, reliable |\n| Quick test \u002F prototyping          | `basic`            | Fast, simple, good enough to evaluate    |\n| Dense model (Llama, Mistral)      | `advanced`         | Multi-direction, norm-preserving         |\n| MoE model (DeepSeek, Mixtral)     | `nuclear`          | Expert-granular, handles MoE complexity  |\n| Reasoning model (R1 distills)     | `surgical`         | CoT-aware, preserves chain-of-thought    |\n| Stubborn refusals persist         | `aggressive`       | Whitened SVD + head surgery + jailbreak   |\n| Want reversible changes           | Use steering vectors (see Analysis section) |\n| Maximum quality, time no object   | `optimized`        | Bayesian search for best parameters      |\n| Experimental auto-detection       | `informed`         | Auto-detects alignment type — experimental, may not always outperform advanced |\n\n### 9 CLI Methods\n- **basic** — Single refusal direction via diff-in-means. Fast (~5-10 min for 8B).\n- **advanced** (DEFAULT, RECOMMENDED) — Multiple SVD directions, norm-preserving projection, 2 refinement passes. Medium speed (~10-20 min).\n- **aggressive** — Whitened SVD + jailbreak-contrastive + attention head surgery. Higher risk of coherence damage.\n- **spectral_cascade** — DCT frequency-domain decomposition. Research\u002Fnovel approach.\n- **informed** — Runs analysis DURING abliteration to auto-configure. Experimental — slower and less predictable than advanced.\n- **surgical** — SAE features + neuron masking + head surgery + per-expert. Very slow (~1-2 hrs). Best for reasoning models.\n- **optimized** — Bayesian hyperparameter search (Optuna TPE). Longest runtime but finds optimal parameters.\n- **inverted** — Flips the refusal direction. Model becomes actively willing.\n- **nuclear** — Maximum force combo for stubborn MoE models. Expert-granular.\n\n### Direction Extraction Methods (--direction-method flag)\n- **diff_means** (default) — Simple difference-in-means between refused\u002Fcomplied activations. Robust.\n- **svd** — Multi-direction SVD extraction. Better for complex alignment.\n- **leace** — LEACE (Linear Erasure via Closed-form Estimation). Optimal linear erasure.\n\n### 4 Python-API-Only Methods\n(NOT available via CLI — require Python import, which violates AGPL boundary. Mention to user only if they explicitly want to use OBLITERATUS as a library in their own AGPL project.)\n- failspy, gabliteration, heretic, rdo\n\n## Step 5: Run Abliteration\n\n### Standard usage\n```bash\n# Default method (advanced) — recommended for most models\nobliteratus obliterate \u003Cmodel_name> --method advanced --output-dir .\u002Fabliterated-models\n\n# With 4-bit quantization (saves VRAM)\nobliteratus obliterate \u003Cmodel_name> --method advanced --quantization 4bit --output-dir .\u002Fabliterated-models\n\n# Large models (70B+) — conservative defaults\nobliteratus obliterate \u003Cmodel_name> --method advanced --quantization 4bit --large-model --output-dir .\u002Fabliterated-models\n```\n\n### Fine-tuning parameters\n```bash\nobliteratus obliterate \u003Cmodel_name> \\\n  --method advanced \\\n  --direction-method diff_means \\\n  --n-directions 4 \\\n  --refinement-passes 2 \\\n  --regularization 0.1 \\\n  --quantization 4bit \\\n  --output-dir .\u002Fabliterated-models \\\n  --contribute  # opt-in telemetry for community research\n```\n\n### Key flags\n| Flag | Description | Default |\n|:-----|:------------|:--------|\n| `--method` | Abliteration method | advanced |\n| `--direction-method` | Direction extraction | diff_means |\n| `--n-directions` | Number of refusal directions (1-32) | method-dependent |\n| `--refinement-passes` | Iterative passes (1-5) | 2 |\n| `--regularization` | Regularization strength (0.0-1.0) | 0.1 |\n| `--quantization` | Load in 4bit or 8bit | none (full precision) |\n| `--large-model` | Conservative defaults for 120B+ | false |\n| `--output-dir` | Where to save the abliterated model | .\u002Fobliterated_model |\n| `--contribute` | Share anonymized results for research | false |\n| `--verify-sample-size` | Number of test prompts for refusal check | 20 |\n| `--dtype` | Model dtype (float16, bfloat16) | auto |\n\n### Other execution modes\n```bash\n# Interactive guided mode (hardware → model → preset)\nobliteratus interactive\n\n# Web UI (Gradio)\nobliteratus ui --port 7860\n\n# Run a full ablation study from YAML config\nobliteratus run config.yaml --preset quick\n\n# Tournament: pit all methods against each other\nobliteratus tourney \u003Cmodel_name>\n```\n\n## Step 6: Verify Results\n\nAfter abliteration, check the output metrics:\n\n| Metric | Good Value | Warning |\n|:-------|:-----------|:--------|\n| Refusal rate | \u003C 5% (ideally ~0%) | > 10% means refusals persist |\n| Perplexity change | \u003C 10% increase | > 15% means coherence damage |\n| KL divergence | \u003C 0.1 | > 0.5 means significant distribution shift |\n| Coherence | High \u002F passes qualitative check | Degraded responses, repetition |\n\n### If refusals persist (> 10%)\n1. Try `aggressive` method\n2. Increase `--n-directions` (e.g., 8 or 16)\n3. Add `--refinement-passes 3`\n4. Try `--direction-method svd` instead of diff_means\n\n### If coherence is damaged (perplexity > 15% increase)\n1. Reduce `--n-directions` (try 2)\n2. Increase `--regularization` (try 0.3)\n3. Reduce `--refinement-passes` to 1\n4. Try `basic` method (gentler)\n\n## Step 7: Use the Abliterated Model\n\nThe output is a standard HuggingFace model directory.\n\n```bash\n# Test locally with transformers\npython3 -c \"\nfrom transformers import AutoModelForCausalLM, AutoTokenizer\nmodel = AutoModelForCausalLM.from_pretrained('.\u002Fabliterated-models\u002F\u003Cmodel>')\ntokenizer = AutoTokenizer.from_pretrained('.\u002Fabliterated-models\u002F\u003Cmodel>')\ninputs = tokenizer('How do I pick a lock?', return_tensors='pt')\noutputs = model.generate(**inputs, max_new_tokens=200)\nprint(tokenizer.decode(outputs[0], skip_special_tokens=True))\n\"\n\n# Upload to HuggingFace Hub\nhuggingface-cli upload \u003Cusername>\u002F\u003Cmodel-name>-abliterated .\u002Fabliterated-models\u002F\u003Cmodel>\n\n# Serve with vLLM\nvllm serve .\u002Fabliterated-models\u002F\u003Cmodel>\n```\n\n## CLI Command Reference\n\n| Command | Description |\n|:--------|:------------|\n| `obliteratus obliterate` | Main abliteration command |\n| `obliteratus info \u003Cmodel>` | Print model architecture details |\n| `obliteratus models --tier \u003Ctier>` | Browse curated models by compute tier |\n| `obliteratus recommend \u003Cmodel>` | Telemetry-driven method\u002Fparam suggestion |\n| `obliteratus interactive` | Guided setup wizard |\n| `obliteratus tourney \u003Cmodel>` | Tournament: all methods head-to-head |\n| `obliteratus run \u003Cconfig.yaml>` | Execute ablation study from YAML |\n| `obliteratus strategies` | List all registered ablation strategies |\n| `obliteratus report \u003Cresults.json>` | Regenerate visual reports |\n| `obliteratus ui` | Launch Gradio web interface |\n| `obliteratus aggregate` | Summarize community telemetry data |\n\n## Analysis Modules\n\nOBLITERATUS includes 28 analysis modules for mechanistic interpretability.\nSee `skill_view(name=\"obliteratus\", file_path=\"references\u002Fanalysis-modules.md\")` for the full reference.\n\n### Quick analysis commands\n```bash\n# Run specific analysis modules\nobliteratus run analysis-config.yaml --preset quick\n\n# Key modules to run first:\n# - alignment_imprint: Fingerprint DPO\u002FRLHF\u002FCAI\u002FSFT alignment method\n# - concept_geometry: Single direction vs polyhedral cone\n# - logit_lens: Which layer decides to refuse\n# - anti_ouroboros: Self-repair risk score\n# - causal_tracing: Causally necessary components\n```\n\n### Steering Vectors (Reversible Alternative)\nInstead of permanent weight modification, use inference-time steering:\n```python\n# Python API only — for user's own projects\nfrom obliteratus.analysis.steering_vectors import SteeringVectorFactory, SteeringHookManager\n```\n\n## Ablation Strategies\n\nBeyond direction-based abliteration, OBLITERATUS includes structural ablation strategies:\n- **Embedding Ablation** — Target embedding layer components\n- **FFN Ablation** — Feed-forward network block removal\n- **Head Pruning** — Attention head pruning\n- **Layer Removal** — Full layer removal\n\nList all available: `obliteratus strategies`\n\n## Evaluation\n\nOBLITERATUS includes built-in evaluation tools:\n- Refusal rate benchmarking\n- Perplexity comparison (before\u002Fafter)\n- LM Eval Harness integration for academic benchmarks\n- Head-to-head competitor comparison\n- Baseline performance tracking\n\n## Platform Support\n\n- **CUDA** — Full support (NVIDIA GPUs)\n- **Apple Silicon (MLX)** — Supported via MLX backend\n- **CPU** — Supported for tiny models (\u003C 1B params)\n\n## YAML Config Templates\n\nLoad templates for reproducible runs via `skill_view`:\n- `templates\u002Fabliteration-config.yaml` — Standard single-model config\n- `templates\u002Fanalysis-study.yaml` — Pre-abliteration analysis study\n- `templates\u002Fbatch-abliteration.yaml` — Multi-model batch processing\n\n## Telemetry\n\nOBLITERATUS can optionally contribute anonymized run data to a global research dataset.\nEnable with `--contribute` flag. No personal data is collected — only model name, method, metrics.\n\n## Common Pitfalls\n\n1. **Don't use `informed` as default** — it's experimental and slower. Use `advanced` for reliable results.\n2. **Models under ~1B respond poorly to abliteration** — their refusal behaviors are shallow and fragmented, making clean direction extraction difficult. Expect partial results (20-40% remaining refusal). Models 3B+ have cleaner refusal directions and respond much better (often 0% refusal with `advanced`).\n3. **`aggressive` can make things worse** — on small models it can damage coherence and actually increase refusal rate. Only use it if `advanced` leaves > 10% refusals on a 3B+ model.\n4. **Always check perplexity** — if it spikes > 15%, the model is damaged. Reduce aggressiveness.\n5. **MoE models need special handling** — use `nuclear` method for Mixtral, DeepSeek-MoE, etc.\n6. **Quantized models can't be re-quantized** — abliterate the full-precision model, then quantize the output.\n7. **VRAM estimation is approximate** — 4-bit quant helps but peak usage can spike during extraction.\n8. **Reasoning models are sensitive** — use `surgical` for R1 distills to preserve chain-of-thought.\n9. **Check `obliteratus recommend`** — telemetry data may have better parameters than defaults.\n10. **AGPL license** — never `import obliteratus` in MIT\u002FApache projects. CLI invocation only.\n11. **Large models (70B+)** — always use `--large-model` flag for conservative defaults.\n12. **Spectral certification RED is common** — the spectral check often flags \"incomplete\" even when practical refusal rate is 0%. Check actual refusal rate rather than relying on spectral certification alone.\n\n## Complementary Skills\n\n- **vllm** — Serve abliterated models with high throughput\n- **gguf** — Convert abliterated models to GGUF for llama.cpp\n- **huggingface-tokenizers** — Work with model tokenizers\n\n## ? Связи\n\n- [[000 - Map of Maps]] — REPO_DOCS\n- [[000 - Map of Maps]] — Map of Maps\n\n",{"name":5,"author":43,"license":15,"version":44,"metadata":45,"description":7,"dependencies":61},"Hermes Agent","2.0.0",{"hermes":46},{"tags":47,"related_skills":57},[48,49,50,51,52,53,54,55,56],"Abliteration","Uncensoring","Refusal-Removal","LLM","Weight-Projection","SVD","Mechanistic-Interpretability","HuggingFace","Model-Surgery",[58,59,60],"vllm","gguf","huggingface-tokenizers",[5,62,63,64,65,66],"torch","transformers","bitsandbytes","accelerate","safetensors","main","bdd9f958d7bb1a0f19b8ad8da020b0bab0f53eb1","vc-kit\u002Fcontent\u002FCOMBINED\u002FCOMBINED\u002FREPO_DOCS\u002F02-hermes-agent\u002Fskills\u002Fmlops\u002Finference\u002Fobliteratus",1,"https:\u002F\u002Fgithub.com\u002Fibragimov-oasis\u002Fvibe-coder","https:\u002F\u002Fgithub.com\u002Fibragimov-oasis","2026-06-24 16:31:18",{"source":8,"skillName":5,"commands":75,"prompt":85,"zipAvailable":86},[76,79,82],{"tool":77,"command":78},"npx","npx skills add ibragimov-oasis\u002Fvibe-coder --skill obliteratus",{"tool":80,"command":81},"bunx","bunx skills add ibragimov-oasis\u002Fvibe-coder --skill obliteratus",{"tool":83,"command":84},"pnpm","pnpm dlx skills add ibragimov-oasis\u002Fvibe-coder --skill obliteratus","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002Fibragimov-oasis\u002Fvibe-coder\u002Fblob\u002Fmain\u002Fvc-kit\u002Fcontent\u002FCOMBINED\u002FCOMBINED\u002FREPO_DOCS\u002F02-hermes-agent\u002Fskills\u002Fmlops\u002Finference\u002Fobliteratus\u002FSKILL.md",true,[],[89,125,152,172,198,227],{"skillNo":90,"name":91,"nameZh":6,"description":92,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":93,"categories":94,"keywords":105,"publishedAt":38},"01M6Q4Q22KKKVMJJYA411DQ4ER","ckm:ui-styling","Create beautiful, accessible user interfaces with shadcn\u002Fui components (built on Radix UI + Tailwind), Tailwind CSS utility-first styling, and canvas-based visual designs. Use when building user interfaces, implementing design systems, creating responsive layouts, adding accessible components (dialogs, dropdowns, forms, tables), customizing themes and colors, implementing dark mode, generating visual designs and posters, or establishing consistent styling patterns across applications.","https:\u002F\u002Fgithub.com\u002Fibragimov-oasis\u002Fvibe-coder\u002Fblob\u002Fmain\u002Fvc-kit\u002Fcontent\u002FCOMBINED\u002FCOMBINED\u002Fui-design\u002Fui-rules\u002Fui-ux-pro-max\u002Fclaude\u002Fskills\u002Fui-styling\u002FSKILL.md",[95,100],{"categoryNo":96,"categoryName":97,"taxonomyType":98,"taxonomyTypeDesc":99},"01JBSEEDCAT000000000000015","视觉设计","SCENARIO","使用场景",{"categoryNo":101,"categoryName":102,"taxonomyType":103,"taxonomyTypeDesc":104},"01JBSEEDCAT000000000000032","设计师","PROFESSION","适用职业",[106,107,108,109,110,111,112,113,114,115,116,117,118,26,119,120,121,122,123,124],"ui styling","ui","styling","ckm:ui styling","ckm","design","css","canvas","components","component","create","design systems","Tailwind","themes","utility","mode","implementing","artifact\u002Fui-component","source\u002Fui-design",{"skillNo":126,"name":127,"nameZh":6,"description":128,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":129,"categories":130,"keywords":139,"publishedAt":38},"01M6Q4PQ2NX4NDVWTEHA3MQ2R0","ckm:design","Comprehensive design skill: brand identity, design tokens, UI styling, logo generation (55 styles, Gemini AI), corporate identity program (50 deliverables, CIP mockups), HTML presentations (Chart.js), banner design (22 styles, social\u002Fads\u002Fweb\u002Fprint), icon design (15 styles, SVG, Gemini 3.1 Pro), social photos (HTML→screenshot, multi-platform). Actions: design logo, create CIP, generate mockups, build slides, design banner, generate icon, create social photos, social media images, brand identity, design system. Platforms: Facebook, Twitter, LinkedIn, YouTube, Instagram, Pinterest, TikTok, Threads, Google Ads.","https:\u002F\u002Fgithub.com\u002Fibragimov-oasis\u002Fvibe-coder\u002Fblob\u002Fmain\u002Fvc-kit\u002Fcontent\u002FCOMBINED\u002FCOMBINED\u002Fui-design\u002Fui-rules\u002Fui-ux-pro-max\u002Fclaude\u002Fskills\u002Fdesign\u002FSKILL.md",[131,134,135,138],{"categoryNo":132,"categoryName":133,"taxonomyType":98,"taxonomyTypeDesc":99},"01JBSEEDCAT000000000000003","演示文稿",{"categoryNo":96,"categoryName":97,"taxonomyType":98,"taxonomyTypeDesc":99},{"categoryNo":136,"categoryName":137,"taxonomyType":98,"taxonomyTypeDesc":99},"01JBSEEDCAT000000000000023","Skill与智能体开发",{"categoryNo":101,"categoryName":102,"taxonomyType":103,"taxonomyTypeDesc":104},[111,127,110,140,115,106,141,116,142,143,144,145,146,147,148,149,150,151,123,124],"google","presentations","generate","screenshot","actions","Media","logo","ads","youtube","tiktok","artifact","chart",{"skillNo":153,"name":154,"nameZh":6,"description":155,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":156,"categories":157,"keywords":160,"publishedAt":38},"01M6Q4PJE27GEA3M0CECEBCZKS","ckm:design-system","Token architecture, component specifications, and slide generation. Three-layer tokens (primitive→semantic→component), CSS variables, spacing\u002Ftypography scales, component specs, strategic slide creation. Use for design tokens, systematic design, brand-compliant presentations.","https:\u002F\u002Fgithub.com\u002Fibragimov-oasis\u002Fvibe-coder\u002Fblob\u002Fmain\u002Fvc-kit\u002Fcontent\u002FCOMBINED\u002FCOMBINED\u002Fui-design\u002Fui-rules\u002Fui-ux-pro-max\u002Fclaude\u002Fskills\u002Fdesign-system\u002FSKILL.md",[158,159],{"categoryNo":96,"categoryName":97,"taxonomyType":98,"taxonomyTypeDesc":99},{"categoryNo":101,"categoryName":102,"taxonomyType":103,"taxonomyTypeDesc":104},[111,161,162,163,127,110,112,115,164,141,150,165,166,167,168,169,170,171,123,124],"design system","system","ckm:design system","architecture","token","creation","systematic","css variables","Variables","spacing","layer",{"skillNo":173,"name":174,"nameZh":6,"description":175,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":176,"categories":177,"keywords":183,"publishedAt":38},"01M6Q4P90JXFYMH2S634QM6SQJ","ckm:banner-design","Design banners for social media, ads, website heroes, creative assets, and print. Multiple art direction options with AI-generated visuals. Actions: design, create, generate banner. Platforms: Facebook, Twitter\u002FX, LinkedIn, YouTube, Instagram, Google Display, website hero, print. Styles: minimalist, gradient, bold typography, photo-based, illustrated, geometric, retro, glassmorphism, 3D, neon, duotone, editorial, collage. Uses ui-ux-pro-max, frontend-design, ai-artist, ai-multimodal skills.","https:\u002F\u002Fgithub.com\u002Fibragimov-oasis\u002Fvibe-coder\u002Fblob\u002Fmain\u002Fvc-kit\u002Fcontent\u002FCOMBINED\u002FCOMBINED\u002Fui-design\u002Fui-rules\u002Fui-ux-pro-max\u002Fclaude\u002Fskills\u002Fbanner-design\u002FSKILL.md",[178,181,182],{"categoryNo":179,"categoryName":180,"taxonomyType":98,"taxonomyTypeDesc":99},"01JBSEEDCAT000000000000009","前端开发",{"categoryNo":96,"categoryName":97,"taxonomyType":98,"taxonomyTypeDesc":99},{"categoryNo":101,"categoryName":102,"taxonomyType":103,"taxonomyTypeDesc":104},[111,184,185,186,110,187,144,145,188,189,190,191,192,193,194,195,123,124,196,197],"banner design","ckm:banner design","banner","frontend","3D","generated","Art","social","dimensions","neon","direction","display","frontend-design","hero",{"skillNo":199,"name":200,"nameZh":6,"description":201,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":202,"categories":203,"keywords":210,"publishedAt":38},"01M6Q2RZXBJ9TBE413GXCYQNDB","seo","Comprehensive SEO analysis for any website or business type. Performs full site audits, single-page deep analysis, technical SEO checks (crawlability, indexability, Core Web Vitals with INP), schema markup detection\u002Fvalidation\u002Fgeneration, content quality assessment (E-E-A-T framework per Dec 2025 update extending to all competitive queries), image optimization, sitemap analysis, and Generative Engine Optimization (GEO) for AI Overviews, ChatGPT, and Perplexity citations. Analyzes AI crawler accessibility (GPTBot, ClaudeBot, PerplexityBot), llms.txt compliance, brand mention signals, and passage-level citability. Industry detection for SaaS, e-commerce, local business, publishers, agencies. Triggers on: \"SEO\", \"audit\", \"schema\", \"Core Web Vitals\", \"sitemap\", \"E-E-A-T\", \"AI Overviews\", \"GEO\", \"technical SEO\", \"content quality\", \"page speed\", \"structured data\".","https:\u002F\u002Fgithub.com\u002Fibragimov-oasis\u002Fvibe-coder\u002Fblob\u002Fmain\u002Fvc-kit\u002Fcontent\u002FCOMBINED\u002FCOMBINED\u002Fskills\u002Fskills-seo\u002Fseo\u002Fclaude-seo\u002Fskills\u002Fseo\u002FSKILL.md",[204,207],{"categoryNo":205,"categoryName":206,"taxonomyType":98,"taxonomyTypeDesc":99},"01JBSEEDCAT000000000000019","营销推广",{"categoryNo":208,"categoryName":209,"taxonomyType":103,"taxonomyTypeDesc":104},"01JBSEEDCAT000000000000035","市场营销",[200,211,37,212,213,214,33,150,215,216,217,218,219,220,221,222,223,224,225,226],"image","assessment","deep analysis","Citations","local","deep","crawlability","seo analysis","2025","commerce","URL","domain\u002Fseo","source\u002Fskills-seo","vitals","generative","publishers",{"skillNo":228,"name":229,"nameZh":6,"description":230,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":231,"categories":232,"keywords":235,"publishedAt":38},"01M6Q2RVE7VGFCFQKBK468NHVY","seo-technical","Technical SEO audit across 9 categories: crawlability, indexability, security, URL structure, mobile, Core Web Vitals, structured data, JavaScript rendering, and IndexNow protocol. Use when user says \"technical SEO\", \"crawl issues\", \"robots.txt\", \"Core Web Vitals\", \"site speed\", or \"security headers\".","https:\u002F\u002Fgithub.com\u002Fibragimov-oasis\u002Fvibe-coder\u002Fblob\u002Fmain\u002Fvc-kit\u002Fcontent\u002FCOMBINED\u002FCOMBINED\u002Fskills\u002Fskills-seo\u002Fseo\u002Fclaude-seo\u002Fskills\u002Fseo-technical\u002FSKILL.md",[233,234],{"categoryNo":205,"categoryName":206,"taxonomyType":98,"taxonomyTypeDesc":99},{"categoryNo":208,"categoryName":209,"taxonomyType":103,"taxonomyTypeDesc":104},[200,236,237,238,239,240,241,242,243,150,26,217,244,245,221,246,247,222,223,224],"technical","seo technical","issues","audit","data","mobile","crawl","structure","rendering","technical seo audit","headers","categories"]