[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M6HWRNAF3WJ2PREH59P7PSX5":3,"skill-same:01M6HWRNAF3WJ2PREH59P7PSX5":71},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":23,"publishedAt":38,"linkOnly":39,"markdownContent":40,"markdownBody":41,"frontMatter":42,"refName":43,"commitSha":44,"skillDirectory":45,"forksCount":46,"repositoryHtmlUrl":47,"repositoryHomepageUrl":6,"ownerHtmlUrl":48,"ownerBlogUrl":49,"ownerDescription":6,"updatedAt":50,"install":51,"resources":64},"01M6HWRNAF3WJ2PREH59P7PSX5","pdftotext-fallback",null,"Recover PDF text extraction when read_file returns binary data by using pdftotext via shell","HKUDS\u002FAgentPilot","HKUDS","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F118165258?v=4","01M6HW8VRNZP64G0P4MVJW2KKQ","✨Data Intelligence Lab@HKU✨","01M6HW8VWZVHBRHYH3T330PFWV",8029,"MIT","https:\u002F\u002Fgithub.com\u002FHKUDS\u002FAgentPilot\u002Fblob\u002Fmain\u002Fopenspace\u002Fbenchmarks\u002Fgdpval\u002Fskills\u002Fpdftotext-fallback\u002FSKILL.md",[18],{"categoryNo":19,"categoryName":20,"taxonomyType":21,"taxonomyTypeDesc":22},"01JBSEEDCAT000000000000002","文档处理","SCENARIO","使用场景",[24,25,26,27,28,29,30,31,32,33,34,35,36,37],"fallback","pdftotext","pdftotext fallback","PDF","extraction","file","data","shell","text","returns","read","binary","via","pdf text extraction","2026-11-10 10:12:30",false,"---\nname: pdftotext-fallback\ndescription: Recover PDF text extraction when read_file returns binary data by using pdftotext via shell\n---\n\n# pdftotext Fallback for PDF Text Extraction\n\n## When to Use\n\nApply this pattern when:\n- `read_file` on a PDF returns binary\u002Fimage data instead of readable text\n- Python-based PDF extraction (PyMuPDF, pdfplumber, etc.) in `execute_code_sandbox` fails or returns garbled content\n- You need reliable text extraction from PDF files as a recovery strategy\n\n## Why This Works\n\nThe `pdftotext` utility (from poppler-utils) is a mature, command-line tool that handles many PDF edge cases that confuse Python libraries or the `read_file` tool. It's pre-installed on most Linux systems and provides consistent, reliable text extraction.\n\n## Steps\n\n### Step 1: Detect the Failure\n\nRecognize extraction failure when:\n- `read_file` returns binary content, image data, or garbled text\n- Error messages indicate encoding issues or unsupported formats\n- Python PDF libraries in sandbox fail with import errors or extraction failures\n\n### Step 2: Use pdftotext via run_shell\n\n**Extract to stdout** (recommended for quick extraction):\n\n```bash\npdftotext \u002Fpath\u002Fto\u002Ffile.pdf -\n```\n\nThe `-` argument outputs directly to stdout for easy capture in your tool response.\n\n**Example:**\n```bash\nrun_shell(\"pdftotext document.pdf -\")\n```\n\n### Step 3: Handle Complex PDFs\n\n**Preserve layout** (maintains original formatting):\n```bash\npdftotext -layout \u002Fpath\u002Fto\u002Ffile.pdf -\n```\n\n**Extract to a file** (for large PDFs):\n```bash\npdftotext \u002Fpath\u002Fto\u002Ffile.pdf \u002Fpath\u002Fto\u002Foutput.txt\n```\nThen read the output file with `read_file`.\n\n**Handle encoded text:**\n```bash\npdftotext -enc UTF-8 \u002Fpath\u002Fto\u002Ffile.pdf -\n```\n\n### Step 4: Verify and Continue\n\n- Check the extracted text for completeness\n- If text is still garbled, the PDF may be image-based (scanned) - consider OCR tools\n- Proceed with your task using the extracted text\n\n## Code Examples\n\n**Basic extraction:**\n```bash\n# Simple text extraction\ntext = run_shell(\"pdftotext document.pdf -\")\n```\n\n**With error handling:**\n```bash\n# Try extraction, check for success\nresult = run_shell(\"pdftotext document.pdf - && echo 'SUCCESS' || echo 'FAILED'\")\n```\n\n**Multi-page PDF with layout:**\n```bash\n# Preserve tables and formatting\ntext = run_shell(\"pdftotext -layout document.pdf -\")\n```\n\n## Troubleshooting\n\n| Issue | Solution |\n|-------|----------|\n| `pdftotext: command not found` | Install poppler-utils: `apt-get install poppler-utils` |\n| Garbled\u002Fspecial characters | Try `-enc UTF-8` or `-enc ASCII7` |\n| Missing formatting | Use `-layout` flag |\n| Scanned PDF (no text) | Requires OCR (e.g., tesseract), not text extraction |\n| Large PDF timeout | Extract to file instead of stdout |\n\n## Limitations\n\n- Does not work on image-only (scanned) PDFs without embedded text\n- May lose complex formatting, tables, or embedded objects\n- Requires poppler-utils to be installed (common on Linux, may need installation on other systems)\n\n## Related Tools\n\n- `pdfinfo`: Get PDF metadata (pages, size, etc.)\n- `pdftoppm`: Convert PDF pages to images\n- `tesseract`: OCR for scanned PDFs","# pdftotext Fallback for PDF Text Extraction\n\n## When to Use\n\nApply this pattern when:\n- `read_file` on a PDF returns binary\u002Fimage data instead of readable text\n- Python-based PDF extraction (PyMuPDF, pdfplumber, etc.) in `execute_code_sandbox` fails or returns garbled content\n- You need reliable text extraction from PDF files as a recovery strategy\n\n## Why This Works\n\nThe `pdftotext` utility (from poppler-utils) is a mature, command-line tool that handles many PDF edge cases that confuse Python libraries or the `read_file` tool. It's pre-installed on most Linux systems and provides consistent, reliable text extraction.\n\n## Steps\n\n### Step 1: Detect the Failure\n\nRecognize extraction failure when:\n- `read_file` returns binary content, image data, or garbled text\n- Error messages indicate encoding issues or unsupported formats\n- Python PDF libraries in sandbox fail with import errors or extraction failures\n\n### Step 2: Use pdftotext via run_shell\n\n**Extract to stdout** (recommended for quick extraction):\n\n```bash\npdftotext \u002Fpath\u002Fto\u002Ffile.pdf -\n```\n\nThe `-` argument outputs directly to stdout for easy capture in your tool response.\n\n**Example:**\n```bash\nrun_shell(\"pdftotext document.pdf -\")\n```\n\n### Step 3: Handle Complex PDFs\n\n**Preserve layout** (maintains original formatting):\n```bash\npdftotext -layout \u002Fpath\u002Fto\u002Ffile.pdf -\n```\n\n**Extract to a file** (for large PDFs):\n```bash\npdftotext \u002Fpath\u002Fto\u002Ffile.pdf \u002Fpath\u002Fto\u002Foutput.txt\n```\nThen read the output file with `read_file`.\n\n**Handle encoded text:**\n```bash\npdftotext -enc UTF-8 \u002Fpath\u002Fto\u002Ffile.pdf -\n```\n\n### Step 4: Verify and Continue\n\n- Check the extracted text for completeness\n- If text is still garbled, the PDF may be image-based (scanned) - consider OCR tools\n- Proceed with your task using the extracted text\n\n## Code Examples\n\n**Basic extraction:**\n```bash\n# Simple text extraction\ntext = run_shell(\"pdftotext document.pdf -\")\n```\n\n**With error handling:**\n```bash\n# Try extraction, check for success\nresult = run_shell(\"pdftotext document.pdf - && echo 'SUCCESS' || echo 'FAILED'\")\n```\n\n**Multi-page PDF with layout:**\n```bash\n# Preserve tables and formatting\ntext = run_shell(\"pdftotext -layout document.pdf -\")\n```\n\n## Troubleshooting\n\n| Issue | Solution |\n|-------|----------|\n| `pdftotext: command not found` | Install poppler-utils: `apt-get install poppler-utils` |\n| Garbled\u002Fspecial characters | Try `-enc UTF-8` or `-enc ASCII7` |\n| Missing formatting | Use `-layout` flag |\n| Scanned PDF (no text) | Requires OCR (e.g., tesseract), not text extraction |\n| Large PDF timeout | Extract to file instead of stdout |\n\n## Limitations\n\n- Does not work on image-only (scanned) PDFs without embedded text\n- May lose complex formatting, tables, or embedded objects\n- Requires poppler-utils to be installed (common on Linux, may need installation on other systems)\n\n## Related Tools\n\n- `pdfinfo`: Get PDF metadata (pages, size, etc.)\n- `pdftoppm`: Convert PDF pages to images\n- `tesseract`: OCR for scanned PDFs",{"name":5,"description":7},"main","6b84b0689ca0d9e7b1e4061188ff6b60758e0f8a","openspace\u002Fbenchmarks\u002Fgdpval\u002Fskills\u002Fpdftotext-fallback",944,"https:\u002F\u002Fgithub.com\u002FHKUDS\u002FAgentPilot","https:\u002F\u002Fgithub.com\u002FHKUDS","https:\u002F\u002Fsites.google.com\u002Fview\u002Fchaoh","2026-11-12 22:26:39",{"source":8,"skillName":5,"commands":52,"prompt":62,"zipAvailable":63},[53,56,59],{"tool":54,"command":55},"npx","npx skills add HKUDS\u002FAgentPilot --skill pdftotext-fallback",{"tool":57,"command":58},"bunx","bunx skills add HKUDS\u002FAgentPilot --skill pdftotext-fallback",{"tool":60,"command":61},"pnpm","pnpm dlx skills add HKUDS\u002FAgentPilot --skill pdftotext-fallback","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002FHKUDS\u002FAgentPilot\u002Fblob\u002Fmain\u002Fopenspace\u002Fbenchmarks\u002Fgdpval\u002Fskills\u002Fpdftotext-fallback\u002FSKILL.md",true,[65],{"path":66,"resourceType":67,"resourceTypeDesc":68,"sizeBytes":69,"sourceHtmlUrl":70},".skill_id","OTHER","其他",32,"https:\u002F\u002Fgithub.com\u002FHKUDS\u002FAgentPilot\u002Fblob\u002Fmain\u002Fopenspace\u002Fbenchmarks\u002Fgdpval\u002Fskills\u002Fpdftotext-fallback\u002F.skill_id",[72,92,111,134,158,180],{"skillNo":73,"name":74,"nameZh":6,"description":75,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":76,"categories":77,"keywords":78,"publishedAt":38},"01M6HYB297NDABRERJRVG0K8R0","agentpilot","Set up AgentPilot and use its single entry to prepare missing inputs and run configured RSI experiments. Use when the user requests AgentPilot installation or work with AgentPilot.","https:\u002F\u002Fgithub.com\u002FHKUDS\u002FAgentPilot\u002Fblob\u002Fmain\u002Fplugins\u002Fagentpilot\u002Fskills\u002Fagentpilot\u002FSKILL.md",[],[74,79,80,81,82,83,84,85,86,87,88,89,90,91],"prepare","requests","with","missing","installation","rsi","up","use","user","work","SET","run","experiments",{"skillNo":93,"name":94,"nameZh":6,"description":95,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":96,"categories":97,"keywords":98,"publishedAt":38},"01M6HYAYWXTTE1J7DJM0MFNQ4H","remember","Review auto-memory entries and propose promotions to OPENSPACE.md, OPENSPACE.local.md, or retained auto-memory topics; detect duplicates, stale facts, conflicts, and ambiguous entries before making changes.","https:\u002F\u002Fgithub.com\u002FHKUDS\u002FAgentPilot\u002Fblob\u002Fmain\u002Fopenspace\u002Fopenspace\u002Fskills\u002Fremember\u002FSKILL.md",[],[94,99,100,101,102,103,104,105,106,107,108,109,110],"memory","review","auto","openspace","changes","facts","detect","entries","local","conflicts","stale","duplicates",{"skillNo":112,"name":113,"nameZh":6,"description":114,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":115,"categories":116,"keywords":120,"publishedAt":38},"01M6HYAVMPM4SBDV60R2B5HPV8","skill-discovery","Search reusable OpenSpace skills locally, and browse cloud packages step by step when a cloud skill may help. Reusing proven skills saves tokens, improves reliability, and extends your capabilities beyond built-in tools.","https:\u002F\u002Fgithub.com\u002FHKUDS\u002FAgentPilot\u002Fblob\u002Fmain\u002Fopenspace\u002Fopenspace\u002Fhost_skills\u002Fskill-discovery\u002FSKILL.md",[117],{"categoryNo":118,"categoryName":119,"taxonomyType":21,"taxonomyTypeDesc":22},"01JBSEEDCAT000000000000023","Skill与智能体开发",[121,122,123,102,124,125,126,127,128,129,130,131,132,133],"skill discovery","discovery","reusable","step by step","tokens","packages","help","cloud","reliability","capabilities","browse","search","Tools",{"skillNo":135,"name":136,"nameZh":6,"description":137,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":138,"categories":139,"keywords":141,"publishedAt":38},"01M6HYAR811B3RB0M50RBEDGN6","delegate-task","Delegate tasks to OpenSpace — a full-stack autonomous worker for coding, DevOps, web research, and desktop automation, backed by an extensive MCP tool and skill library. Skills auto-improve through use, reducing token consumption over time. A cloud community lets agents share and collectively evolve reusable skills.","https:\u002F\u002Fgithub.com\u002FHKUDS\u002FAgentPilot\u002Fblob\u002Fmain\u002Fopenspace\u002Fopenspace\u002Fhost_skills\u002Fdelegate-task\u002FSKILL.md",[140],{"categoryNo":118,"categoryName":119,"taxonomyType":21,"taxonomyTypeDesc":22},[142,143,144,102,145,146,147,148,149,123,101,86,150,151,152,153,154,155,156,157],"delegate","task","delegate task","time","improve","desktop automation","worker","community","autonomous","tool","stack","for","share","tasks","automation","MCP",{"skillNo":159,"name":160,"nameZh":6,"description":161,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":162,"categories":163,"keywords":164,"publishedAt":38},"01M6HYAM9FSGV6E52AYENDQXYH","write-special-chars-ts-check","Workaround for write_file failures caused by special characters (apostrophes, backticks, template literals) using a Python heredoc script, plus a reliable TypeScript type-checking step that filters output to only the newly-written files to avoid being misled by pre-existing errors.","https:\u002F\u002Fgithub.com\u002FHKUDS\u002FAgentPilot\u002Fblob\u002Fmain\u002Fopenspace\u002Flegacy\u002Fv1\u002Fshowcase\u002Fskills\u002Fwrite-special-chars-ts-check\u002FSKILL.md",[],[165,166,167,168,169,170,171,172,29,173,174,175,176,177,153,178,179],"write special chars ts check","write","check","type","files","filters","only","template","python","typescript","output","Existing","type-checking","errors","script",{"skillNo":181,"name":182,"nameZh":6,"description":183,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":184,"categories":185,"keywords":186,"publishedAt":38},"01M6HYAH05HGV7SVWSVR8PJRQD","write-special-chars-readback","Workaround for write_file failures caused by special characters (apostrophes, backticks, template literals) using a Python heredoc script, with mandatory post-write verification via read_file and cleanup of \u002Ftmp helper scripts.","https:\u002F\u002Fgithub.com\u002FHKUDS\u002FAgentPilot\u002Fblob\u002Fmain\u002Fopenspace\u002Flegacy\u002Fv1\u002Fshowcase\u002Fskills\u002Fwrite-special-chars-readback\u002FSKILL.md",[],[187,188,166,81,153,179,189,190,36,191,34,172,29,192,193,173],"write special chars readback","readback","helper","post","scripts","verification","cleanup"]