AGENT SKILL

blockchain-spider-toolkit

Points to the BlockchainSpider open-source Python/Scrapy toolkit for collecting on-chain data-transfer subgraphs around an address or tx, EVM and Solana block/transaction ingestion, receipts/logs, and optional label plugins. Use when the user wants to build datasets, offline traces, or research pipelines alongside blockchain-analytics-operations and solana-tracing-specialist-not as a substitute for RPC provider ToS, rate limits, or legal review of sensitive crawls.

License 许可
Apache-2.0
所属仓库
zkos-labs/bastion
最近更新
2026-11-13
Stars
★ 3
Forks
1

01 前言 Front Matter

name
blockchain-spider-toolkit
description
Points to the BlockchainSpider open-source Python/Scrapy toolkit for collecting on-chain data-transfer subgraphs around an address or tx, EVM and Solana block/transaction ingestion, receipts/logs, and optional label plugins. Use when the user wants to build datasets, offline traces, or research pipelines alongside blockchain-analytics-operations and solana-tracing-specialist-not as a substitute for RPC provider ToS, rate limits, or legal review of sensitive crawls.

03 SKILL.md 正文

BlockchainSpider - on-chain data collection toolkit

Reference skill. This repository does not vendor BlockchainSpider; read the upstream README and docs for install, spiders, and options.

What it is for

Typical capabilities described in the project (confirm against current docs):

Area Examples
Transfer subgraph Money-flow graph centered on a source address or transaction (e.g. txs.blockscan-style crawls).
EVM transactions Block ranges, latest listener, receipts, logs, token transfers; multiple EVM-compatible providers.
Solana Slot ranges or live streams via JSON-RPC providers.
Labels Optional plugins (e.g. label-oriented crawls)-scope and ethics depend on source and law.

Academic background appears in project references (e.g. TRacer / transaction semantics papers-see repo Reference section).

Prerequisites

  • Python environment and pip install -r requirements.txt from the cloned repo.
  • RPC / indexer API endpoints you are authorized to use (respect ToS, rate limits, and billing).
  • API keys for third-party explorers (Etherscan-class APIs, etc.) must be supplied by you-never commit keys or paste live keys into chats.

Example command shapes (placeholders only)

Upstream examples use scrapy crawl <spider> -a .... Illustrative patterns (replace placeholders):

# EVM transfer / subgraph style (example spider name from upstream docs)
scrapy crawl txs.blockscan -a source=<ADDRESS> -a apikeys=<YOUR_ETHERSCAN_API_KEY> -a endpoint=<ETHERSCAN_COMPATIBLE_API_URL>

# EVM blocks / transactions over a range
scrapy crawl trans.block.evm -a start_blk=<N> -a end_blk=<M> -a providers=<YOUR_ETH_HTTP_RPC_URL>

# Solana slot range
scrapy crawl trans.block.solana -a start_slot=<S1> -a end_slot=<S2> -a providers=<YOUR_SOLANA_JSON_RPC_URL>

Exact spider names and arguments change with releases-always copy from the current README.

How to combine with blockint

Task Skill
High-level analytics / AML context blockchain-analytics-operations
Solana forensic tracing methodology solana-tracing-specialist
Multi-chain clustering cross-chain-clustering-techniques-agent
Web surface crawling (HTTP), not chain RPC katana-web-crawling

Guardrails

  • Lawful use only - comply with sanctions, privacy, and computer misuse rules in your jurisdiction; do not use spiders to harass or dox.
  • Darknet / sensitive label sources - some demo commands in upstream docs point to Tor or sensitive data sources; obtain legal and security approval before running.
  • Do not store or share API keys, customer identifiers, or non-public investigation exports in public repos.
  • Outputs are raw or heuristic-validate critical facts against primary chain data.

Related research codebase

  • mots-transaction-semantics - MoTS (WWW 2023 “Know Your Transactions”); upstream notes MoTS merged into BlockchainSpider-use MoTS skill for legacy spider names (blocks.eth, blocks.semantic.eth, labels.action) and the bundled PDF.

Goal: a stable pointer and safe usage framing for BlockchainSpider inside blockint workflows.

04 同仓库更多 Skills

zkos-labs
zkos-labs/bastion

bastion

Programmable Trust Runtime for Autonomous Systems. Orchestrates identity, policy, privacy, durable execution, and multi-chain settlement.

★ 3
zkos-labs
zkos-labs/bastion

web2-api-firewall-administrator

Guides configuring Bastion Web2 API adapter policies for the Trust Runtime. Covers endpoint allowlists, provider budgets, rate limits, content inspection (PII/secrets detection), header filters, and OpenAPI spec-based auto-configuration. Use when configuring API call security for AI agents, setting provider spending caps, inspecting outbound API traffic, or setting up the Web2 adapter.

★ 3
zkos-labs
zkos-labs/bastion

transaction-screening-workflow-concepts

Educational map of transaction-centric compliance screening-transfer as the atomic unit, deposit vs withdrawal direction, single and CSV import, transaction list and detail views, per-transfer screening, rescreen, and STR-style exports. Use when the user asks how monitoring UIs treat tx hashes, directions, or regulatory reporting hooks-not for legal filing advice or evading reporting.

★ 3
zkos-labs
zkos-labs/bastion

solana-tracing-specialist

Guides Solana-specific on-chain forensics-ATA resolution, SPL instruction parsing, transaction history via RPC and indexers (e.g. Helius-style APIs), fund-flow graphs, Solana clustering heuristics, and program authority review. Use when the user investigates Solana wallets, SPL tokens, DEX/Jito flows, rug or phishing patterns on Solana, or needs evidence-structured tracing reports with public data only.

★ 3
zkos-labs
zkos-labs/bastion

solana-onchain-intelligence-resources

Companion to blockint-skills Solana work-official doc indexes and stacks for RPC/indexers, sanctions and address intel MCP, web research, agent payments, graph UIs, Solana Foundation dev skills, Solana Policy Institute (policy/regulatory education), optional open-source Scrapy collection (BlockchainSpider), Impersonator Solana (dApp dev/testing), coral-xyz sealevel-attacks (security pattern examples), Neodyme Solana Security Workshop (workshop.neodyme.io), and Osec Solana auditor introduction blog (osec.io). Use when the user needs pointers to Helius, Range AI, Tavily, PayAI x402, React Flow, Solana.com skills, or SPI alongside on-chain forensics-not as a substitute for reading current provider docs, legal counsel, or API keys.

★ 3
zkos-labs
zkos-labs/bastion

solana-defi-vulnerability-analyst-agent

Guides discovery and documentation of Solana DeFi protocol risks from public code and chain state-Anchor/native programs, PDAs, CPIs, oracles, pools, SPL mechanics, and historical tx reconstruction. Use when the user asks for Solana program security review, DeFi vulnerability triage, PDA or CPI safety, oracle or liquidity-pool risk, launchpad/bonding-curve issues, or evidence-backed severity findings without exploits or private keys.

★ 3