scrapyd-scrapydweb-local
description (verbatim frontmatter)
Run the local scrapyd job daemon + scrapydweb visual dashboard for the docs crawler (crawlers/claude_docs) — the manual/full-recrawl half of crawling, distinct from the daily automated Cloudflare Cron Trigger on workers/agentcrawls. Use on "start the crawl dashboard", "run scrapydweb", "trigger a full re-crawl visually", or /scrapyd-scrapydweb-local.
summary
Run the local scrapyd job daemon + scrapydweb visual dashboard for the docs crawler (crawlers/claude_docs) — the manual/full-recrawl half of crawling, distinct from the daily automated Cloudflare Cron Trigger on workers/agentcrawls.
source
plugins/cwc-engineering/skills/scrapyd-scrapydweb-local/SKILL.md
provenance
created 2026-07-10 18:13:13 · JSON