Skip to main content
Generaldvcrn

fetch

Public web retrieval and clean extraction engine. Use whenever the user wants to fetch, download, inspect, clean, or save content from a public URL. Supports safe fetching of public web pages, extracts title/text/links, stores results locally, and keeps a job history. No credentials, no login flows, no cloud sync.

Stars
15
Source
dvcrn/openclaw-skills-marketplace
Updated
2026-05-29
Slug
dvcrn--openclaw-skills-marketplace--fetch
View on GitHubRaw SKILL.md

// install — copy + paste into any project

mkdir -p .claude/skills && curl -fsSL https://raw.githubusercontent.com/dvcrn/openclaw-skills-marketplace/HEAD/plugins/agistack--fetch/skills/fetch/SKILL.md -o .claude/skills/fetch.md

Drops the SKILL.md into .claude/skills/fetch.md. Works with Claude Code, Cursor, and any agent that loads SKILL.md files from .claude/skills/.

Fetch

Turn public URLs into usable local content.

Core Philosophy

  1. Fetch only public web content.
  2. Prefer clean extracted text over noisy raw HTML.
  3. Save both the raw response and structured extraction locally.
  4. Keep a simple local job history so previous fetches are easy to inspect.

Runtime Requirements

  • Python 3 must be available as python3
  • No external packages required

Safety Boundaries

  • Public URLs only
  • No login flows
  • No cookies or browser automation
  • No API keys or credentials
  • No external uploads or cloud sync
  • All fetched data is stored locally only

Local Storage

All data is stored under:

  • ~/.openclaw/workspace/memory/fetch/jobs.json
  • ~/.openclaw/workspace/memory/fetch/pages/

Key Workflows

  • Fetch URL: fetch_url.py --url "https://example.com"
  • Save cleaned output: save_output.py --url "https://example.com" --title "Example"
  • List history: list_jobs.py
  • Show job details: show_job.py --id JOB-XXXX

Scripts

Script Purpose
init_storage.py Initialize local storage
fetch_url.py Fetch a public URL and extract content
save_output.py Save cleaned output with a custom title
list_jobs.py List previous fetch jobs
show_job.py Show one saved fetch job