Web3 Autonomous Scraper — Pay Per Request

§ I — About

What This Is

A scraping API designed exclusively for autonomous AI agents. No sign-up. No API key. No monthly bill. Your agent pays 0.005 USDC per page directly on Solana mainnet using the x402 protocol — and gets clean HTML back instantly.

The x402 protocol turns the long-ignored HTTP 402 Payment Required status into a real machine-to-machine payment standard. Your agent receives a challenge, pays on-chain, and retries — the whole cycle happens in milliseconds, without human intervention.

Who It's For

Built for the agentic web. If your AI agent needs to read a live webpage — product prices, news articles, research content, competitor data — this API lets it pay and fetch without any pre-configured credentials or account management.

Autonomous. Stateless. Trustless. One payment per scrape, verified on-chain, consumed once. No replay, no overpayment, no subscriptions eating your runway.

§ II — Protocol

How It Works

1

First Request

Your agent sends POST /scrape with the target URL. The API responds with HTTP 402 and a base64-encoded x402 v2 challenge in the PAYMENT-REQUIRED header.

2

Pay On-Chain

Your agent pays exactly 0.005 USDC to the wallet on Solana mainnet. The transaction must be confirmed and less than 5 minutes old. Each signature is single-use.

3

Get the Data

Retry the request with the X-PAYMENT header containing the base64-encoded payment proof. Payment is verified on-chain. You receive clean HTML — no session, no cookie, no key.

§ III — Integration

The Endpoint

POST https://ai-scraper-api.duckdns.org/scrape

Request Body

{
  "targetUrl": "https://example.com/page-to-scrape"
}

Payment Header (on retry)

X-PAYMENT: <base64-encoded x402 v2 payment proof>

// Proof structure (before base64 encoding):
{
  "x402Version": 2,
  "scheme": "exact",
  "network": "solana:5eykt4UsFv8P8NJdTREpY1vzqKqZKvdp",
  "payload": {
    "signature": "<solana_transaction_signature>"
  }
}

200 Response

{
  "success": true,
  "data": "<!DOCTYPE html><html>...</html>"
}

§ IV — Market

How We Compare

Provider	Price / Request	Network	No API Key
This API You Are Here	$0.005 USDC Cheapest	Solana Native	✓
Scrape Agent	$0.010 USDC	Base (EVM only)	✓
x402engine	$0.005 USDC	Base, Solana, MegaETH	✓

§ V — Infrastructure

What Runs Under the Hood

∴ Backed by proven infrastructure ∴

This API sits in front of industry-leading Web2 scraping infrastructure — the same engines that power enterprise-grade data extraction at scale. We handle CAPTCHA bypass, JavaScript rendering, and rotating proxies so your agent never has to.

CAPTCHA Bypass JS Rendering Proxy Rotation Global Coverage

§ VI — Live Activity

Success Rate

∴ Since last boot ∴

—

0 of 0 requests succeeded

Recent Interactions

Loading...

↻ Refreshes every 60 seconds