scrapeapi.dev — Web Scraping & WHOIS API

# API Reference

Base URL: https://api.scrapeapi.dev/
Unauthenticated: 100 requests/day. With API key: unlimited.

GET https://api.scrapeapi.dev/

Parameters

Param	Description
url	URL to scrape. Must include `http://` or `https://`. required*
whoisQuery	IP address for WHOIS lookup. required*
whoisServer	Custom WHOIS server (optional, validated against allowlist).
whoisPort	Custom WHOIS port (optional, 1-65535).
headers	Custom HTTP headers as JSON object, e.g. `{"Accept":"text/html","Cookie":"sid=abc"}`. Max 20 headers. Only printable ASCII. Some internal headers like `Host` and `Transfer-Encoding` are blocked.
forceProxy	Set to `1` to route request through a random proxy from the pool. URL scraping only.
forceVpn	Set to `1` to route request exclusively through a VPN backend.
type	Response content-type. `text/plain` or `application/json`.
key	API key for authenticated access (or use `X-API-Key` header).

* Provide either url or whoisQuery, not both.

Examples

Scrape a URL

curl 'https://api.scrapeapi.dev/?url=https://httpbin.org/ip'

Scrape HTML (Google)

curl 'https://api.scrapeapi.dev/?url=https://www.google.com/search?q=web+scraping'

Scrape HTML (Amazon product)

curl 'https://api.scrapeapi.dev/?url=https://www.amazon.com/dp/B0D1XD1ZV3'

Scrape HTML (eBay)

curl 'https://api.scrapeapi.dev/?url=https://www.ebay.com/sch/i.html?_nkw=raspberry+pi'

Scrape Google Maps / Places

curl 'https://api.scrapeapi.dev/?url=https://www.google.com/maps/search/restaurants+near+me'

Custom headers (Accept, Cookie, Referer)

curl 'https://api.scrapeapi.dev/?url=https://httpbin.org/headers&headers=%7B%22Accept%22%3A%22application%2Fjson%22%2C%22Referer%22%3A%22https%3A%2F%2Fgoogle.com%22%2C%22Accept-Language%22%3A%22en-US%22%7D'

Custom User-Agent

curl 'https://api.scrapeapi.dev/?url=https://httpbin.org/user-agent&headers=%7B%22User-Agent%22%3A%22MyBot%2F1.0%22%7D'

WHOIS lookup

curl 'https://api.scrapeapi.dev/?whoisQuery=8.8.8.8&type=text/plain'

WHOIS with custom server

curl 'https://api.scrapeapi.dev/?whoisQuery=68.144.0.0&whoisServer=whois.arin.net&type=text/plain'

Authenticated request

curl -H 'X-API-Key: YOUR_KEY' 'https://api.scrapeapi.dev/?url=https://example.com'

Python

import requests, json

r = requests.get('https://api.scrapeapi.dev/', params={
    'url': 'https://httpbin.org/headers',
    'headers': json.dumps({
        'Accept': 'application/json',
        'Accept-Language': 'de-DE',
    })
})
print(r.text)

Node.js

const params = new URLSearchParams({
  url: 'https://httpbin.org/headers',
  headers: JSON.stringify({ Accept: 'application/json', Referer: 'https://google.com' })
});
const r = await fetch('https://api.scrapeapi.dev/?' + params);
console.log(await r.text());

Web Scraping & WHOIS API

# API Reference

Parameters

Examples

# Try it

# Pricing

Pay as you go