SERVICE // CLOUD_ASP_API

Scrapfly Platform Deep Dive

Cloud-scale web scraping, anti-bot protection (ASP) bypass, residential proxy networks, and token-optimized LLM Markdown extraction.

1. Dual-Engine Stealth Architecture

Curlium (Stealth HTTP Engine): Custom in-house C++ curl fork replicating authentic browser TLS handshakes (JA3/JA4), HTTP/2 framing, and header ordering at 10–50x the speed of headless browsers.
Scrapium (Patched Chromium Engine): Cloud headless Chromium instances patched at the C++ level to eliminate canvas, WebGL, audio, and font fingerprinting artifacts.

2. Anti-Scraping Protection (ASP)

Automated challenge solving and proxy elevation with asp=true:

Cloudflare: Turnstile, "Under Attack Mode", Bot Management.
DataDome & Akamai: Dynamic JS challenges and PoW puzzles.
PerimeterX & AWS WAF: Behavioral fingerprint bypass.
Proxy Pool: 130M+ rotating residential and mobile IPs.

3. LLM Markdown Preprocessing

Reduces token overhead by 70–90% directly on Scrapfly servers:

# Scrape protected site directly to clean Markdown
curl -s "https://api.scrapfly.io/scrape?\
key=YOUR_KEY\
&url=https://protected-domain.com\
&asp=true\
&render_js=true\
&format=markdown"

4. Credit Consumption & Pricing Structure

Operation	Credit Cost	Description
Standard Datacenter Scrape	`1 credit`	Base HTTP request without JS rendering
JavaScript Rendering (`render_js=true`)	`+5 credits`	Headless browser execution (`Scrapium`)
Anti-Scraping Protection (`asp=true`)	`Dynamic`	Automated CAPTCHA / WAF bypass
Residential Proxy Pool	`+25 credits`	Routing through 190+ country residential network
AI Model Extraction	`+5 to +10 credits`	Auto schema or custom LLM prompt extraction

Subscription Tiers: Free (1,000 credits) • Discovery ($30/mo, 200k) • Pro ($100/mo, 1M) • Startup ($250/mo, 2.5M).