Web Scraping API

Public page content, ready for your application.

Send a page URL and prepare the rendering, location and output settings your workflow needs. Web Scraping API brings the collection step into one request, while you keep control of how the content is used.

View pricing

Product preview. Account setup is open; public product access is pending.

Web Scraping API
01Public page URL
02Rendering & collection
03HTML for your code
{
  "url": "https://example.com",
  "render": true,
  "output": "html"
}
Conceptual workflow · not a live request
Input
A public page URL
Core output
Page HTML
Pricing unit
1,000 requests

Product capabilities

Spend your code on the data you need.

Use these details to plan your setup. Supported options and limits are confirmed before activation.

01

Public page retrieval

Define the URL you want to collect and preserve it alongside the returned content. Limit collection to pages you are authorized to access.

02

JavaScript rendering

Plan for pages whose content is rendered in the browser. Rendering needs affect execution time and provider cost, so confirm the settings for your workload.

03

Collection infrastructure

The product is designed to bring proxy selection and request handling behind the API. Supported targets, retry behavior and limits are confirmed before activation.

04

Location preferences

Request a preferred country for page collection. Available geography and targeting precision depend on the activated product.

05

HTML for your own parser

Keep control of extraction in your application. Page content can feed a parser, an archive or an AI workflow with the source attached.

06

Request generator

The Universal API dashboard includes configuration and code previews. Live execution is currently an internal pilot; public product access is not enabled.

Integration and documentation

Start with one request.

Prepare the query or URL, preferred country and output before connecting your application. Save the setup in your dashboard and keep the original source with the data you collect.

JSON · setup illustration
{
  "url": "https://example.com/",
  "country": "US",
  "render": true,
  "format": "HTML"
}

Setup illustration, not the public API contract. Endpoint and authentication details follow product activation.

Pricing

Monthly request plans

Choose a monthly request allowance for collecting public page content.

View Web Scraping API pricing
Free$05,000 requests
Starter$30Up to 30,000 requests
Basic$100Up to 100,000 requests
Flexible$500Up to 500,000 requests

Plan preview. Missing rates will be supplied later; checkout is not open yet.

Response planning

Define the output before you automate.

Page HTML is the core output. Confirm the response format and rendering options for your workload before connecting an application.

HTML
Page markup for your own parser or archive.
Rendering
A setting for pages that rely on browser-side JavaScript.
Source context
Keep the requested URL with your extracted fields.

Use cases

Build around the job you need done.

AI agents and RAG

Collect current page content and retain source URLs for citations.

Research automation

Turn a list of public company or topic pages into a repeatable collection job.

Competitive intelligence

Track public launches, reviews and product changes over time.

E-commerce research

Fetch public product pages for your own price and availability parser.

Public-information monitoring

Review public notices and filings with a consistent retrieval process.

Content archiving

Keep page content with its retrieval time and original address.

Questions, answered

Before you connect.

Is this the same as Universal API?

Yes. Web Scraping API is the public product name used here; the dashboard currently calls the product Universal API.

Does the API parse fields for me?

The core product returns page HTML so your application controls extraction. Additional formats must be confirmed as part of the public response contract.

Can it render JavaScript?

Browser rendering is included in the proposed product and available in the internal request-generator pilot. Public availability and limits are confirmed before activation.

How does this differ from raw proxies?

With raw proxies, your application makes the requests and handles page loading. A scraping API exposes its own request contract for retrieving content through its collection infrastructure.

What do requests cost?

The current pricing preview includes $30, $100 and $500 monthly plans with corresponding allowances. The final billing and overage rules are confirmed before purchase.

Your next step

Put your setup in place.

Compare the plans or save your preferred settings in your account.

Contact us

Tell us what you want to collect.

See our Privacy Notice for how we handle your message.

Your message is sent to hello@crawlhub.ai. Please do not include passwords or API keys.