CRAWL · WEB DATA API

The web, ready for your next workflow.

Turn a single page or an entire website into clean, structured data. Built for the pipelines and agents your team already uses.

Request Access See a demo

factget · Console

Playground

Try Crawl on a page and see what the API returns.

Web data API

https://example.com

Request

Formats

Main content only

Fixed example input for this walkthrough.

As code

curl -X POST https://factget.dev/crawl/v1/scrape \
  -H "Authorization: Bearer $KEY" \
  -H "Content-Type: application/json" \
  -d '{
  "url": "https://example.com",
  "formats": [
    "markdown",
    "links"
  ],
  "onlyMainContent": true
}'

Response

Sample

Completed

STATUS 200 · EXAMPLE.COM

Example Domain

This domain is for use in illustrative examples in documents.

https://www.iana.org/domains/example

Sample inputs and outputs. Your own data stays in your account.Product docs

Interactive console preview with sample data. No live jobs or monitors are created.

MADE FOR THE WAY YOU WORK

From scattered web pages to usable data.

Scrape, map, batch, and crawl with one API. Get markdown, HTML, links, or extracted fields without maintaining a browser stack yourself.

Explore the API reference

Read the rendered web

Chrome rendering handles pages that need JavaScript. Retrieve main content or target specific elements.

Scale a job, keep control

Run asynchronous jobs, poll their status, cancel work, and receive signed webhooks.

Respect the source

robots.txt is always on. Private networks are blocked, and access failures return explicit reasons.

A few things to know.

Can I use a Firecrawl integration?

Crawl uses Firecrawl v1-compatible request shapes. Start by changing the base URL and API key, then check supported formats and options in the reference.

What happens when a site blocks access?

Crawl returns a typed error with the reason. It respects robots.txt and does not solve CAPTCHAs.

Are screenshots supported?

Crawl returns markdown, HTML, raw HTML, links, and CSS/XPath/regex extraction. Page screenshots are not a supported output.

GET THE FACTS. KEEP THEM CURRENT.

Put Crawl to work for your team.

Bring us the research you do by hand. We’ll show you what FactGet can take off your plate.

Request Access See a demo