List your AI tool on AI Orion for free. Submit a tool

Context.dev

Context.dev is the web scraping API for AI agents: scrape any URL into LLM-ready Markdown, search the live web, crawl entire sites, and extract structured data with one REST API.

Pricing
Freemium
Free Tier, Developer, Pro, Enterprise

About Context.dev

Context.dev provides a web data API used to power AI agents and products by turning pages into Markdown, structured JSON, screenshots, and other formats. It handles the scraping infrastructure so developers can build on top of live web content. It offers batch processing, monitors, and structured outputs across formats, with JS rendering and managed proxies enabled by design to maximize data quality.

Context.dev exposes endpoints for scraping, mapping URLs, crawling, searching, and answering research questions with cited sources. It also offers brand data, people search, enrichment, and company data through the same API. It emphasizes that rendering happens in a real browser and that proxies and retries are managed automatically to scale data collection for agents and products.

Context.dev supports onboarding, experimentation, and production use with an emphasis on integration into codebases via SDKs in multiple languages and through direct API calls. It provides security and governance features like zero data retention and configurable web access policies, along with monitoring and webhook updates for changes to pages and sites.

Context.dev presents use cases for onboarding autofill, enterprise-grade security, and data freshness through Monitors and Batches. It describes a workflow where teams scrape pages, map URLs, crawl sites, and retrieve brand data to keep downstream retrieval indexes current.

Use cases

  • Monitor changes to pricing or content for alerts and automation.
  • Research with cited sources and structured JSON outputs.

Key features

  • Scrape anything into Markdown, HTML, screenshots, images, or structured fields from any URL.
  • Map domains to discover page URLs across a site with titles and descriptions.
  • Run batches to process thousands of URLs or crawl entire sites in the background.
  • Answers API to return structured JSON with sources for research questions.
  • Monitors to watch pages for changes and send webhook updates.

Pros and cons

Pros

API covers scraping, mapping, crawling, searching, and answers in one endpoint.
Zero data retention and web access policy controls.

Cons

No one-time lookup option; multiple plans with different quotas.
Rate limits are defined per plan and can require upgrades for higher volume.

Pricing

Free Tier
$0/month
  • 1,000 credits per month
  • 2 concurrent
  • Scrape 1,000 pages
  • JS rendering & proxies included
  • 10 monitors
  • 1 concurrent batch
  • Email support
  • Pull 10K logos (one-time quota)
Developer
$20/month
  • 10,000 credits per month
  • 2 concurrent
  • Scrape 10,000 pages
  • JS rendering & proxies included
  • 2 concurrent batches
  • Email support
  • Usage alerts
  • Pull 100K logos
  • 1,000 Answers in Fast mode
  • 100 monitors
Pro
$90/month
  • 100,000–1,000,000 credits per month
  • 100 concurrent
  • Scrape 100,000 pages
  • JS rendering & proxies included
  • 5 concurrent batches
  • Email + Slack support
  • Spend controls
  • Pull 2.5M logos
  • 10,000 Answers in Fast mode
  • 1,000 monitors
Enterprise
Custom
  • Custom monthly credits
  • Volume discounts
  • Custom rate and monitor limits
  • SSO, SAML and SCIM provisioning
  • 99.9% uptime SLA
  • Annual invoicing, MSA and DPA
  • Dedicated Slack channel
  • Custom support and implementation help

Reviews

Loading reviews…

Frequently asked questions

Can I crawl an entire website?
Yes. Crawl discovers and scrapes up to 500 pages into Markdown in one call, with controls for depth, page count, URL patterns, and subdomains. For larger sites, run Batches in crawl mode and collect results through pagination or a completion webhook. Use Map when you only need the URLs.
What SDKs are available?
We provide official SDKs for TypeScript, Python, Ruby, Go, and PHP.
How can my agent sign up?
AI agents can register and obtain API credentials programmatically using our agent authentication guide (auth.md). You will still need to sign in or verify your email.

Alternatives to Context.dev

More in AI Agent