InfraA capability for your stack
Web scraping and crawling
Read web pages and extract text or structured data.
The directory
Tools for the job
Listed A–Z. Hosted and self-hosted options share one listing. About the labels
Apify
ApifyA managed platform for running reusable data-collection tools called Actors, including website crawling and structured extraction.
HostedDetails & sources
Individual Actors have their own scope and terms; open-source crawler libraries do not make the Apify platform self-hostable.
Reviewed
Bright Data Web Scraper APIs
Bright DataManaged scraper APIs that retrieve structured data from supported websites for applications and data workflows.
HostedDetails & sources
Reviewed
Exa
ExaWeb search and page-content APIs for giving agents current information from the web.
HostedDetails & sources
Reviewed
Firecrawl
FirecrawlWeb search, scraping, and crawling tools that turn pages into Markdown and structured data for AI applications.
Details & sources
Some managed-service capabilities are unavailable or require additional setup in the self-hosted edition.
Source repository ↗ · Firecrawl server code. SDKs and the hosted service have separate terms.
Reviewed
Jina Reader
Jina AIURL reading and web search interfaces that return text suitable for agent and retrieval workflows.
Details & sources
The public server supports stateless or bucket-cached deployments; the hosted service's storage layer is not included.
Source repository ↗ · Public Reader server branch, excluding the hosted MongoDB storage layer.
Reviewed
ScrapingBee
ScrapingBeeA web scraping API that handles browser rendering and proxy infrastructure and can return structured data or Markdown.
HostedDetails & sources
Reviewed
Tavily
TavilyWeb access APIs for agent search, content extraction, and crawling, returning information for application and research workflows.
HostedDetails & sources
Reviewed
No tools match those filters.
Try a different search or see all deployment options.
Know a tool that belongs here? Send it our way ↗