Web content fetching and processing for AI consumption.
Search & Data Extraction
Search and extraction servers bridge AI assistants with search engines, crawlers and document extraction tools. Compare source coverage, supported formats and service costs; a cloud integration may require a separate account or API key.

Local web search, fetching, crawling, extraction and research, with multi-engine search, local ML reranking, a SQLite cache and JavaScript rendering.
Real-time web search using the Exa AI Search API.
Search arXiv papers, read original LaTeX sections, get BibTeX from arXiv metadata and set topic watches, with papers stored locally.
Crawl, embed, chunk, search and retrieve information from datasets through Trieve.
Discover, extract and interact with the web via Bright Data, one interface for automated access to the public internet.
Multi-engine web search across Bing, Baidu, DuckDuckGo, Brave, Exa and CSDN.
Web search using DuckDuckGo, with content fetching and parsing.
Web search using Brave's Search API.
Web search via SearXNG.
Self-hostable web crawler and search API (fastCRW): scraping, crawling, site mapping and SearXNG-backed search.
Fetch web page content using a Playwright headless browser, supporting JavaScript rendering, content extraction and Markdown or HTML output.
Search the web with Kagi Search.
Google search with parallel queries for multiple keywords.
Unsplash image search.
Self-hosted web research: SearXNG search with DuckDuckGo fallback, crawling, dense and BM25 reranking and deduplication into a cited, source-grounded prompt.
Convert PDFs, Word and PowerPoint files, images and spreadsheets to Markdown via the MinerU document parsing API.
Autonomous deep research with structured query elaboration and concise reporting.
Local search of foods, nutrition facts and barcodes in the OpenNutrition database.
Search and read papers from arXiv.
Data extraction with AgentQL.
Search results from Google, Bing, Yahoo, DuckDuckGo, YouTube, eBay and more via SerpApi, plus real-time weather and stock market data.
Web search via your own SearXNG instance and/or You.com, plus page and site crawling to deduplicated Markdown with Crawl4AI and Playwright, including pages behind a login.
Extract content from web pages, PDFs, Word documents, YouTube transcripts, audio and video with automatic engine selection and structured JSON output.
Web search via Search1API.
Search and read medical and life sciences papers from PubMed.
Web search via the Scrapeless Google SERP API.
Convert websites to clean Markdown with links preserved, using Mozilla Readability, caching, robots.txt-aware crawling and concurrent fetching.
Chromium-free web content extraction in a single binary: fetch, render, crawl and screenshot pages with the Servo browser engine.
Get the LaTeX source of arXiv papers to handle mathematical content and equations.
Primitive RAG-like web search that runs locally, without external APIs.
Connect to SearXNG instances.
Web, image, news, video and local point-of-interest search using Brave's Search API.
Google News via SerpAPI: search headlines, stories and related topics, with automatic topic categorization and multi-language support.
Retrieval, private deep research, file-to-Markdown extraction and text chunking via Vectorize.
Search across DuckDuckGo, Sogou, Bing, Baidu, Wikipedia, Startpage, Yandex and Mojeek with waterfall search, multi-source verification and news search.
Capture website screenshots, tiling full pages into 1072x1072 chunks for Claude Vision, with configurable viewports and wait strategies for dynamic content.
Crawl documentation sites into local Markdown or JSONL corpora and serve them with offline BM25 search, page reads, freshness checks and crawl diffs.
Expose OpenAI's built-in web search tool.
Deep research agent from Octagon.
Naver Search API integration: blog, news and shopping search plus DataLab analytics.
Web search via DuckDuckGo.
Access computational knowledge and data via the Wolfram Alpha API.
PDF extraction router that classifies each page and routes it to PyMuPDF, Docling, OCR or an LLM fallback, re-extracting pages with low confidence scores.
Query network asset information from ZoomEye.
Web search using the Microsoft Bing Search API.
Search Hacker News, get top stories and more.
Local, offline full-text code search for coding agents using a trigram index over large codebases.