searxNcrawl
DasDigitaleMomentum/searxNcrawl
Web search via your own SearXNG instance and/or You.com, plus page and site crawling to deduplicated Markdown with Crawl4AI and Playwright, including pages behind a login.
- Local integrations
Installation, supported tools and required credentials are maintained by the project.
Project details
- GitHub stars
- 179
- Language
- Python
- License
- MIT
- Forks
- 22
- Latest release
- v0.32.06d ago
- Activity
- updated 1d ago
- Platforms listed
- macOS, Windows, Linux
- crawl4ai
- llm-tools
- mcp
- mcp-server
- python
- searxng
- web-crawler
- web-search
First MCP server?Start with the basics
Web content fetching and processing for AI consumption.
Local web search, fetching, crawling, extraction and research, with multi-engine search, local ML reranking, a SQLite cache and JavaScript rendering.
Real-time web search using the Exa AI Search API.
Search arXiv papers, read original LaTeX sections, get BibTeX from arXiv metadata and set topic watches, with papers stored locally.
Crawl, embed, chunk, search and retrieve information from datasets through Trieve.
Discover, extract and interact with the web via Bright Data, one interface for automated access to the public internet.
Multi-engine web search across Bing, Baidu, DuckDuckGo, Brave, Exa and CSDN.
Web search using DuckDuckGo, with content fetching and parsing.