content-core
lfnovo/content-core
Extract content from web pages, PDFs, Word documents, YouTube transcripts, audio and video with automatic engine selection and structured JSON output.
- Local integrations
Installation, supported tools and required credentials are maintained by the project.
Project details
- GitHub stars
- 179
- Language
- Python
- License
- MIT
- Forks
- 44
- Latest release
- v2.2.018d ago
- Activity
- updated 18d ago
First MCP server?Start with the basics
Web content fetching and processing for AI consumption.
Local web search, fetching, crawling, extraction and research, with multi-engine search, local ML reranking, a SQLite cache and JavaScript rendering.
Real-time web search using the Exa AI Search API.
Search arXiv papers, read original LaTeX sections, get BibTeX from arXiv metadata and set topic watches, with papers stored locally.
Crawl, embed, chunk, search and retrieve information from datasets through Trieve.
Discover, extract and interact with the web via Bright Data, one interface for automated access to the public internet.
Multi-engine web search across Bing, Baidu, DuckDuckGo, Brave, Exa and CSDN.
Web search using DuckDuckGo, with content fetching and parsing.