Agent tools
crw
us/crw
A fast Rust web scraping, crawling and search API with an MCP server that gives AI agents clean markdown and structured data.
Topics
Related projects
crawl4ai87.1kAn open-source web crawler built for LLMs and agents that turns any website into clean, LLM-ready Markdown.
firecrawl199.5kA developer API service that gives AI agents real-time web search, scraping, and crawling with LLM-ready structured output.
livecontext-ce784A self-hosted AI automation platform that builds workflows, scoped agents, and apps from chat.
PageIndex40.4kA vectorless, reasoning-based RAG engine that indexes documents as trees and retrieves answers like a human expert.
quivr39.6kAn opinionated, embeddable RAG engine that ingests files and powers question-answering inside your own product.
quivr39.6kAn open-source knowledge retrieval backend for agents. It ingests documents and continuous content streams, then serves hybrid keyword and semantic search plus topic alerts through an HTTP API.