Agent tools
crawl4ai
unclecode/crawl4ai
An open-source web crawler built for LLMs and agents that turns any website into clean, LLM-ready Markdown.
Topics
Related projects
crw1.2kA fast Rust web scraping, crawling and search API with an MCP server that gives AI agents clean markdown and structured data.
aci4.9kAn open tool-calling platform that gives any agent secure, discoverable access to 600+ integrations via MCP.
firecrawl199.5kA developer API service that gives AI agents real-time web search, scraping, and crawling with LLM-ready structured output.
basic-memory4.5kBasic Memory is a local-first memory and knowledge base that stores notes as Markdown and exposes them to Claude, Codex, Cursor, and other MCP clients for reading, writing, search, and graph-based recall.
webclaw2.4kwebclaw is a local-first web content extraction tool for LLMs, offering a CLI, REST API, MCP server, and SDKs to turn websites into clean markdown or JSON.
suna20.7kAn open-source AI operating system where team agents do finished work on cloud computers with human approval.