Tools
TorBot
DedSecInside/TorBot
TorBot is an OSINT crawler for the dark web. It crawls .onion sites, checks link liveness, builds link-relationship trees and exports JSON, with an optional desktop app and evidence-first AI analysis.
Topics
Related projects
EasySpider44.8kA free, open-source visual web scraper that lets anyone design and run data-collection tasks by clicking page elements, with optional command-line execution for embedding into other systems.
proxy_pool23.8kA self-hosted proxy IP pool for web crawlers. It periodically collects and validates free proxies and exposes them through a small HTTP API and CLI so scraping code can fetch working proxies.
OnionBrowser2.7kOnion Browser is an open-source privacy-focused web browser for iPhone and iPad that routes all traffic through the Tor network via Orbot. It offers anonymous browsing, downloads and multi-window support.
SpiderSuite989SpiderSuite is a cross-platform web security crawler with a graphical interface, designed for security professionals doing reconnaissance and information gathering.
spider2.8kA concurrency-first Rust crawling engine that streams pages locally or at scale for search and RAG feeds.
NetDiscovery643A general-purpose Java crawler framework and middleware built on Vert.x and RxJava 2, offering modular downloaders, distributed crawling, message-queue integrations and proxy/cookie pools.