DIRECTORY · CATEGORY
Technical SEO Crawlers & Auditors
Tools that crawl a website to find broken links, missing tags, and other on-site technical issues. 17 tools, sorted by what's actually running underneath — full tier criteria →
01Alli AIAPI STITCHA code snippet edits live on-page SEO in the browser; a separate build step makes sure search and AI crawlers see the same changes in the raw page, not just what a visitor sees.CONF HIGH$249+/MO02BotifyDATA MOATOwn crawler at Googlebot-matching render speed, plus real server-log ingestionCONF MEDIUMNO PUBLIC PRICING (EST. $75K–$400K+/YR)03DYNO MapperAPI STITCHVisual sitemap / site-structure crawler with content planning and accessibility testing bundled in — crawls the site(s) you add, no proprietary web-scale index; keyword-ranking data source not disclosed by vendor. Annual-vs-monthly pricing gap directly verified via live browser (both billing toggle states screenshotted, 21 Aug 2026).CONF HIGH$39+/YR04JetOctopusAPI STITCHCrawl + log analysis like Oncrawl/Lumar, but self-serve usage pricing instead of a custom quoteCONF MEDIUM€383+/MO (SELF-SERVE)05LumarAPI STITCHCloud-scale crawler, no persistent web index — quote-only enterprise pricingCONF MEDIUMCUSTOM QUOTE — NO PUBLIC PRICING06Netpeak SpiderAPI STITCHOwn crawl engine per site, Windows & macOS desktop app; no persistent web indexCONF HIGH$20+/MO07OncrawlAPI STITCHCrawler plus log-file analysis; no persistent web index, quote-only pricingCONF MEDIUMCUSTOM QUOTE — NO PUBLIC PRICING08RyteAPI STITCHSite-scoped crawler and content suite bundled with performance/accessibility/GDPR checks — quote-only pricingCONF MEDIUMCUSTOM QUOTE — NO PUBLIC PRICING09Schema AppAPI STITCHEnterprise schema markup on the open schema.org standard; custom-quote only, no self-serve planCONF MEDIUMCUSTOM QUOTE — NO PUBLIC PRICING10Screaming FrogAPI STITCHOwn crawl engine per site; no persistent web indexCONF HIGH$279/YR11ScrepyAPI STITCHSmall all-in-one SEO suite (Airscarp LLC, founded 2020, 2-10 employees) — own site crawler plus bundled rank tracking, keyword research, backlink checks, and an AI article generator; backlink/keyword data source not disclosed by vendor; no proprietary web-scale index.CONF HIGH$6+/MO12SEOnautAPI STITCHOwn Go-based crawler, MIT license, free to self-hostCONF HIGH$0 self-hosted (MIT) · free cloud Lite tier · $9+/MO cloud Growth tier13SEOptimerAPI STITCHWhite-label SEO audit tool built for agencies — runs its own site crawler, bundles keyword/backlink search credits and an AI-search-visibility score; site-scoped crawl, no disclosed web-scale index. Acquired GrowthBar (AI content tool, also covered on this site).CONF HIGH$29+/MO14SitebulbAPI STITCHTechnical SEO site crawler — desktop and cloud versions, runs its own crawl/render engine, no proprietary web-scale index.CONF HIGH$18+/MO15Sitechecker.proAPI STITCHOwn site crawler plus a SERP-based rank tracker and AI-visibility monitor; no backlink index of its ownCONF HIGH$79+/MO16WooRankAPI STITCHWebsite review/report-card tool — scores one site against on-page and technical checklist items, tracks keywords, and generates client-ready PDF and lead-gen reports; site-scoped crawl, no proprietary web-scale index.CONF HIGH$89.99+/MO17WordLiftAPI STITCHAI content generation plus a real structured-data knowledge graph bundled with schema markup — sales-assisted only, starts at €799/mo.CONF HIGH€799+/MO