Browse documentation

SEO Crawler documentation

Turn crawl data into work your team can ship.

Practical workflows for finding technical SEO problems, checking whether they matter, and handing off a clear next action without rewriting a raw crawl export first.

Core workflows

Start with a useful output.

19 guides · more in progress

Practice workflow

Crawl demo fixtures

Learn scope, crawl results, and issue investigation on a small test site with intentional errors, without using client data.

Read guide →

Crawl workflow · 23-second demo

Export an SEO fix list from a crawl

Narrow a crawl to the issues most likely to block a launch or waste organic traffic, then export a CSV that already explains what broke, where, and what to do next.

Read guide →

Link workflow · 11-second demo

Find the source of a broken internal link

Isolate a 404, switch from the broken page to its incoming links, and identify the exact source URL that needs to be corrected.

Read guide →

Redirect workflow · 9-second demo

Find and fix redirect chains

Isolate URLs that take more than one redirect to resolve, inspect the intermediate hop, and replace the chain with a direct route to the final page.

Read guide →

Indexability workflow · 16-second demo

Check page indexability

Find pages that load but still declare noindex, then read the response and indexing reason together before changing a template or CMS setting.

Read guide →

Title workflow · 18-second demo

Review missing and duplicate page titles

Isolate pages with empty titles, compare repeated title text, and decide whether the fix belongs to one page or the template behind many of them.

Read guide →

Snippet workflow · 18-second demo

Review meta descriptions

Isolate missing and repeated descriptions, review length outliers, and decide whether the fix belongs to one page or a shared metadata template.

Read guide →

Canonical workflow · 12-second demo

Check canonical URLs

Find pages that declare a different preferred URL and separate intentional duplicates from stale migration settings or template mistakes.

Read guide →

Heading workflow · 18-second demo

Audit heading structure

Find pages with multiple H1s or missing H2s, inspect the heading text beside each URL, and decide whether the page or its shared template needs attention.

Read guide →

Resource crawling guide

Find CSS and JavaScript blocked by robots.txt

Crawl supporting files as rows, isolate resources blocked by crawl rules, and decide whether the robots.txt directive or the page dependency needs to change.

Read guide →

Table workflow guide

Filter the Pages table

Combine URL and text searches with response, indexability, and discovery filters to turn a large crawl into the exact review queue you need.

Read guide →

Link investigation guide

Trace links to their source

Copy a problem destination, filter the Links table, and identify the source page that needs attention.

Read guide →

Content quality guide

Review duplicate body content

Group pages with matching body content, compare their URL purpose and indexability, and choose whether to consolidate, canonicalize, redirect, or differentiate them.

Read guide →

Content quality guide

Review thin content

Find short pages, compare their extracted content length with page purpose, and decide whether the content or its rendering needs attention.

Read guide →

Table review guide

Use include/exclude filters

Keep one site section in view, remove a matching subset, and restore the full table without another crawl.

Read guide →

Table review guide

Freeze the URL column

Keep page URLs visible while moving across a wide table, and read metadata beside the page it belongs to.

Read guide →

Repeatable audit guide

Clear and rerun a crawl

Preserve the evidence you need, clear the current results, and review a fresh crawl with a comparable scope.

Read guide →

Crawl views guide

Compare Pages and Links

Distinguish a page-level result from the source and destination relationship that needs attention.

Read guide →

Table sorting guide

Sort crawl results

Group response codes, reverse the direction, and return to URL order without hiding results.

Read guide →

How these docs work

Start with the decision

Each guide explains when a workflow is useful, not only which button to press.

Keep the evidence attached

See the affected URL, the signal that triggered the issue, and the recommended next action.

Finish with a handoff

The useful output is work someone can prioritize and ship, not a larger spreadsheet.

Learn without cleaning up after the lesson.

Our demos use a small public fixture site with deliberate 404s, canonical conflicts, missing metadata, and redirect chains. You can repeat the workflow without exposing a client domain or waiting for a large production crawl.