Crawl Results

Understand and act on your crawl data

Overview

After a crawl completes, you’ll have comprehensive data about your domain’s link health, SEO status, and performance. This guide explains how to interpret results and prioritize fixes.

Results Dashboard

The results dashboard provides an at-a-glance summary:

Crawl Results: example.com
═══════════════════════════════════════════════════════════
Completed: Dec 2, 2024 at 2:34 PM
Duration: 4m 23s
Pages: 847 discovered, 847 checked

┌─────────────────┬─────────────────┬─────────────────┐
│  HEALTH SCORE   │  BROKEN LINKS   │   SEO ISSUES    │
│      78/100     │       12        │       34        │
│     Good        │    Critical     │    Warnings     │
└─────────────────┴─────────────────┴─────────────────┘

Summary Metrics

Metric	Description
Health Score	Overall site health (0-100)
Pages Discovered	Total unique URLs found
Pages Checked	URLs successfully analyzed
Broken Links	4xx/5xx errors found
Redirects	Redirect chains detected
SEO Issues	On-page SEO problems
Crawl Duration	How long the crawl took

Navigating Results

Results are organized into tabs:

Overview
Broken Links
Redirects
SEO
All URLs

High-level summary with:

Health score trend
Issue breakdown by category
Quick stats
Action items

Understanding Status Codes

Success (2xx)

Code	Meaning	Action
200	OK	None needed
201	Created	None needed
204	No Content	Verify intentional

Redirects (3xx)

Code	Meaning	Action
301	Permanent Redirect	Update links to final URL
302	Temporary Redirect	Verify temporary status
307	Temporary (strict)	Verify temporary status
308	Permanent (strict)	Update links to final URL

Client Errors (4xx)

Code	Meaning	Action
400	Bad Request	Fix malformed URL
401	Unauthorized	Expected for protected pages
403	Forbidden	Check permissions
404	Not Found	Remove or redirect
410	Gone	Remove links
429	Rate Limited	May be false positive

Server Errors (5xx)

Code	Meaning	Action
500	Internal Error	Investigate server logs
502	Bad Gateway	Check upstream servers
503	Unavailable	Temporary; recheck
504	Gateway Timeout	Performance issue

Filtering Results

Use filters to focus on specific issues:

Filter	Options
Status	Success, Redirect, Error, Timeout
Status Code	Specific code (404, 500, etc.)
Link Type	Internal, External
Issue Type	SEO category
Page	Specific source URL

Example Filters

Find all 404 errors on internal links:
  Status Code: 404
  Link Type: Internal
  
Find SEO issues on blog pages:
  Issue Type: Any
  Page: /blog/*
  
Find external broken links:
  Status: Error
  Link Type: External

Prioritizing Fixes

Not all issues are equally important. Prioritize by:

Impact Priority

Priority	Issues	Why
🔴 Critical	Server errors, SSL expired	Affects all visitors
🟠 High	Internal 404s, missing H1	Direct SEO/UX impact
🟡 Medium	External 404s, long chains	Indirect impact
🟢 Low	Short descriptions, generic anchors	Optimization

Reach Priority

Fix issues that affect more pages first:

Broken Link Analysis
─────────────────────────────────────────
/old-product-page (404)
  Found on: 47 pages
  Impact: HIGH ← Fix this first
  
/typo-link (404)
  Found on: 1 page
  Impact: LOW ← Fix later

A single broken link in your navigation might appear on every page. Fixing one link can resolve hundreds of issues.

Exporting Results

Export data for team collaboration or analysis:

Export Formats

Format	Best For
CSV	Spreadsheet analysis, bulk fixing
PDF	Client presentations, stakeholders
JSON	API integration, custom tools

Export Options

Export Settings
─────────────────────────────────────────
Format: CSV ▼

Include:
  ☑ All URLs
  ☑ Broken links
  ☑ Redirects
  ☑ SEO issues
  ☐ Response times (large file)

Filters:
  ☑ Apply current filters
  ☐ Export all data

Comparing Crawls

Track progress by comparing crawls:

Select Crawls

Choose two crawls to compare from the history.

View Diff

See what changed:

New issues (appeared)
Fixed issues (resolved)
Unchanged (persistent)

Analyze Trends

Track metrics over time:

Health score trend
Issue count trend
New vs resolved rate

Comparison View

Crawl Comparison: Dec 1 vs Dec 2
═══════════════════════════════════════════════════════════
                    Dec 1        Dec 2        Change
─────────────────────────────────────────────────────────
Health Score         73          78           +5 ▲
Broken Links         18          12           -6 ▼
SEO Issues           42          34           -8 ▼
Pages Crawled       832         847          +15 ▲

New Issues (3):
  • /new-page missing H1
  • /products/widget 404
  • /about missing meta description

Fixed Issues (9):
  • /old-link redirected
  • /blog/post H1 added
  • ... 7 more

Acting on Results

Quick Actions

From any result, take quick actions:

Action	Effect
Ignore	Hide from future reports
Mark Fixed	Track as resolved
Export	Download single issue details
View Source	See page containing the link

Bulk Actions

Select multiple issues for bulk operations:

Bulk Ignore: Hide multiple known issues
Bulk Export: Download selected items
Generate Redirect List: Create redirect rules

Historical Data

Retention Periods

Plan	History Retained
Free	30 days
Solo	90 days
Pro	1 year
Agency	Unlimited

Accessing History

View past crawls from the domain dashboard:

Crawl History
─────────────────────────────────────────
Dec 2, 2024    78/100    847 pages    ← Current
Dec 1, 2024    73/100    832 pages
Nov 24, 2024   71/100    820 pages
Nov 17, 2024   68/100    815 pages
...

Next Steps

Share Results

Share reports with teams and clients.

AI Review

Get AI-powered analysis of your results.

To find navigation and other pages in this documentation, fetch the llms.txt file at: https://docs.seocrawler.app/llms.txt

Getting Started

Features

Domain Management

Crawling

Plans & Billing

Agency Features

Integrations

Crawl Results

Crawl Results

Overview

Results Dashboard

Summary Metrics

Navigating Results

Understanding Status Codes

Success (2xx)

Redirects (3xx)

Client Errors (4xx)

Server Errors (5xx)

Filtering Results

Example Filters

Prioritizing Fixes

Impact Priority

Reach Priority

Exporting Results

Export Formats

Export Options

Comparing Crawls

Comparison View

Acting on Results

Quick Actions

Bulk Actions

Historical Data

Retention Periods

Accessing History

Next Steps

Share Results

AI Review

​Crawl Results

​Overview

​Results Dashboard

​Summary Metrics

​Navigating Results

​Understanding Status Codes

​Success (2xx)

​Redirects (3xx)

​Client Errors (4xx)

​Server Errors (5xx)

​Filtering Results

​Filter Options

​Example Filters

​Prioritizing Fixes

​Impact Priority

​Reach Priority

​Exporting Results

​Export Formats

​Export Options

​Comparing Crawls

​Comparison View

​Acting on Results

​Quick Actions

​Bulk Actions

​Historical Data

​Retention Periods

​Accessing History

​Next Steps

Share Results

AI Review

Crawl Results

Overview

Results Dashboard

Summary Metrics

Navigating Results

Understanding Status Codes

Success (2xx)

Redirects (3xx)

Client Errors (4xx)

Server Errors (5xx)

Filtering Results

Filter Options

Example Filters

Prioritizing Fixes

Impact Priority

Reach Priority

Exporting Results

Export Formats

Export Options

Comparing Crawls

Comparison View

Acting on Results

Quick Actions

Bulk Actions

Historical Data

Retention Periods

Accessing History

Next Steps