Skip to main content

​
Crawl Results

Understand and act on your crawl data

​
Overview

After a crawl completes, you’ll have comprehensive data about your domain’s link health, SEO status, and performance. This guide explains how to interpret results and prioritize fixes.

​
Results Dashboard

The results dashboard provides an at-a-glance summary: 
Crawl Results: example.com
═══════════════════════════════════════════════════════════
Completed: Dec 2, 2024 at 2:34 PM
Duration: 4m 23s
Pages: 847 discovered, 847 checked

┌─────────────────┬─────────────────┬─────────────────┐
│  HEALTH SCORE   │  BROKEN LINKS   │   SEO ISSUES    │
│      78/100     │       12        │       34        │
│     Good        │    Critical     │    Warnings     │
└─────────────────┴─────────────────┴─────────────────┘

​
Summary Metrics

MetricDescription
Health ScoreOverall site health (0-100)
Pages DiscoveredTotal unique URLs found
Pages CheckedURLs successfully analyzed
Broken Links4xx/5xx errors found
RedirectsRedirect chains detected
SEO IssuesOn-page SEO problems
Crawl DurationHow long the crawl took
Results are organized into tabs:
High-level summary with:
  • Health score trend
  • Issue breakdown by category
  • Quick stats
  • Action items

​
Understanding Status Codes

​
Success (2xx)

CodeMeaningAction
200OKNone needed
201CreatedNone needed
204No ContentVerify intentional

​
Redirects (3xx)

CodeMeaningAction
301Permanent RedirectUpdate links to final URL
302Temporary RedirectVerify temporary status
307Temporary (strict)Verify temporary status
308Permanent (strict)Update links to final URL

​
Client Errors (4xx)

CodeMeaningAction
400Bad RequestFix malformed URL
401UnauthorizedExpected for protected pages
403ForbiddenCheck permissions
404Not FoundRemove or redirect
410GoneRemove links
429Rate LimitedMay be false positive

​
Server Errors (5xx)

CodeMeaningAction
500Internal ErrorInvestigate server logs
502Bad GatewayCheck upstream servers
503UnavailableTemporary; recheck
504Gateway TimeoutPerformance issue

​
Filtering Results

Use filters to focus on specific issues:

​
Filter Options

FilterOptions
StatusSuccess, Redirect, Error, Timeout
Status CodeSpecific code (404, 500, etc.)
Link TypeInternal, External
Issue TypeSEO category
PageSpecific source URL

​
Example Filters

Find all 404 errors on internal links:
  Status Code: 404
  Link Type: Internal
  
Find SEO issues on blog pages:
  Issue Type: Any
  Page: /blog/*
  
Find external broken links:
  Status: Error
  Link Type: External

​
Prioritizing Fixes

Not all issues are equally important. Prioritize by:

​
Impact Priority

PriorityIssuesWhy
🔴 CriticalServer errors, SSL expiredAffects all visitors
🟠 HighInternal 404s, missing H1Direct SEO/UX impact
🟡 MediumExternal 404s, long chainsIndirect impact
🟢 LowShort descriptions, generic anchorsOptimization

​
Reach Priority

Fix issues that affect more pages first: 
Broken Link Analysis
─────────────────────────────────────────
/old-product-page (404)
  Found on: 47 pages
  Impact: HIGH ← Fix this first
  
/typo-link (404)
  Found on: 1 page
  Impact: LOW ← Fix later
A single broken link in your navigation might appear on every page. Fixing one link can resolve hundreds of issues.

​
Exporting Results

Export data for team collaboration or analysis:

​
Export Formats

FormatBest For
CSVSpreadsheet analysis, bulk fixing
PDFClient presentations, stakeholders
JSONAPI integration, custom tools

​
Export Options

Export Settings
─────────────────────────────────────────
Format: CSV ▼

Include:
  ☑ All URLs
  ☑ Broken links
  ☑ Redirects
  ☑ SEO issues
  ☐ Response times (large file)

Filters:
  ☑ Apply current filters
  ☐ Export all data

​
Comparing Crawls

Track progress by comparing crawls:
1

Select Crawls

Choose two crawls to compare from the history.
2

View Diff

See what changed:
  • New issues (appeared)
  • Fixed issues (resolved)
  • Unchanged (persistent)
3

Analyze Trends

Track metrics over time:
  • Health score trend
  • Issue count trend
  • New vs resolved rate

​
Comparison View

Crawl Comparison: Dec 1 vs Dec 2
═══════════════════════════════════════════════════════════
                    Dec 1        Dec 2        Change
─────────────────────────────────────────────────────────
Health Score         73          78           +5 ▲
Broken Links         18          12           -6 ▼
SEO Issues           42          34           -8 ▼
Pages Crawled       832         847          +15 ▲

New Issues (3):
  • /new-page missing H1
  • /products/widget 404
  • /about missing meta description

Fixed Issues (9):
  • /old-link redirected
  • /blog/post H1 added
  • ... 7 more

​
Acting on Results

​
Quick Actions

From any result, take quick actions:
ActionEffect
IgnoreHide from future reports
Mark FixedTrack as resolved
ExportDownload single issue details
View SourceSee page containing the link

​
Bulk Actions

Select multiple issues for bulk operations:
  • Bulk Ignore: Hide multiple known issues
  • Bulk Export: Download selected items
  • Generate Redirect List: Create redirect rules

​
Historical Data

​
Retention Periods

PlanHistory Retained
Free30 days
Solo90 days
Pro1 year
AgencyUnlimited

​
Accessing History

View past crawls from the domain dashboard: 
Crawl History
─────────────────────────────────────────
Dec 2, 2024    78/100    847 pages    ← Current
Dec 1, 2024    73/100    832 pages
Nov 24, 2024   71/100    820 pages
Nov 17, 2024   68/100    815 pages
...

​
Next Steps

Share Results

Share reports with teams and clients.

AI Review

Get AI-powered analysis of your results.
To find navigation and other pages in this documentation, fetch the llms.txt file at: https://docs.seocrawler.app/llms.txt