Skip to main content

​
Overview

Before diving into SEO Crawler’s features, it’s helpful to understand the core concepts that power the platform. This page explains the key terminology and how different components work together.

​
Domains

A domain represents a website you want to monitor. Each domain is a unique property in your SEO Crawler account.
Domains must be verified before crawling to ensure you have permission to analyze the site. This protects website owners from unauthorized scanning.

​
Domain Properties

​
Subdomains

Each subdomain is treated as a separate domain:
  • example.com → One domain
  • blog.example.com → Separate domain
  • shop.example.com → Separate domain
If you need to monitor multiple subdomains, add each one individually and verify ownership for each.

​
Crawls

A crawl is an automated scan of your domain that discovers and analyzes links. The crawler starts from your homepage and follows links to map your entire site structure.

​
How Crawling Works

​
Crawl States

​
Crawl Depth

Crawl depth determines how many “clicks” from the homepage the crawler will follow:
  • Depth 1: Only the homepage
  • Depth 2: Homepage + pages linked from homepage
  • Depth 3: Two levels of link-following
  • Unlimited: Follow all discoverable links
Higher depths take longer and discover more pages. For large sites, start with a limited depth to estimate total page count.
A link is any URL discovered during a crawl. Links are categorized by type and status.

Internal Links

Links pointing to pages on the same domain. These form your site’s navigation structure.

External Links

Links pointing to other domains. These are checked for availability but not crawled further.

​
Scan Options

Scan options are additional analyses you can enable during a crawl. Each option adds specific checks beyond basic link validation.
Verifies SSL/TLS certificate validity and checks expiration dates. Warns you 30, 14, and 7 days before certificates expire.Available on: All plans
Analyzes on-page SEO factors including:
  • Meta titles and descriptions
  • Heading hierarchy (H1-H6)
  • Image alt text
  • Viewport meta tag
  • Language attributes
Available on: Solo plan and above
Evaluates the quality of link anchor text:
  • Detects generic text (“click here”, “read more”)
  • Identifies empty anchors
  • Flags image links without alt text
  • Scores descriptive quality
Available on: Pro plan and above

​
AI Reviews

AI Reviews provide intelligent analysis of your crawl results using advanced language models. Instead of just listing issues, AI Reviews:
  • Prioritize fixes by impact
  • Explain why issues matter
  • Provide specific code fixes
  • Identify patterns across your site
AI Reviews are available on Pro and Agency plans with monthly limits based on your subscription.

​
Review Components

​
Health Score

The Health Score is a 0-100 rating that summarizes your domain’s overall link health. Higher scores indicate fewer issues and better performance.

​
Score Calculation

The score weighs multiple factors:

​
Score Ranges

​
Reports

Reports are exportable summaries of crawl results. They can be shared with team members, clients, or stakeholders who don’t have direct platform access.

​
Report Formats

  • Web Link: Shareable URL with optional password protection
  • PDF Export: Formatted document for presentations
  • CSV Export: Raw data for spreadsheet analysis
Agency plan users can generate white-labeled reports with custom branding.

​
What’s Next?

Now that you understand the core concepts, explore specific features:

Broken Link Detection

Learn how to find and fix broken links.

Adding Domains

Add and configure your first domain.