# SEO Audit Tool - Website Crawler & Broken Link Checker (`groupoject/technical-seo-audit-crawler`) Actor

SEO audit tool and website crawler: 0-100 score and A-F grade per page, prioritized issues with fixes, broken links, duplicate titles and meta descriptions, indexability, headings, alt text, JSON-LD, security headers and optional Core Web Vitals.

- **URL**: https://apify.com/groupoject/technical-seo-audit-crawler.md
- **Developed by:** [Group Oject](https://apify.com/groupoject) (community)
- **Categories:** SEO tools, Developer tools, Marketing
- **Features:** Limited permissions
- **Stats:** 3 total users, 1 monthly users, 100.0% runs succeeded, 1 bookmarks
- **User rating**: No ratings yet

## Pricing

from $10.50 / 1,000 results

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

## SEO Audit Tool - Website Crawler & Broken Link Checker

Crawl any website and get a **technical SEO audit for every page**: a 0-100 score and A-F grade, prioritized issues with fix recommendations, broken links, duplicate titles and meta descriptions, indexability, headings, images, structured data, social tags, security headers, and optional Core Web Vitals from Google PageSpeed Insights. **$0.015 per audited page.**

![SEO Audit Tool output in Apify: seo score, grade, page url, http, indexable, title, title length](https://api.apify.com/v2/key-value-stores/lwQu1lCMCLQIIhSMQ/records/technical-seo-audit-crawler-output.png)

*Real output from a default run of SEO Audit Tool in Apify Console.*

### What can this SEO audit crawler do?

- **Crawl a whole site or a section** - follow internal links from one or more start URLs with depth, include, and exclude patterns.
- **Score every page 0-100** with an A-F grade, weighted by issue severity (critical, high, medium, low).
- **Find on-page SEO issues** - missing/short/long titles, missing or badly sized meta descriptions, missing canonical, noindex, missing H1, multiple H1s, skipped heading levels, thin content, missing `lang`, missing viewport.
- **Find duplicate titles and meta descriptions** across the crawled pages.
- **Check broken links** - optional HEAD/GET checks of internal and external links, with the broken URLs and status codes listed per page.
- **Audit images** - missing alt text, missing width/height, lazy-loaded image count.
- **Validate structured data** - JSON-LD blocks, schema types found, and JSON-LD that fails to parse.
- **Social metadata** - incomplete Open Graph tags and missing Twitter/X cards.
- **Security headers** - missing HSTS and Content-Security-Policy.
- **Core Web Vitals (optional)** - PageSpeed Insights performance, SEO, accessibility, and best-practice scores plus LCP, CLS, INP, TBT, and Speed Index for a limited number of pages.
- **Site signals** - robots.txt status and contents, and declared sitemap URLs.

### What data does the SEO audit return?

One dataset row per page:

| Field | Description |
|---|---|
| `url`, `finalUrl`, `depth`, `statusCode`, `responseTimeMs`, `htmlBytes` | Crawl data |
| `score`, `grade` | 0-100 page score and A-F grade |
| `issueCount`, `criticalIssues`, `highIssues`, `mediumIssues`, `lowIssues` | Issue counts |
| `issues[]` | `code`, `severity`, `category`, `message`, `recommendation`, `field` |
| `title`, `titleLength`, `metaDescription`, `metaDescriptionLength` | Metadata |
| `canonicalUrl`, `robotsMeta`, `indexable`, `htmlLang`, `viewport`, `hreflangCount` | Indexability |
| `h1Count`, `h1[]`, `headings[]` | Heading outline |
| `wordCount`, `contentToHtmlRatio` | Content depth |
| `internalLinksCount`, `externalLinksCount`, `brokenLinksCount`, `brokenLinks[]` | Links |
| `imagesCount`, `imagesMissingAlt`, `imagesWithoutDimensions`, `lazyImagesCount` | Images |
| `structuredDataCount`, `structuredDataTypes[]`, `invalidStructuredDataCount` | Schema |
| `openGraphComplete`, `twitterCardPresent` | Social tags |
| `pageSpeed` | PageSpeed scores and Core Web Vitals (when enabled) |

Key-value store: `SUMMARY` (average score and grade, indexable vs non-indexable pages, failed pages, issue counts by severity, top 25 issue codes), `ISSUES` (every issue as a flat list, easy to export to a spreadsheet), and `SITE_SIGNALS` (robots.txt and sitemap URLs).

### How much does an SEO audit cost?

Pay-per-event: **$0.015 per audited page** ($15 per 1,000 pages) plus a tiny Actor-start fee. A 25-page audit costs about $0.38. `maxPages` caps both the crawl and the bill, and the Actor also respects your maximum charge per run. Broken-link checks and PageSpeed calls do not add result charges, but they make runs longer. Check the Pricing tab for current rates.

### How to run a technical SEO audit

1. Enter one or more start URLs (homepage or a section such as `/blog/`).
2. Set `maxPages` and `maxDepth`. Use `includePatterns` / `excludePatterns` to focus the crawl.
3. Turn on `checkBrokenLinks` for a broken link check (set `maxLinksToCheck`).
4. Optionally turn on `includePageSpeed` for Core Web Vitals on a few pages.
5. Click **Start**. Sort by `score`, or export the `ISSUES` record as your fix list.

### Input example

```json
{
  "startUrls": ["https://example.com"],
  "maxPages": 100,
  "maxDepth": 3,
  "excludePatterns": ["*/login*", "*/cart*", "*/checkout*"],
  "checkBrokenLinks": true,
  "maxLinksToCheck": 300,
  "includePageSpeed": true,
  "pageSpeedStrategy": "mobile",
  "pageSpeedMaxPages": 3
}
```

### Output example

```json
{
  "url": "https://example.com/blog/post",
  "statusCode": 200,
  "score": 72,
  "grade": "C",
  "title": "Post",
  "titleLength": 4,
  "indexable": true,
  "h1Count": 2,
  "wordCount": 640,
  "brokenLinksCount": 1,
  "brokenLinks": [{ "url": "https://example.com/old-page", "statusCode": 404 }],
  "imagesMissingAlt": 3,
  "issues": [
    {
      "code": "short-title",
      "severity": "medium",
      "category": "metadata",
      "message": "Title is only 4 characters.",
      "recommendation": "Use a descriptive title that clearly communicates page intent.",
      "field": "title"
    }
  ]
}
```

Illustrative output shape.

### Use cases

- **Website SEO audits** for clients or your own site, with a prioritized fix list.
- **Broken link checking** before and after site migrations.
- **Scheduled SEO monitoring** - run weekly and alert on new critical issues via webhooks.
- **Content quality checks** - thin pages, heading structure, missing alt text.
- **Pre-launch QA** - noindex left on, missing canonicals, invalid JSON-LD.

### Integrations and API

Use the Apify API, schedules, webhooks, Make, Zapier, n8n, Google Sheets, or the Apify MCP server.

```python
from apify_client import ApifyClient

client = ApifyClient("<YOUR_APIFY_TOKEN>")
run = client.actor("groupoject/technical-seo-audit-crawler").call(run_input={
    "startUrls": ["https://example.com"],
    "maxPages": 50,
    "checkBrokenLinks": True,
})
summary = client.key_value_store(run["defaultKeyValueStoreId"]).get_record("SUMMARY")["value"]
print(summary["averageScore"], summary["grade"], summary["topIssueCodes"][:5])
```

### FAQ

**Does it render JavaScript?** No. It is a fast HTTP crawler that audits the HTML your server returns, which is what most search engine first passes see. Client-rendered content may show as thin.

**Do I need a PageSpeed API key?** No, but adding one in `pageSpeedApiKey` improves quota and reliability. The key is never written to the output.

**How many pages can it audit?** Up to 1,000 pages per run.

**Will it overload my site?** Lower `maxConcurrency` for small or fragile sites. The default user agent identifies the crawler.

### Related Actors

- [Website to Markdown Crawler](https://apify.com/groupoject/ai-rag-web-crawler) - export page content as Markdown for LLMs.
- [Google AI Overview Tracker](https://apify.com/groupoject/google-ai-overview-tracker) - check whether your pages are cited in AI Overviews.
- [Google Trends Scraper](https://apify.com/groupoject/trendpulse-keyword-monitor) - find topics worth optimizing for.

# Changelog

This Actor's version history is a separate document: https://apify.com/groupoject/technical-seo-audit-crawler/changelog.md

# Actor input Schema

## `startUrls` (type: `array`):

Start pages or domains. The crawler follows internal links from each URL.

## `urlsText` (type: `string`):

Paste one website URL per line.

## `maxPages` (type: `integer`):

Maximum pages to crawl and bill across all websites.

## `maxDepth` (type: `integer`):

Start URLs are depth 0. Set 0 to audit only the supplied pages.

## `includeSubdomains` (type: `boolean`):

Allow links on subdomains of each starting hostname.

## `includePatterns` (type: `array`):

Optional wildcard patterns. Only matching crawl URLs are included, for example https://example.com/blog/\*.

## `excludePatterns` (type: `array`):

Wildcard patterns to skip, such as */login*, */cart*, or *?preview=*.

## `checkBrokenLinks` (type: `boolean`):

Send extra HEAD/GET requests to test discovered links. This increases runtime.

## `maxLinksToCheck` (type: `integer`):

Maximum unique internal and external links tested when broken-link checks are enabled.

## `includePageSpeed` (type: `boolean`):

Call Google PageSpeed Insights for a limited number of crawled pages.

## `pageSpeedStrategy` (type: `string`):

Mobile is recommended for SEO audits.

## `pageSpeedApiKey` (type: `string`):

Optional. Improves PageSpeed quota and reliability. The key is never included in output.

## `pageSpeedMaxPages` (type: `integer`):

Limit expensive PageSpeed calls separately from the crawl page limit.

## `maxConcurrency` (type: `integer`):

Concurrent page requests. Lower this for small or sensitive websites.

## `requestTimeoutSecs` (type: `integer`):

Maximum time to wait for each page request before retrying or recording a crawl failure.

## `proxyConfiguration` (type: `object`):

Optional. Direct requests are usually enough for public websites.

## `userAgent` (type: `string`):

Optional HTTP user-agent override.

## `debugMode` (type: `boolean`):

Enable verbose crawler logs.

## Actor input object example

```json
{
  "startUrls": [
    "https://apify.com"
  ],
  "maxPages": 25,
  "maxDepth": 3,
  "includeSubdomains": false,
  "excludePatterns": [
    "*/login*",
    "*/cart*",
    "*/checkout*"
  ],
  "checkBrokenLinks": false,
  "maxLinksToCheck": 100,
  "includePageSpeed": false,
  "pageSpeedStrategy": "mobile",
  "pageSpeedMaxPages": 3,
  "maxConcurrency": 10,
  "requestTimeoutSecs": 30,
  "debugMode": false
}
```

# Actor output Schema

## `pages` (type: `string`):

Scored technical SEO audit rows.

## `summary` (type: `string`):

Average score, issue totals, indexability, and top issue codes.

## `issues` (type: `string`):

Flat report-ready list of every issue and recommendation.

## `siteSignals` (type: `string`):

robots.txt status and discovered sitemap URLs.

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "startUrls": [
        "https://apify.com"
    ],
    "excludePatterns": [
        "*/login*",
        "*/cart*",
        "*/checkout*"
    ]
};

// Run the Actor and wait for it to finish
const run = await client.actor("groupoject/technical-seo-audit-crawler").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "startUrls": ["https://apify.com"],
    "excludePatterns": [
        "*/login*",
        "*/cart*",
        "*/checkout*",
    ],
}

# Run the Actor and wait for it to finish
run = client.actor("groupoject/technical-seo-audit-crawler").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "startUrls": [
    "https://apify.com"
  ],
  "excludePatterns": [
    "*/login*",
    "*/cart*",
    "*/checkout*"
  ]
}' |
apify call groupoject/technical-seo-audit-crawler --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,groupoject/technical-seo-audit-crawler"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/RlyaAj0aqVc3Fi0Gq/builds/Up1ZpEmFURpxeQZDe/openapi.json