See llms.txt for all machine-readable content.

Back to Templates

Catch soft 404 and error pages from sitemaps with Snapshot Site, Slack, and Google Sheets

Created by

Created by: Rabii Jemaiel || snapshotsite
Rabii Jemaiel

Last update

Last update a day ago

Categories

Share

Quick overview

This workflow runs daily to fetch your sitemap.xml, sample a set of URLs, analyze each page with Snapshot Site to detect soft 404s and other error-page signals, log the results to Google Sheets, and post a Slack digest (or a sitemap-fetch failure alert).

How it works

  1. Runs every day at 5AM on a schedule.
  2. Fetches your sitemap.xml over HTTP and extracts all <loc> URLs, deduplicating and sampling up to a capped number for the day.
  3. Sends each selected URL to Snapshot Site Analyze with quality checks enabled to capture HTTP status, title, headings, blank-page detection, CAPTCHA detection, and a screenshot link.
  4. Classifies each result as ok, soft-error, hard-error, blank, captcha, or unreachable based on the returned quality/status fields and title/H1 pattern matching.
  5. Appends all audited URL results to a Google Sheets tab for historical tracking.
  6. Builds a single Slack digest that reports coverage and lists only problem URLs, posting either the problem report or an all-clear message.
  7. Posts a dedicated Slack alert and stops reporting a clean run if the sitemap cannot be fetched or parsed.

Setup

  1. Install the community node n8n-nodes-snapshot-site and add Snapshot Site API credentials.
  2. Add a Slack credential and set the target channel (for the error report, all-clear, and sitemap-failure messages).
  3. Add Google Sheets credentials, set the spreadsheet URL/ID, and create a sheet tab named “Soft 404 Findings” with matching columns for the appended fields.
  4. Update the sitemap URL in the HTTP request step to point to your site’s sitemap.xml (use a full https:// URL, and point to a child sitemap if you currently use a sitemap index).