Find HTML Pages Missing from the Sitemap

You need to compare generated HTML files against sitemap URLs.

Command

find public -name '*.html' -print | sed 's#^public#https://example.com#' | while read -r url; do grep -q "$url" public/sitemap.xml || echo "$url"; done

Before you run this

System impact: Read-only. Can create load on large logs, directories, filesystems, or process tables.

When not to use it: Do not treat every result as an error; drafts and private pages may be intentionally omitted.

Expected output

Generated page URLs that do not appear in sitemap.xml.

System impact

Read-only, can be slow. Nothing changes. The command maps file paths to URLs and prints pages absent from the sitemap.

Scope this to the smallest useful path or service on busy systems.

Recovery / rollback: no state is changed.

When to use it

Use when new routes are not appearing in sitemap output.

When not to use it

Do not treat every result as an error; drafts and private pages may be intentionally omitted.

Watch this command run

Command transcript

This sanitized transcript shows the commands and output shape without exposing host details.

demo@lab:~$

$ find public -name '*.html' -print

public/about.html
public/draft.html
public/blog/post.html
public/index.html

$ find public -name '*.html' -print | sed 's#^public#https://example.com#' | while read -r url; do grep -q "$url" public/sitemap.xml || echo "$url"; done

https://example.com/draft.html
https://example.com/index.html

View commands shown

These are the commands shown in the sanitized transcript.