Skip to content

XML Sitemap Generator

Follow the links on your site from the home page and turn every page that asks to be indexed into a clean sitemap.xml, with nothing made up.

Loading the tool

How the generator decides what goes in

Pages are found by following links from the home page, breadth first, on the same site. Each page is kept or left out for a stated reason.

Indexable HTML pages only
A page must answer 200 and be HTML. Error pages, PDFs and other non-HTML files are left out.
noindex respected
Pages with noindex in meta robots, a googlebot meta tag or the X-Robots-Tag header are skipped by default.
Canonical respected
A page whose canonical names a different address is left out by default, since it asks Google to index the other one.
Your exclusions
Up to 20 text fragments such as /tag/ or ?replytocom=. Any address containing one is skipped, while its links are still followed.
Honest lastmod
Taken from dateModified in structured data, article:modified_time or og:updated_time, or a Last-Modified header. If the page declares nothing, no date is written.
Image entries
Up to 20 images per page and 2,000 per file. Logos and icons that appear on half the pages or more are treated as site chrome and dropped.
changefreq and priority (off)
Google ignores both. If you switch them on, they are worked out from how many clicks each page is from the home page.
Polite crawling
robots.txt is followed, a Crawl-delay is honoured, and no more than two requests run at once.

How to generate a sitemap for your website

  1. Enter your home page

    Use the address your visitors land on. If it redirects, for example from http to https or to www, the crawl follows that version.

  2. Pick how many pages to crawl

    Choose 50, 100, 250 or 500. Larger sites take longer, because pages are fetched politely.

  3. Choose what goes in the file

    Images and lastmod are on by default. Leave changefreq and priority off unless another tool needs them.

  4. Add exclusions if needed

    One fragment per line, matched as plain text anywhere in the address. Typical ones are /tag/, /author/ and ?replytocom=.

  5. Download and submit

    Upload sitemap.xml to your site root, add a Sitemap line to robots.txt, and submit it in Search Console.

A slow page is given up after about 15 seconds, and the crawl stops at five clicks from the home page. A crawl that runs out of time still returns the pages it reached and says it was partial.

Reading the generated sitemap

Pages In The Sitemap
How many URLs made it into the file, in crawl order with the shallowest pages first.
Images Listed
Image entries written into the file after site chrome and the caps were applied.
With A Declared lastmod
Pages that carry a real modification date. The Declared In column shows whether it came from structured data, a meta tag or the Last-Modified header.
Crawled And Left Out
Pages reached but kept out of the file. The Why column shows marked noindex, canonical names another page, matched an exclusion, error, not HTML or listed already.
Clicks From Home
How deep each page sits. Important pages more than three or four clicks deep may need better internal links.
sitemap.xml
The finished file, ready to copy or download.

Sitemap issues this tool avoids or exposes

  • Sitemaps that stamp today's date on every page

    Fix: This generator writes lastmod only when the page declares one, and drops server dates shared across many pages, so Google can trust the dates that remain.

  • noindex or canonicalised pages submitted for indexing

    Fix: They are left out and listed. If a page in that list should rank, remove its noindex or fix its canonical, then generate again.

  • Important pages missing from the file

    Fix: If the crawl never reached them, they have no internal links from crawlable pages. Link to them from menus, categories or related posts.

  • Thousands of tag and archive URLs

    Fix: Add their path fragments as exclusions, and consider noindex on thin archive types so they stay out of every sitemap.

  • Only the home page was crawled

    Fix: The site's robots.txt could not be read, or the links are added only by JavaScript. Make /robots.txt answer 200 or 404 and put navigation links in the HTML.

Who needs this sitemap generator

  • Owners of hand-built or static sites with no CMS plugin to write a sitemap.
  • SEO auditors comparing a fresh crawl-based sitemap with the one a plugin produces.
  • Developers launching a new site who want an accurate file for Search Console on day one.
  • Agencies checking which pages a client's internal links actually reach.

A crawl-based sitemap shows your real site

Plugin sitemaps list what the database holds. A crawl lists what links can reach. Pages that appear in your plugin's sitemap but not in this one are orphans: search engines can find them only through the sitemap, which is a weak signal. Use the gap as a to-do list for internal linking.

Sitemap Generator FAQ

Short answers about the Sitemap Generator.

You can choose 50, 100, 250 or 500 pages per run. The crawl stays on the same site and goes up to five clicks deep from the home page.