XML Sitemap Generator
Follow the links on your site from the home page and turn every page that asks to be indexed into a clean sitemap.xml, with nothing made up.
How the generator decides what goes in
Pages are found by following links from the home page, breadth first, on the same site. Each page is kept or left out for a stated reason.
- Indexable HTML pages only
- A page must answer 200 and be HTML. Error pages, PDFs and other non-HTML files are left out.
- noindex respected
- Pages with noindex in meta robots, a googlebot meta tag or the X-Robots-Tag header are skipped by default.
- Canonical respected
- A page whose canonical names a different address is left out by default, since it asks Google to index the other one.
- Your exclusions
- Up to 20 text fragments such as /tag/ or ?replytocom=. Any address containing one is skipped, while its links are still followed.
- Honest lastmod
- Taken from dateModified in structured data, article:modified_time or og:updated_time, or a Last-Modified header. If the page declares nothing, no date is written.
- Image entries
- Up to 20 images per page and 2,000 per file. Logos and icons that appear on half the pages or more are treated as site chrome and dropped.
- changefreq and priority (off)
- Google ignores both. If you switch them on, they are worked out from how many clicks each page is from the home page.
- Polite crawling
- robots.txt is followed, a Crawl-delay is honoured, and no more than two requests run at once.
How to generate a sitemap for your website
Enter your home page
Use the address your visitors land on. If it redirects, for example from http to https or to www, the crawl follows that version.
Pick how many pages to crawl
Choose 50, 100, 250 or 500. Larger sites take longer, because pages are fetched politely.
Choose what goes in the file
Images and lastmod are on by default. Leave changefreq and priority off unless another tool needs them.
Add exclusions if needed
One fragment per line, matched as plain text anywhere in the address. Typical ones are /tag/, /author/ and ?replytocom=.
Download and submit
Upload sitemap.xml to your site root, add a Sitemap line to robots.txt, and submit it in Search Console.
A slow page is given up after about 15 seconds, and the crawl stops at five clicks from the home page. A crawl that runs out of time still returns the pages it reached and says it was partial.
Reading the generated sitemap
- Pages In The Sitemap
- How many URLs made it into the file, in crawl order with the shallowest pages first.
- Images Listed
- Image entries written into the file after site chrome and the caps were applied.
- With A Declared lastmod
- Pages that carry a real modification date. The Declared In column shows whether it came from structured data, a meta tag or the Last-Modified header.
- Crawled And Left Out
- Pages reached but kept out of the file. The Why column shows marked noindex, canonical names another page, matched an exclusion, error, not HTML or listed already.
- Clicks From Home
- How deep each page sits. Important pages more than three or four clicks deep may need better internal links.
- sitemap.xml
- The finished file, ready to copy or download.
Sitemap issues this tool avoids or exposes
Sitemaps that stamp today's date on every page
Fix: This generator writes lastmod only when the page declares one, and drops server dates shared across many pages, so Google can trust the dates that remain.
noindex or canonicalised pages submitted for indexing
Fix: They are left out and listed. If a page in that list should rank, remove its noindex or fix its canonical, then generate again.
Important pages missing from the file
Fix: If the crawl never reached them, they have no internal links from crawlable pages. Link to them from menus, categories or related posts.
Thousands of tag and archive URLs
Fix: Add their path fragments as exclusions, and consider noindex on thin archive types so they stay out of every sitemap.
Only the home page was crawled
Fix: The site's robots.txt could not be read, or the links are added only by JavaScript. Make /robots.txt answer 200 or 404 and put navigation links in the HTML.
Who needs this sitemap generator
- Owners of hand-built or static sites with no CMS plugin to write a sitemap.
- SEO auditors comparing a fresh crawl-based sitemap with the one a plugin produces.
- Developers launching a new site who want an accurate file for Search Console on day one.
- Agencies checking which pages a client's internal links actually reach.
A crawl-based sitemap shows your real site
Plugin sitemaps list what the database holds. A crawl lists what links can reach. Pages that appear in your plugin's sitemap but not in this one are orphans: search engines can find them only through the sitemap, which is a weak signal. Use the gap as a to-do list for internal linking.
Sitemap Generator FAQ
Short answers about the Sitemap Generator.
You can choose 50, 100, 250 or 500 pages per run. The crawl stays on the same site and goes up to five clicks deep from the home page.
They were marked noindex, their canonical pointed elsewhere, they matched an exclusion, returned an error or were not HTML. The Crawled And Left Out table shows each one with the reason. Pages not linked from anywhere crawlable are never found.
Those pages do not declare a modification date. The generator never invents one, because a wrong date teaches Google to ignore the dates on the rest of your pages.
Google ignores both. They are off by default. Turn them on only if another search engine or tool you use expects them.
Yes. Disallowed pages are not visited, and a Crawl-delay is respected. If robots.txt cannot be read at all, only the page you entered is fetched.
It reads links in the HTML the server sends and does not run scripts. Menus built only in the browser will not be followed, and search engines may struggle with them too.
Upload it as sitemap.xml in the root of your site, add Sitemap: https://yourdomain/sitemap.xml to robots.txt, and submit the address in Search Console.
Related SEO tools
XML Sitemap Extractor
Every URL inside a sitemap or sitemap index.
1 free run a dayRobots.txt Generator
A clean robots.txt for WordPress, Shopify or any site.
Free, unlimitedSite Audit Pro
Crawl up to 100 pages and get a technical health score.
1 free run a dayLLMs.txt Generator
A draft llms.txt file built from your site.
1 free run a day