SEO, XML Sitemap, Sitemap Generator, Google Crawl, Search Console, Technical SEO, Website Indexing

Written by Mehar Ali Hassan | 10/22/2026

Sitemap Generator: Create a Sitemap and Help Google Crawl Your Website (2026)

New pages go live and nothing happens. Google takes days or even weeks to find them and your traffic report stays flat. Plenty of website owners blame the content when the real problem is discovery.

A sitemap generator fixes that part in minutes. It crawls your site and builds a clean list of every URL worth finding. This post covers the best free picks and a few ways to get a free sitemap without installing anything. It also covers the cleanup step that most roundups skip and the checks to run after you submit.

What a Sitemap Generator Tool Does for SEO (and What It Does Not)

A sitemap generator tool crawls your site and writes a list of indexable URLs in XML format. That list helps search engines like Google find your pages faster. It supports SEO through discovery only. It does not guarantee indexing or higher rankings.

A Sitemap Is a File and Not a Ranking Factor

A sitemap is a file that sits on your server and lists URLs. Search engines read it like a reading list. Nothing inside the sitemap file adds ranking power by itself.

Here is the thing I see in audits all the time. Owners add every page to the list and then wait for rankings to jump. That is not how it works. The file only speeds up discovery.

Most of the time it is a plain XML file. This is what the formatted XML looks like:

xml

<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
  <url>
    <loc>https://www.example.com/page/</loc>
    <lastmod>2026-10-01</lastmod>
  </url>
</urlset>

Each url block holds a loc value and an optional lastmod date. That small XML file is the whole idea.

What the File Provides

What a sitemap provides is simple:

• A clear list of the web pages you want found

• A hint about when each page last changed

• Faster discovery of fresh pages that have few internal links

• A way to compare submitted URLs against what actually shows up in search results

Sitemaps help most on new sites and large sites and badly linked sites. They support website visibility by shortening the path between a fresh page and a crawler. Both Google Search and Bing read the same format. You will also see it written as site map with a space. Same thing.

Crawl and Index Your Site: Where the Sitemap Fits

Search engines crawl and index your site in two separate steps. A bot crawls a page first. Then the engine decides whether to index your pages at all. A sitemap only helps with the first step.

You do not have to use a sitemap on a tiny site with clean internal links. But it costs nothing and gives crawlers a second route. On bigger sites crawl budget starts to matter. A tidy file points bots toward pages worth the visit and a messy one wastes the trip. Treat it as a hint and never a command.

Three Myths That Cause Wasted Work

• More URLs in the file means more traffic. It does not.

• Submitting the file forces indexing. Google decides that on its own.

• You must resubmit after every new post. Search engines tend to recheck a known file by themselves.

XML Sitemap vs Visual Sitemap vs HTML Sitemap: Which Do You Need?

Pick XML for bots and HTML for visitors and visual for planning. Most sites only need an XML sitemap. Add an HTML page when your navigation is weak. Use a visual map when you are redesigning or planning structure before anything goes live. Each step takes only a few minutes.

Different types of content need different files. A blog mostly needs the plain XML version. A photo portfolio benefits from image entries too.

When a Visual Sitemap Generator Beats XML

A visual sitemap generator draws your pages as boxes and lines. You see the website structure at a glance. That makes it handy for planning menus and spotting orphan pages. Agencies use it at redesign kickoffs because you can create visual sitemaps before a single page exists.

Most roundups blur the visual and XML types together. They solve different problems. A visual map helps people. The XML file helps bots.

Rich Media: Image and Video Entries

If your site has a lot of rich media content you can list images and videos too. Image entries sit under the page they belong to. Video entries add details like a title and a thumbnail. This pays off when pictures drive traffic such as a product catalog or a photo gallery.

Free Online Sitemap Generator: 6 Steps from URL to Live File

Fix broken pages first. Enter your URL and let the tool crawl it. Download the file and upload it to your root folder. Add a line to robots.txt. Then submit it and check for errors. Each step takes only a few minutes.

This is the workflow for building a sitemap for your website from nothing.

1. Clean up first. Run your site through a broken link checker and fix dead pages and long redirect chains. A crawler will happily list a broken URL if it finds one. Skipping this is the most common reason a new file arrives full of errors. Fixing broken links before the run saves you a second pass.

2. Enter your website URL. Open the free XML sitemap generator and enter your website URL in the box. Use the exact version of the domain you want indexed. That means one choice between www and no www and one choice between http and https.

3. Crawl your site. Start the run so the tool can crawl your site and follow internal links. It will generate an XML sitemap from whatever it finds. If you want to create XML for a specific section only then set the starting folder first.

4. Download and upload sitemap.xml. Save the output as sitemap.xml and upload it to the root of your domain. It should open at yourdomain.com/sitemap.xml in a browser. A 404 means the upload landed in the wrong folder. Sitemap creation is not finished until that address loads.

5. Point robots.txt to it. Add one line that starts with Sitemap and gives the full URL. Need to build or fix the file itself. The robots.txt generator handles that.

6. Sitemap is ready: validate and submit. Run the file through a sitemap validator. It catches broken tags and wrong URL formats. Once the check comes back clean the sitemap is ready for submission.

When the Crawl Misses Pages

Crawlers follow links. A page with no internal links is an orphan and it will not appear in the output. If a page you care about is missing then add a link from a related page and run the crawl again. Do not paste the URL in by hand and move on. A page nobody links to usually has a bigger problem than discovery.

Why a Downloaded File Goes Stale

Here is the part most people miss. A downloaded file is a snapshot. If you publish weekly that snapshot is out of date within days. Set a reminder or a regeneration trigger so fresh pages get added without anyone remembering.

Best Free Sitemap Generator Options: Online Tools vs Plugins vs Crawlers

For a small static site use a browser tool. For WordPress use a plugin. For a large site or one heavy on JavaScript use a desktop crawler. Free limits and hosting rules differ by vendor so check the date on any price you see.

Any sitemap tool with a free version is fine for a first test. Some paid tools offer a free trial for bigger sites. A tool that creates an XML sitemap on request is great for a quick job but weak for a site that changes daily. Prices change often and sources disagree so check the vendor page on the day you decide.

WordPress Plugin Route

A plugin builds the file and refreshes it when you publish. That makes it the easiest way to create XML sitemaps for a blog. Some plugins have a setting that allows you to create one list for posts and another for pages and categories. Pick plugins built to output Google XML files and read their settings page once.

One check I run on WordPress audits. Two SEO plugins both producing a sitemap. Search Console then shows two files with overlapping URLs. Turn one off. A leftover Google sitemap option inside an old theme can add a third.

Desktop Crawler

Screaming Frog is the usual pick for technical audits. The free version caps at 500 URLs. Its real strength is filtering. You can drop noindex pages and redirects before you export.

Building From Scratch with a Sitemap XML Generator Script

Developers sometimes write a sitemap from scratch with a script or a framework package. A sitemap xml generator script is flexible. It also leaves limits and updates entirely to you. A sitemap builder inside a CMS is a middle path.

Old tutorials tell you to ping search engines with a URL after every build. Google retired its ping endpoint . Remove that step from any script you copy.

Where Sitemaps Fit in Your SEO Tools Stack

Treat the file as one item in a wider set of SEO tools. Pair it with a crawler and Search Console and a speed test. Each one catches a different problem.

What Happens After 500 Pages? Limits and Index Files for Large Sites

One sitemap file can hold 50000 URLs or 50 MB uncompressed . Past that limit you split the list by section and tie the files together with an index file. Most free tools stop at 500 pages long before that. Plan the split early.

Generate Sitemaps Per Section

Large sites do better when you generate sitemaps by section. One file for the blog. One for products. One for categories. A parent index file lists them all. Several XML sitemap files with one index is normal on big stores.

This setup helps with debugging. If Search Console reports a problem in the product file you know where to look. One giant file hides the cause.

When You Outgrow the Free Cap

Say your site has 800 pages. You have passed the free cap but you are nowhere near the file limit. Your options are a paid tier or a plugin or a desktop crawler. Roundups rarely explain this middle zone and it is where many growing sites get stuck.

Pages to Leave Out: The Audit Step Most Roundups Skip

List only live pages that return a 200 status and can be indexed and point to themselves as canonical. Remove noindex pages and redirects and 404s and duplicate parameter URLs and thin pages. Anything else sends mixed signals and wastes crawl attention.

Every page on the site does not belong in the file. Your entire website and your important pages are not the same list.

• Pages with a noindex tag because they contradict the file

• URLs that redirect with a 301 or 302

• 404 and 410 pages

• URLs whose canonical points elsewhere (check them with a canonical tag checker)

• Filter and sort and session parameter URLs

• Staging and test URLs

• Login and cart and account pages

One more small thing. Each URL must be absolute with the full domain and protocol. If a URL is relative search engines reject it. Search engines index pages they can reach cleanly and a file full of redirects works against that.

Keep Signals Consistent

Canonical and hreflang and robots rules should all agree with the file. If a page names a different canonical then only the canonical belongs in the sitemap. On multilingual sites each URL should list its language alternates the same way in the file and on the page. Disagreement between these signals is a common reason Search Console shows warnings nobody can explain.

Freshness: lastmod and New Pages

Use lastmod only when a page really changed in a meaningful way. Updating the date for tiny edits or on every build makes the value worthless. Honest dates help crawlers decide what to revisit. Google has said it trusts lastmod only when it proves accurate .

Add new pages the day they go live. Provide search engines with fresh dates and fresh URLs and little else.

Here is a hypothetical based on a common pattern. A WooCommerce shop has 3000 real products. The crawler also picks up 9000 filter URLs and out of stock pages that redirect. The file now lists 12000 URLs and three quarters are noise. Cutting it back to the real products makes the file match what the shop wants found. This example is made up for illustration and is not a client result.

How to Submit Your File to Every Search Engine (Google and Bing Included)

Upload the file and then add its address in the Sitemaps report in Google Search Console. Do the same in Bing Webmaster Tools. Then watch the status. Google retired pinging so rely on submission and a robots.txt line . Submitting takes about two minutes per engine.

1. Google Search Console. Open the Sitemaps report and paste the file path and press submit. Once the file is submitted to Google the status should read Success. You can also submit it to Google through the robots.txt line alone if you lack access.

2. Bing. Add the same file in Bing Webmaster Tools. Many people only do Google and forget this. Submitting to Google and Bing takes minutes. Bing and other search engines that read robots.txt will also find the file through that line.

3. IndexNow. Bing supports IndexNow for instant URL notices . It is optional and works alongside the file.

4. Check the status. Come back in a day. Look at discovered URLs and any errors. Pages shown in Google after a few days are a good sign. Over time you should see better visibility in search results for newly added pages.

Reading the Page Indexing Report

After a few days open the Page indexing report. Two statuses come up constantly. Discovered currently not indexed means Google knows the URL but has not crawled it yet. Crawled currently not indexed means Google visited and chose to skip it. The first is often a patience or crawl budget issue. The second points at content quality or duplication.

After Submission: A 15 Minute Metadata Check on Your Key Pages

Run three quick checks on your top pages. Review the meta description and the Open Graph tags and the general meta tags. That keeps pages properly optimized for search engines and looking right when shared on social platforms. Fifteen minutes is enough for a first pass.

Meta Description Checker Pass

Run a meta description checker over your top pages. Look for missing descriptions and duplicates and text cut off at the length limit. If you need rewrites the meta title and description generator gives you drafts to edit.

Open Graph Checker Pass

Paste a page into an open graph checker and look at the preview. Check the title and image and description that appear when someone shares the link. A missing image tag is the usual miss.

Meta Tag Analyzer Sweep

A meta tag analyzer reads the whole head of a page. It flags a missing canonical or a stray noindex or a wrong robots tag. That last one matters because a noindex on a page in your sitemap recreates the conflict covered above.

Why the Metazivo Method Beats Generic Advice

Most roundups stop at download and submit. Metazivo audits first and splits files by section and validates and monitors and then rechecks metadata. That order solves the problems rivals skip: stale files and polluted URL lists and missing error handling.

On sites built heavily with JavaScript I prefer building the list from the CMS or database instead of a blind crawl. A crawler can only list what it can see. A source of truth lists what actually exists.

A Quick Audit Routine

1. Crawl the live site and export every URL.

2. Remove anything that fails the status and canonical and noindex checks.

3. Split the clean list by section.

4. Submit and wait a day.

5. Read the errors and fix the cause rather than the symptom.

Frequently Asked Questions

Do I need one for a 20 page site?

Not strictly. A 20 page site with clean internal links gets found without one. Still the file costs nothing and gives crawlers a second route plus a place to see submission data in Search Console. If you plan to grow or publish often then add it early.

How often should I regenerate it?

Regenerate whenever you add or remove or meaningfully change pages. For a weekly blog that means weekly. Plugins and CMS tools do this on their own. A downloaded static file needs a manual refresh or a scheduled job so it never falls behind.

How do I find out whether my site already has one?

Type your domain followed by /sitemap.xml in a browser. Then check your robots.txt for a Sitemap line. Also open the Sitemaps report in Google Search Console. WordPress SEO plugins often use a different name such as sitemap_index.xml so test that too.

Can I make one for WordPress or WooCommerce without a plugin?

Yes. WordPress has built in sitemaps in recent versions . For WooCommerce check that product and category pages are included and that filter URLs are not. You can also run a crawler and upload the file yourself but it will go stale quickly.

Is a free generator safe and does it store my URLs?

Mostly yes for public sites since the tool only reads pages anyone can open. Read the privacy terms anyway. Some services host your file on their own servers instead of yours. That is fine for a quick job but not for a file you want to control long term.

Can I include images and videos?

Yes. Image and video entries sit under the page they belong to. They help most when media drives traffic. If images are minor decoration then skip them. Keep the file focused on pages and add media entries only where search value exists.

Does Google still read priority and changefreq?

Google has said it ignores both . It does use lastmod when the dates prove accurate. So put your effort into honest dates and clean URLs rather than tuning the other two tags.

Do AI search tools read sitemaps?

There is no official confirmation that they do . Many depend on traditional search indexes or their own crawlers. A clean file still helps your pages get found by the search engines those tools may rely on.

How do I handle multiple subdomains or languages?

Create one file per subdomain and place each at its own root . For languages list alternates with hreflang annotations inside the file or in page tags. Keep every file limited to URLs on its own host. Submit each property separately in Search Console.

Can I map a login only or JavaScript rendered site?

A crawler can only list what it can reach. Login only pages should stay out of the file anyway. For pages built with JavaScript use a tool that renders scripts or build the list from your CMS or database. Then compare the result against Search Console.