XML Sitemap

You might say

The new article is live but has few internal links. Generate a sitemap.xml containing only valid canonical URLs.

List important canonical URLs in a machine-readable XML file for crawler discoveryWhen a new article has few internal links, listing its full address in sitemap.xml can help crawlers discover and request it. It is a machine-readable URL list, not visitor-facing site navigation, and it does not guarantee indexing or ranking.

Know first

SEO URL Web Hosting

sitemap.xml

How one URL in the file becomes a crawler request

sitemap.xml

1<url>https://example.com/guides</url>

2<url>https://example.com/guides/cache</url>

3<url>https://example.com/deleted</url>

⌕Read the URL listdiscovered: 3

The file can expose URLs, but it cannot turn a 404 into a page or guarantee indexing.

Which step an XML sitemap supports

List the addresses you want systems to discover: A sitemap organizes full URLs in XML for important pages you want crawlers to discover. Each address should exist, be reachable, and match the page's chosen canonical address.

Discovery is followed by requests and decisions: After reading the list, a crawler still requests each page, checks access, and decides what to process. A sitemap improves discovery; it does not provide content or decide indexing and ranking.

Quick checkChoose the best answer

An entry in sitemap.xml points to an article URL that returns 404. What should you do?

Fix the article URL or remove it from the sitemap, then verify every listed URL is reachableKeep it because a crawler will create or index the article after seeing the URLReplace it with a visitor-facing article directory and write out the full navigation hierarchy

You can say this to an AI Agent

Generate sitemap.xml with only important pages that you want crawlers to discover, using full canonical URLs that are reachable. Validate the XML and request every listed address; report which URLs succeed and which need fixing. Do not describe a sitemap as an indexing or ranking guarantee.

Learn next

1SEO→2Robots.txt→