What Is a Sitemap?
A sitemap is a blueprint of your website that help search engines find, crawl and index all of your website’s content. Sitemaps also tell search engines which pages on your site are most important.
There are four main types of sitemaps:
- Normal XML Sitemap: This by far the most common type of sitemap. It’s usually in the form of an XML Sitemap that links to different pages on your website.
- Video Sitemap: Used specifically to help Google understand video content on your page.
- News Sitemap: Helps Google find content on sites that are approved for Google News.
- Image Sitemap: Helps Google find all of the images hosted on your site.
Why are Sitemaps Important?
Search engines like Google, Yahoo and Bing use your sitemap to find different pages on your site.
“If your site’s pages are properly linked, our web crawlers can usually discover most of your site.”
In other words: you probably don’t NEED a sitemap. But it definitely won’t hurt your SEO efforts. So it makes sense to use them.
There are also a few special cases where a sitemap really comes in handy.
For example, Google largely finds webpages through links. And if your site is brand new and only has a handful external backlinks, then a sitemap is HUGE for helping Google find pages on your site.
Or maybe you run an ecommerce site with 5 million pages. Unless you internal link PERFECTLY and have a ton of external links, Google’s going to have a tough time finding all of those pages. That’s where sitemaps come in.
With that, here’s how to setup a sitemap…and optimize it for SEO.
Create a Sitemap
Your first step is to create a sitemap.
If you use WordPress, you can get a sitemap made for you with the Yoast SEO plugin.
The main benefit of using Yoast to make your XML sitemap is that it updates automatically (dynamic sitemap).
So whenever you add a new page to your site (whether it’s a blog post or ecommerce product page), a link to that page will be added to your sitemap file automatically:
If you don’t use Yoast, there are lots of other plugins available for WordPress (like Google XML Sitemaps) that you can use to create a sitemap:
What if you don’t use WordPress?
No worries. You can use a third-party sitemap generator tool like XML-Sitemaps.com. These will spit out an XML file that you can use as your sitemap.
Either way, once your sitemap is created, I recommend manually taking a look at it.
(Your sitemap is usually found at site.com/sitemap.xml. But it depends on your CMS and what program you used to create your sitemap)
It should display all of the pages on your site:
If everything looks good, it’s time to submit your sitemap to Google.
Submit Your Sitemap To Google
To submit your sitemap login to your Google Search Console account.
Then, go to “Index” → “Sitemaps” in the sidebar.
If you already submitted your sitemap, you’ll see a list of “Submitted Sitemaps” on this page:
Either way, to submit your sitemap, enter your sitemap’s URL into this field:
And hit “Submit”.
And if everything is all setup, you’ll start to see information on your sitemap on this page under the “Submitted Sitemaps” section:
Use the Sitemap Report to Spot Errors
Once Google has crawled your sitemap, click on it under “Submitted Sitemaps”:
If you see “Sitemap index processed successfully”, then Google successfully crawled your sitemap.
You can also click on the little bar chart icon to go to the Coverage Report for your sitemap:
This report shows you how many URLs Google found in your sitemap… and how many of those pages ended up in Google’s index:
For example, you can see that my sitemap contains links to 116 webpages. 109 are “valid” and 6 are “Excluded”.
I can obviously ignore the valid pages.
But I do want to check out any “Excluded” pages to see what’s up.
It turns out that those 6 URLs in my sitemap are getting a “Duplicate, submitted URL not selected as canonical” message.
And when I look at the URLs, I see that these are pages that I don’t even want indexed in the first place.
So I should remove them from my sitemap.
Use Your Sitemap to Find Problems With Indexing
One of the cool things about using a sitemap is that it can gives you a ballpark estimate of:
- How many pages you WANT indexed
- How many pages ARE indexed
For example, let’s say that your sitemap links to 5,000 pages.
But when you look at the Google Search Console, your site only has 2,000 pages indexed.
That’s a sign that something’s up. It could be that there’s a lot of duplicate content in those 5,000 pages. So Google isn’t indexing all of them.
Or it could be that the number of pages on your site exceed your crawl budget.
Match Your Sitemaps and Robots.txt
It’s important that your sitemaps and Robots.txt work together.
In other words:
If you clock a page in robots.txt or use the “noindex” tag on a page, you DON’T want it to appear in your sitemap.
Otherwise, you’re sending mixed messages to Google.
Your sitemap says: “This page is important enough to make it into our sitemap”. But when Googlebot lands on the page, they get blocked.
Sitemap Pro Tips
Huge Site? Break Things Up Into Smaller Sitemaps: Sitemaps have a limit of 50k URLs. So if you run a site with a ton of pages, Google recommends breaking up your sitemap into several smaller sitemaps.
Be Careful With Dates: URLs in your sitemap have a “last modified” date associated with them.
I recommend changing these dates ONLY when you make significant changes to your site (or add new content to your site). Otherwise, Google warns that updating dates on pages that haven’t changed can be seen as a spammy tactic.
Don’t Sweat Video Sitemaps: Video Schema has largely replaced the need for video sitemaps. A video sitemap definitely won’t hurt your page’s ability to get a video rich snippet. But it’s usually not worth the hassle.
Stay Under 50MB: Google and Bing both allow sitemaps that are up to 50MB. So as long as you’re under 50MB, you’re good.
HTML Sitemaps: This is basically the equivalent of an XML sitemap… but for users.
You don’t necessarily need these as Google and other search engines now rely on your XML sitemap. But if you think they’re useful for human visitors, an HTML sitemap probably isn’t going to hurt your SEO efforts.
Build and submit a sitemap: A guide from Google on creating sitemaps… and getting them submitted to Google.
Using Sitemaps to help Google find content hosted on your site: Quick video from the Google Webmaster YouTube channel on how sitemaps can help your site appear higher and more often in the search results.