Sitemaps

Sitemaps

What Is a Sitemap?

A sitemap is a blueprint of your website that help search engines find, crawl and index all of your website’s content. Sitemaps also tell search engines which pages on your site are most important.

There are four main types of sitemaps:

  • Normal XML Sitemap: This by far the most common type of sitemap. It’s usually in the form of an XML Sitemap that links to different pages on your website.
  • Video Sitemap: Used specifically to help Google understand video content on your page.
  • News Sitemap: Helps Google find content on sites that are approved for Google News.
  • Image Sitemap: Helps Google find all of the images hosted on your site.

Why are Sitemaps Important?

Search engines like Google, Yahoo and Bing use your sitemap to find different pages on your site.

Sitemaps can help search engines find pages

As Google puts it:

“If your site’s pages are properly linked, our web crawlers can usually discover most of your site.”

In other words: you probably don’t NEED a sitemap. But it definitely won’t hurt your SEO efforts. So it makes sense to use them.

There are also a few special cases where a sitemap really comes in handy.

For example, Google largely finds webpages through links. And if your site is brand new and only has a handful external backlinks, then a sitemap is HUGE for helping Google find pages on your site.

Or maybe you run an ecommerce site with 5 million pages. Unless you internal link PERFECTLY and have a ton of external links, Google’s going to have a tough time finding all of those pages. That’s where sitemaps come in.

With that, here’s how to setup a sitemap…and optimize it for SEO.

Best Practices

Create a Sitemap

Your first step is to create a sitemap.

If you use WordPress, you can get a sitemap made for you with the Yoast SEO plugin.

Yoast plugin

The main benefit of using Yoast to make your XML sitemap is that it updates automatically (dynamic sitemap).

So whenever you add a new page to your site (whether it’s a blog post or ecommerce product page), a link to that page will be added to your sitemap file automatically:

New link in sitemap

If you don’t use Yoast, there are lots of other plugins available for WordPress (like Google XML Sitemaps) that you can use to create a sitemap:

WordPress XML sitemap

What if you don’t use WordPress?

No worries. You can use a third-party sitemap generator tool like XML-Sitemaps.com. These will spit out an XML file that you can use as your sitemap.

XML sitemaps

Either way, once your sitemap is created, I recommend manually taking a look at it.

Backlinko XML sitemap

(Your sitemap is usually found at site.com/sitemap.xml. But it depends on your CMS and what program you used to create your sitemap)

It should display all of the pages on your site:

Backlinko – Posts XML sitemap

If everything looks good, it’s time to submit your sitemap to Google.

Submit Your Sitemap To Google

To submit your sitemap login to your Google Search Console account.

Then, go to “Index” → “Sitemaps” in the sidebar.

Google Search Console – Navigation

If you already submitted your sitemap, you’ll see a list of “Submitted Sitemaps” on this page:

Google Search Console – Sitemaps

Either way, to submit your sitemap, enter your sitemap’s URL into this field:

Add a sitemap

And hit “Submit”.

Submit new sitemap

And if everything is all setup, you’ll start to see information on your sitemap on this page under the “Submitted Sitemaps” section:

Submitted sitemaps

Use the Sitemap Report to Spot Errors

Once Google has crawled your sitemap, click on it under “Submitted Sitemaps”:

Google Search Console – Submitted sitemaps

If you see “Sitemap index processed successfully”, then Google successfully crawled your sitemap.

Sitemap index processed

You can also click on the little bar chart icon to go to the Coverage Report for your sitemap:

See index coverage

This report shows you how many URLs Google found in your sitemap… and how many of those pages ended up in Google’s index:

Coverage report

For example, you can see that my sitemap contains links to 116 webpages. 109 are “valid” and 6 are “Excluded”.

I can obviously ignore the valid pages.

But I do want to check out any “Excluded” pages to see what’s up.

It turns out that those 6 URLs in my sitemap are getting a “Duplicate, submitted URL not selected as canonical” message.

Excluded error message

And when I look at the URLs, I see that these are pages that I don’t even want indexed in the first place.

Excluded examples

So I should remove them from my sitemap.

Use Your Sitemap to Find Problems With Indexing

One of the cool things about using a sitemap is that it can gives you a ballpark estimate of:

  • How many pages you WANT indexed
  • How many pages ARE indexed

For example, let’s say that your sitemap links to 5,000 pages.

But when you look at the Google Search Console, your site only has 2,000 pages indexed.

That’s a sign that something’s up. It could be that there’s a lot of duplicate content in those 5,000 pages. So Google isn’t indexing all of them.

Or it could be that the number of pages on your site exceed your crawl budget.

Match Your Sitemaps and Robots.txt

It’s important that your sitemaps and Robots.txt work together.

In other words:

If you clock a page in Robots.txt or use the “noindex” tag on a page, you DON’T want it to appear in your sitemap.

Otherwise, you’re sending mixed messages to Google.

Your sitemap says: “This page is important enough to make it into our sitemap”. But when Googlebot lands on the page, they get blocked.

Sitemap Pro Tips

Huge Site? Break Things Up Into Smaller Sitemaps: Sitemaps have a limit of 50k URLs. So if you run a site with a ton of pages, Google recommends breaking up your sitemap into several smaller sitemaps.

Be Careful With Dates: URLs in your sitemap have a “last modified” date associated with them.

Sitemap last modified

I recommend changing these dates ONLY when you make significant changes to your site (or add new content to your site). Otherwise, Google warns that updating dates on pages that haven’t changed can be seen as a spammy tactic.

Don’t Sweat Video Sitemaps: Video Schema has largely replaced the need for video sitemaps. A video sitemap definitely won’t hurt your page’s ability to get a video rich snippet. But it’s usually not worth the hassle.

Stay Under 50MB: Google and Bing both allow sitemaps that are up to 50MB. So as long as you’re under 50MB, you’re good.

HTML Sitemaps: This is basically the equivalent of an XML sitemap… but for users.

HTML sitemap

You don’t necessarily need these as Google and other search engines now rely on your XML sitemap. But if you think they’re useful for human visitors, an HTML sitemap probably isn’t going to hurt your SEO efforts.

Learn More

Build and submit a sitemap: A guide from Google on creating sitemaps… and getting them submitted to Google.

Using Sitemaps to help Google find content hosted on your site: Quick video from the Google Webmaster YouTube channel on how sitemaps can help your site appear higher and more often in the search results.