{"id":16218,"date":"2021-08-01T12:00:16","date_gmt":"2021-08-01T12:00:16","guid":{"rendered":"https:\/\/www.improvemysearchranking.com\/?p=16218"},"modified":"2023-11-23T15:16:32","modified_gmt":"2023-11-23T15:16:32","slug":"normal-20-site-unindexed-google-says","status":"publish","type":"post","link":"https:\/\/www.improvemysearchranking.com\/normal-20-site-unindexed-google-says\/","title":{"rendered":"It\u2019s normal to have 20% of your site unindexed, Google says"},"content":{"rendered":"

You may have noticed that Google search crawlers do not index all the pages on your website. Moreover, you will notice that these pages are being discovered but not being crawled.<\/span><\/p>\n

You might think that there is something qualitatively wrong with your website or perhaps your server.<\/span><\/p>\n

While those issues do affect how your site is being crawled, they aren\u2019t always the only culprits. This is especially true for bigger websites with lots of web pages.<\/span><\/p>\n

According to Google\u2019s John Mueller:<\/span><\/p>\n

\u201cIt\u2019s completely normal that we don\u2019t index everything off of the website.<\/span><\/p>\n

So if you look at any larger website or any even midsize or smaller website, you\u2019ll see fluctuations in indexing. It\u2019ll go up and down and it\u2019s never going to be the case that we index 100% of everything that\u2019s on a website.<\/span><\/p>\n

So if you have a hundred pages and (I don\u2019t know) 80 of them are being indexed, then I wouldn\u2019t see that as being a problem that you need to fix. That\u2019s sometimes just how it is for the moment.<\/span><\/p>\n

And over time, when you get to like 200 pages on your website and we index 180 of them, then that percentage gets a little bit smaller.<\/span><\/p>\n

But it\u2019s always going to be the case that we don\u2019t index 100% of everything that we know about.\u201d<\/span><\/p>\n

 <\/p>\n

Page quality vs. Website quality<\/b><\/h2>\n

 <\/p>\n

In addition, John Mueller also shared another interesting insight. According to him, if certain pages are not being indexed, it does not necessarily mean that those pages are of lower quality.<\/span><\/p>\n

Instead, the issue could be with the overall quality of the website \u2014 not just with those pages specifically.<\/span><\/p>\n

\u201cWith regards to the quality, when it comes to understanding the quality of the website, that is something that we take into account quite strongly with regards to crawling and indexing of the rest of the website.<\/span><\/p>\n

But that\u2019s not something that\u2019s necessarily related to the individual URL.<\/span><\/p>\n

So if you have five pages that are not indexed at the moment, it\u2019s not that those five pages are the ones we would consider low quality.<\/span><\/p>\n

It\u2019s more that overall, we consider this website may be to be a little bit lower quality. And, therefore, we won\u2019t go off and index everything on this site.<\/span><\/p>\n

Because if we don\u2019t have that page indexed, then we\u2019re not really going to know if that\u2019s high quality or low quality.<\/span><\/p>\n

 <\/p>\n

High percentage of non-indexed pages on smaller websites<\/b><\/h2>\n

 <\/p>\n

As we just learned, it\u2019s okay for large websites to have up to 20% of pages unindexed. However, for smaller websites, you need to be careful as a high percentage of non-indexed pages may represent a qualitative website issue.<\/span><\/p>\n

According to John:<\/span><\/p>\n

\u201cIf you have a smaller site and you\u2019re seeing a significant part of your pages are not being indexed, then I would take a step back and try to reconsider the overall quality of the website and not focus so much on technical issues for those [individual] pages.\u201d<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

You may have noticed that Google search crawlers do not index all the pages on your website. Moreover, you will notice that these pages are being discovered but not being crawled. You might think that there is something qualitatively wrong with your website or perhaps your server. While those issues do affect how your site […]<\/p>\n","protected":false},"author":12,"featured_media":17309,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_oct_exclude_from_cache":false,"inline_featured_image":false},"categories":[33,38,35],"tags":[],"yoast_head":"\nIt\u2019s normal to have 20% of your site unindexed, Google says<\/title>\n<meta name=\"description\" content=\"Google search crawlers do not index all the pages on your website. You will notice that these pages are being discovered but not crawled.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.improvemysearchranking.com\/normal-20-site-unindexed-google-says\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"It\u2019s normal to have 20% of your site unindexed, Google says\" \/>\n<meta property=\"og:description\" content=\"Google search crawlers do not index all the pages on your website. You will notice that these pages are being discovered but not crawled.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.improvemysearchranking.com\/normal-20-site-unindexed-google-says\/\" \/>\n<meta property=\"og:site_name\" content=\"Improve My Search Ranking\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/ImproveMySearchRanking\" \/>\n<meta property=\"article:published_time\" content=\"2021-08-01T12:00:16+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-11-23T15:16:32+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.improvemysearchranking.com\/wp-content\/uploads\/2021\/08\/Google-indexing-1.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1280\" \/>\n\t<meta property=\"og:image:height\" content=\"853\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Howard\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@ImproveMySearch\" \/>\n<meta name=\"twitter:site\" content=\"@ImproveMySearch\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Howard\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.improvemysearchranking.com\/normal-20-site-unindexed-google-says\/\",\"url\":\"https:\/\/www.improvemysearchranking.com\/normal-20-site-unindexed-google-says\/\",\"name\":\"It\u2019s normal to have 20% of your site unindexed, Google says\",\"isPartOf\":{\"@id\":\"https:\/\/www.improvemysearchranking.com\/#website\"},\"datePublished\":\"2021-08-01T12:00:16+00:00\",\"dateModified\":\"2023-11-23T15:16:32+00:00\",\"author\":{\"@id\":\"https:\/\/www.improvemysearchranking.com\/#\/schema\/person\/8b86fcb272c87a525fd140a0d5ba5774\"},\"description\":\"Google search crawlers do not index all the pages on your website. You will notice that these pages are being discovered but not crawled.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.improvemysearchranking.com\/normal-20-site-unindexed-google-says\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.improvemysearchranking.com\/normal-20-site-unindexed-google-says\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.improvemysearchranking.com\/normal-20-site-unindexed-google-says\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.improvemysearchranking.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"It\u2019s normal to have 20% of your site unindexed, Google says\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.improvemysearchranking.com\/#website\",\"url\":\"https:\/\/www.improvemysearchranking.com\/\",\"name\":\"Improve My Search Ranking\",\"description\":\"Improve My Search Ranking\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.improvemysearchranking.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.improvemysearchranking.com\/#\/schema\/person\/8b86fcb272c87a525fd140a0d5ba5774\",\"name\":\"Howard\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/www.improvemysearchranking.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/4c87fb3682926fa84b2b397e5633b404?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/4c87fb3682926fa84b2b397e5633b404?s=96&d=mm&r=g\",\"caption\":\"Howard\"},\"url\":\"https:\/\/www.improvemysearchranking.com\/author\/howard\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"It\u2019s normal to have 20% of your site unindexed, Google says","description":"Google search crawlers do not index all the pages on your website. You will notice that these pages are being discovered but not crawled.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.improvemysearchranking.com\/normal-20-site-unindexed-google-says\/","og_locale":"en_GB","og_type":"article","og_title":"It\u2019s normal to have 20% of your site unindexed, Google says","og_description":"Google search crawlers do not index all the pages on your website. You will notice that these pages are being discovered but not crawled.","og_url":"https:\/\/www.improvemysearchranking.com\/normal-20-site-unindexed-google-says\/","og_site_name":"Improve My Search Ranking","article_publisher":"https:\/\/www.facebook.com\/ImproveMySearchRanking","article_published_time":"2021-08-01T12:00:16+00:00","article_modified_time":"2023-11-23T15:16:32+00:00","og_image":[{"width":1280,"height":853,"url":"https:\/\/www.improvemysearchranking.com\/wp-content\/uploads\/2021\/08\/Google-indexing-1.jpg","type":"image\/jpeg"}],"author":"Howard","twitter_card":"summary_large_image","twitter_creator":"@ImproveMySearch","twitter_site":"@ImproveMySearch","twitter_misc":{"Written by":"Howard","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.improvemysearchranking.com\/normal-20-site-unindexed-google-says\/","url":"https:\/\/www.improvemysearchranking.com\/normal-20-site-unindexed-google-says\/","name":"It\u2019s normal to have 20% of your site unindexed, Google says","isPartOf":{"@id":"https:\/\/www.improvemysearchranking.com\/#website"},"datePublished":"2021-08-01T12:00:16+00:00","dateModified":"2023-11-23T15:16:32+00:00","author":{"@id":"https:\/\/www.improvemysearchranking.com\/#\/schema\/person\/8b86fcb272c87a525fd140a0d5ba5774"},"description":"Google search crawlers do not index all the pages on your website. You will notice that these pages are being discovered but not crawled.","breadcrumb":{"@id":"https:\/\/www.improvemysearchranking.com\/normal-20-site-unindexed-google-says\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.improvemysearchranking.com\/normal-20-site-unindexed-google-says\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.improvemysearchranking.com\/normal-20-site-unindexed-google-says\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.improvemysearchranking.com\/"},{"@type":"ListItem","position":2,"name":"It\u2019s normal to have 20% of your site unindexed, Google says"}]},{"@type":"WebSite","@id":"https:\/\/www.improvemysearchranking.com\/#website","url":"https:\/\/www.improvemysearchranking.com\/","name":"Improve My Search Ranking","description":"Improve My Search Ranking","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.improvemysearchranking.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-GB"},{"@type":"Person","@id":"https:\/\/www.improvemysearchranking.com\/#\/schema\/person\/8b86fcb272c87a525fd140a0d5ba5774","name":"Howard","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/www.improvemysearchranking.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/4c87fb3682926fa84b2b397e5633b404?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/4c87fb3682926fa84b2b397e5633b404?s=96&d=mm&r=g","caption":"Howard"},"url":"https:\/\/www.improvemysearchranking.com\/author\/howard\/"}]}},"_links":{"self":[{"href":"https:\/\/www.improvemysearchranking.com\/wp-json\/wp\/v2\/posts\/16218"}],"collection":[{"href":"https:\/\/www.improvemysearchranking.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.improvemysearchranking.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.improvemysearchranking.com\/wp-json\/wp\/v2\/users\/12"}],"replies":[{"embeddable":true,"href":"https:\/\/www.improvemysearchranking.com\/wp-json\/wp\/v2\/comments?post=16218"}],"version-history":[{"count":1,"href":"https:\/\/www.improvemysearchranking.com\/wp-json\/wp\/v2\/posts\/16218\/revisions"}],"predecessor-version":[{"id":22486,"href":"https:\/\/www.improvemysearchranking.com\/wp-json\/wp\/v2\/posts\/16218\/revisions\/22486"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.improvemysearchranking.com\/wp-json\/wp\/v2\/media\/17309"}],"wp:attachment":[{"href":"https:\/\/www.improvemysearchranking.com\/wp-json\/wp\/v2\/media?parent=16218"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.improvemysearchranking.com\/wp-json\/wp\/v2\/categories?post=16218"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.improvemysearchranking.com\/wp-json\/wp\/v2\/tags?post=16218"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}