Page 1 of 2 12 LastLast
Results 1 to 20 of 24
  1. #1
    PaulEchere's Avatar
    PaulEchere is offline Private Member
    Join Date
    June 2020
    Posts
    565
    Thanks
    67
    Thanked 177 Times in 136 Posts

    Default Pages aren't getting discovered or indexed

    Around three months ago I put up a website that has quite a lot of pages (~2k), however to this day Google only has 20 of them indexed.

    The sitemap is submitted successfully and G does see the correct number of pages on it. Now, I would probably not mind if pages were getting discovered but not indexed, however in my case G discovered the first 20 pages in the first week and then nothing for months after that.

    Was wondering if there is something I might not know here (potentially can do) or whetehr it is still just an annoying matter of time.

  2. #2
    baldidiot is offline Private Member
    Join Date
    January 2010
    Posts
    4,977
    Thanks
    427
    Thanked 2,271 Times in 1,510 Posts

    Default

    Are the pages real content or auto generated? Just thinking that 2k pages sounds like it might not be 2k articles. If it's just data or other thin pages then google might not bother indexing it if it doesn't see value, especially if they all suddenly appeared overnight.

    Age plays a big factor as well. Three months isn't that old...

    Look in GWT and see what the crawl rate is, both for refresh and discovery. If you have a decent refresh rate but discovery is low then it'll probably pick it up in time. If the refresh rate is also low then you might want to try and get that up.

    Couple of links to non-indexed pages could help as well.
    onlinegamblingwebsites.com - Formally known as goodbonusguide.

    Gambling Domains: Small clear out of some of the domains we've been hoarding on Dan - see the list here. Prices negotiable, and willing to swap for decent links.

  3. The Following 2 Users Say Thank You to baldidiot For This Useful Post:

    edgarf76 (1 May 2023), PaulEchere (19 April 2023)

  4. #3
    Mattbar's Avatar
    Mattbar is offline Private Member
    Join Date
    July 2015
    Location
    London
    Posts
    1,215
    Thanks
    108
    Thanked 835 Times in 516 Posts

    Default

    Quote Originally Posted by baldidiot View Post

    Couple of links to non-indexed pages could help as well.
    Yes, that was what I was going to suggest. Get a few links to the non-indexed articles and see if that gives google a bump to increase the discovery and crawl rate. I've done this in similar situations and it often helps.

  5. The Following User Says Thank You to Mattbar For This Useful Post:

    PaulEchere (19 April 2023)

  6. #4
    AceHigh Pino's Avatar
    AceHigh Pino is offline Private Member
    Join Date
    September 2007
    Location
    Arizona
    Posts
    145
    Thanks
    86
    Thanked 42 Times in 29 Posts

    Default

    I've been all over the map with a site of mine that's been doing this for well over a year now. I had to go back and fix a **** ton of thin content, sometimes even re-writing whole pages and sections of the site. It went from 50 pages indexed last year to 227 this year and then to 98 and now to 174 -- seems like there's been more and more movement has been happening on this most recent Google core update, lol.

  7. #5
    edgarf76's Avatar
    edgarf76 is offline Private Member
    Join Date
    March 2013
    Location
    Montreal
    Posts
    2,175
    Thanks
    798
    Thanked 580 Times in 427 Posts

    Default

    I have the same problem. The way I looked at it is Google basically doesn't respect the content, I had it re-wrote and submitted for manual indexing. It worked most of the time. I am still working through these.

  8. #6
    xecutable's Avatar
    xecutable is offline Private Member
    Join Date
    March 2011
    Location
    Zurich, Switzerland
    Posts
    1,937
    Thanks
    571
    Thanked 1,190 Times in 689 Posts

    Default

    Quote Originally Posted by edgarf76 View Post
    I have the same problem. The way I looked at it is Google basically doesn't respect the content, I had it re-wrote and submitted for manual indexing. It worked most of the time. I am still working through these.
    I had the same issue months ago. At first I thought it's the rewriting, but they were perfectly good articles, so I gave it a try on just manually resubmitting (without touching the content). It worked flawlessly for 100% of the things I submitted. Too bad there's like a 10 page daily limit and it took a month and a half.

    Went around searching for a probable cause and it turns out Google had indexing issues on a few occasions and most likely I was one of the affected ones.

  9. The Following User Says Thank You to xecutable For This Useful Post:

    edgarf76 (19 April 2023)

  10. #7
    Ninja16 is offline Public Member
    Join Date
    July 2018
    Posts
    70
    Blog Entries
    3
    Thanks
    38
    Thanked 15 Times in 12 Posts

    Default

    I have the same issue for a long time. My situatiaon is a bit different. I have AMP pages. All pages indexed but in search console in amp section some of them dissapear. What i assume is thin contents is enough to be indexed but not enough to be indexed for AMP Pages. Strong Pages never disapear but the thin ones does. So i think its about content. You may need to rewrite or add more content to pages.

  11. #8
    Moiz is offline Public Member
    Join Date
    April 2023
    Posts
    13
    Thanks
    0
    Thanked 1 Time in 1 Post

    Default

    if you have a news page most likely it will be indexed.

  12. #9
    xecutable's Avatar
    xecutable is offline Private Member
    Join Date
    March 2011
    Location
    Zurich, Switzerland
    Posts
    1,937
    Thanks
    571
    Thanked 1,190 Times in 689 Posts

    Default

    Ok, so all of the sudden the console reports 80 pages not indexed. Started wondering what's happening again, submit manually 10 until the quota and went around looking for videos to get an answer (perhaps).

    Watched a guy that said it was a search console issue and that it was out of sync and to do a "site:yoururl keyword" where the keyword is the title of the "deindexed url and wow indeed it is a search console issue. All of the urls are still in the index but the console returns them as not indexed for w/e reason.

    So don't trust what you see in the console. Do a "site:url keyword" to double check they are indeed NOT indexed.

  13. The Following 2 Users Say Thank You to xecutable For This Useful Post:

    chaumi (30 April 2023), PaulEchere (1 May 2023)

  14. #10
    baldidiot is offline Private Member
    Join Date
    January 2010
    Posts
    4,977
    Thanks
    427
    Thanked 2,271 Times in 1,510 Posts

    Default

    Quote Originally Posted by xecutable View Post
    Watched a guy that said it was a search console issue and that it was out of sync and to do a "site:yoururl keyword" where the keyword is the title of the "deindexed url and wow indeed it is a search console issue. All of the urls are still in the index but the console returns them as not indexed for w/e reason.

    So don't trust what you see in the console. Do a "site:url keyword" to double check they are indeed NOT indexed.
    Yeah this seems to be relatively common these days, especially on newer sites.

    Something else I've noticed on these sites is that sometimes it won't show up for the "site:FULL-URL" search but if you search the page title it will. So the site:url query says it's not indexed but it actually is.
    onlinegamblingwebsites.com - Formally known as goodbonusguide.

    Gambling Domains: Small clear out of some of the domains we've been hoarding on Dan - see the list here. Prices negotiable, and willing to swap for decent links.

  15. #11
    xecutable's Avatar
    xecutable is offline Private Member
    Join Date
    March 2011
    Location
    Zurich, Switzerland
    Posts
    1,937
    Thanks
    571
    Thanked 1,190 Times in 689 Posts

    Default

    Quote Originally Posted by baldidiot View Post
    Yeah this seems to be relatively common these days, especially on newer sites.

    Something else I've noticed on these sites is that sometimes it won't show up for the "site:FULL-URL" search but if you search the page title it will. So the site:url query says it's not indexed but it actually is.
    Yup I can confirm this is the case. Turns out all of these errors could potentially be a nonsense as it's my case right now. Instead of helping webmasters this seems to be causing confusion and in some cases from what I'm reading in the comment section on various forums panic.

  16. #12
    eenzoo's Avatar
    eenzoo is offline Private Member
    Join Date
    November 2014
    Location
    Bella Italia
    Posts
    1,427
    Thanks
    506
    Thanked 1,035 Times in 622 Posts

    Default

    Imho ... it's all a question of parts of EEAT ... in that case it's Authority and Trust.
    If you would be the Authority in your field, G would index you in a matter of seconds.
    I do think, meanwhile Google is sooo bloated, that they have, resources wise, consider what to index and what not.
    If you are site #12.334.999 on sports betting but not able to positioning your site as one of the best possible sources, why they should consider to index another article.

    I have the same problem but different, if you buy links on budget for one special project, you have to consider toi buy one or two powerful links from Authorities, or 8-10 links from sites, lets call them "unnecessary".

    If you go the second route, you have the problem that your links you bought don't get indexed, which makes them absolutely useless.
    So I were looking for the best way to get those pages indexed. Maybe that can help you too searchlogistics.com/learn/seo/link-building/backlink-indexers-test/

  17. #13
    GameLandiaLtd's Avatar
    GameLandiaLtd is offline Private Member
    Join Date
    October 2022
    Location
    Sofia
    Posts
    9
    Thanks
    0
    Thanked 1 Time in 1 Post

    Default

    We also have this problem, but we managed to realize many pages in a short time. It takes Google time to index them automatically, as they say, doing it by the "hour." The self-indexing option in Google Console will also help to boost the indexing process. When the indexed content accumulates over time, you will literally believe in Winnie the Pooh's saying - the more, the more, the merrier!

  18. #14
    universal4's Avatar
    universal4 is online now Forum Administrator
    Join Date
    July 2003
    Location
    Courage is being scared to death...and saddling up anyway. John Wayne
    Posts
    31,789
    Thanks
    3,643
    Thanked 8,677 Times in 5,532 Posts

    Default

    I wonder if any of this has to do with the fact they are getting ready to drop the "page experience".
    Notice: The page experience report will be changing in the coming months. Read more
    I find it interesting they want to drop page experience, even though they have a higher percentage of that reported to folks that use the GSC and move to the "Core Web Vitals" report that they do not report for tens of millions of website in the GSC.

    Maybe the slow down or lack of reporting of the indexed pages has to do with the changes coming?

    Rick
    Universal4

  19. #15
    content is offline Public Member
    Join Date
    September 2023
    Posts
    89
    Thanks
    22
    Thanked 34 Times in 26 Posts

    Default

    Now it's been a few more months since you made this thread, do you have an update on this?
    Curious if they've picked up more of the pages by now.

    I manually submit pages in GSC everyday, and I found they were indexing nearly all of them after I submitted my site map. Though more recently I found some of the newer content I have been making is not being indexed(not a duplicate content error or something, just not indexed even after requesting in GSC, says it's been requested and passes the page scan for "can be indexed" but just isn't anyway).

    I definitely agree it is EEAT issue as my less competitive pages in the same general categories never have the problem. Not really expecting the more competitive term pages to rank for much of anything, but I put some work into some of them and thought in the least maybe having them was good for "topical authority" in the long run, or maybe might show up for specific searches with the same wording as wording used in my articles even if not really a good source of seo traffic. A vast majority of my content is indexed, though I do the manual submissions daily event though it doesn't work for some of the more general pages, the issue seems to only effect more competitive general search term titled articles even if the article is 3,000 words+(again, guessing they just don't need another page on the topic, but still figured was better to cover it than not). Not really a big deal since still most is getting successfully indexed, which is good enough, though sorta hoping maybe in the long run those pages might get picked up as my site grows.

    Anyway, I'm wondering if in time since then, if more of those pages of your site got picked up or not

  20. #16
    PaulEchere's Avatar
    PaulEchere is offline Private Member
    Join Date
    June 2020
    Posts
    565
    Thanks
    67
    Thanked 177 Times in 136 Posts

    Default

    I manually submitted all the pages that I mostly cared about and those got indexed quite quickly. Although, additional pages have also been indexed since then. Of course not all of them, but right now there are about 700 indexed pages - 50 of which I submitted manually before.

  21. #17
    chaumi is offline Private Member
    Join Date
    October 2013
    Location
    East Midlands
    Posts
    1,508
    Thanks
    505
    Thanked 784 Times in 573 Posts

    Default

    You can't really equate Paul's to yours though, Content. Well, not with any real level of value. If I'm 'guessing' the site involved correctly, and assuming my detective skills are not desperately poor (which they may be in this case), it has (or appears to have) a very different history to yours. A history which may well have been playing a big part in its early (and possibly ongoing) performance.
    Last edited by chaumi; 2 October 2023 at 3:52 am.

  22. #18
    dachin is offline Private Member
    Join Date
    September 2023
    Location
    Japan
    Posts
    14
    Thanks
    0
    Thanked 2 Times in 2 Posts

    Default

    Whenever I write an article, I index it in Search Console. You may already know this, but I wanted to comment.

  23. #19
    baldidiot is offline Private Member
    Join Date
    January 2010
    Posts
    4,977
    Thanks
    427
    Thanked 2,271 Times in 1,510 Posts

    Default

    Quote Originally Posted by PaulEchere View Post
    I manually submitted all the pages that I mostly cared about and those got indexed quite quickly. Although, additional pages have also been indexed since then. Of course not all of them, but right now there are about 700 indexed pages - 50 of which I submitted manually before.
    We've been testing out omega indexer more recently. It seems to be 50-50 at the moment. For some sites it immediately indexes them, others it doesn't help at all. My guess would be that it relates to the sites crawl budget - if the site has a sufficient crawl budget to index the urls, then the indexer can help it find them, but if the site doesn't then it won't help.

    If you want me to test some urls to see if it would help just pop me over a small list.
    onlinegamblingwebsites.com - Formally known as goodbonusguide.

    Gambling Domains: Small clear out of some of the domains we've been hoarding on Dan - see the list here. Prices negotiable, and willing to swap for decent links.

  24. #20
    chaumi is offline Private Member
    Join Date
    October 2013
    Location
    East Midlands
    Posts
    1,508
    Thanks
    505
    Thanked 784 Times in 573 Posts

    Default

    This one's probably worth a try. Getting good reported results within some groups who know what they're doing.

    Don't take too much notice of the simplicity of the site, there's a pretty big/trustworthy SEO industry name behind it...

    powerindexing.online

Page 1 of 2 12 LastLast

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •