| View previous topic :: View next topic |
|
|
|
| Author |
Message |
Mel
Site Admin
Joined: 03 Sep 2003
Posts: 9060
|
Posted: Wed Mar 08, 2006 1:12 pm
|
 
|
| Post subject: Google Problem with supplemental pages |
|
|
It seems that over the past few days many webmasters have noticed a significant proportion of their pages going into the supplementa index for no apparent reason.
Googleguy has acknowledged that there is a problem, and expects it to be cleaned up within a week or so.
It might be a good idea to check your pages with a site: search to see if this is happening to you.
<added>
While this may or may not be related (it is in a the same timeframe) SEOchat forums appear to have been dumped from the google index. |
_________________
Expert SEO Services - Buy Cheap Used Cars
Last edited by Mel on Wed Mar 08, 2006 1:34 pm; edited 1 time in total |
|
| Back to top |
|
 |
CrankyDave
Moderator
Joined: 12 Dec 2005
Posts: 3230
Location: Playing with fire!
|
|
Posted: Wed Mar 08, 2006 1:34 pm
|
|
| Post subject: |
|
|
What I'm seeing is the majority of my pages (75%) go to a URL only partially indexed page.
Dave |
|
|
| Back to top |
|
|
Mel
Site Admin
Joined: 03 Sep 2003
Posts: 9060
|
|
Posted: Wed Mar 08, 2006 1:59 pm
|
|
| Post subject: |
|
|
| I am seeing about 25% of one sites pages go supplemental - these are pages that have been up for years in some cases, used to rank OK and in most cases have been updated in the past few months. |
_________________
Expert SEO Services - Buy Cheap Used Cars |
|
| Back to top |
|
|
CrankyDave
Moderator
Joined: 12 Dec 2005
Posts: 3230
Location: Playing with fire!
|
|
Posted: Wed Mar 08, 2006 2:28 pm
|
|
| Post subject: |
|
|
| Mel wrote: |
| I am seeing about 25% of one sites pages go supplemental - these are pages that have been up for years in some cases, used to rank OK and in most cases have been updated in the past few months. |
The pages that went partial have been up and indexed for for almost 2 years as well. Some with #1 rankings that are now gone.
Dave |
|
|
| Back to top |
|
|
Mel
Site Admin
Joined: 03 Sep 2003
Posts: 9060
|
|
Posted: Wed Mar 08, 2006 2:48 pm
|
|
| Post subject: |
|
|
Lets hope that Googleguys "fix" includes this sort of stuff, as I can see no reason that any of those pages should go supplemental - except that there have been multiple copies of at least some of these pages which have been purloined and floating around on other sites.
Could it be that these pages are being hit as duplicate pages (even though they are original and the first published) due to copies on other sites???  |
_________________
Expert SEO Services - Buy Cheap Used Cars |
|
| Back to top |
|
|
CrankyDave
Moderator
Joined: 12 Dec 2005
Posts: 3230
Location: Playing with fire!
|
|
Posted: Wed Mar 08, 2006 3:19 pm
|
|
| Post subject: |
|
|
| Mel wrote: |
Lets hope that Googleguys "fix" includes this sort of stuff, as I can see no reason that any of those pages should go supplemental - except that there have been multiple copies of at least some of these pages which have been purloined and floating around on other sites.
Could it be that these pages are being hit as duplicate pages (even though they are original and the first published) due to copies on other sites??? |
Interesting thought. I believe that a filter for duplicate content is applied at intervals and not continuously. Perhaps this is time for that cycle and the results aren't quite what was expected.
Mel, are you aware of any duplicated content that has not slipped to supplemental whereas the original has?
Yes, lets hope they "fix" this soon. Given the blunders this past week by the CFO, one has to wonder if Google knows how Google is supposed to work.
Dave |
|
|
| Back to top |
|
|
Mel
Site Admin
Joined: 03 Sep 2003
Posts: 9060
|
|
Posted: Wed Mar 08, 2006 3:41 pm
|
|
| Post subject: |
|
|
| I am going to carve out some time to compare the pages that have slipped vs. those that haven't in the next day or so. |
_________________
Expert SEO Services - Buy Cheap Used Cars |
|
| Back to top |
|
|
WilliamC
Moderator
Joined: 07 Dec 2003
Posts: 9911
Location: On a Mountain
|
|
| Back to top |
|
|
CrankyDave
Moderator
Joined: 12 Dec 2005
Posts: 3230
Location: Playing with fire!
|
|
Posted: Wed Mar 08, 2006 7:15 pm
|
|
| Post subject: |
|
|
I just checked 50+ IP's/DC's and found that 19 of them are having "issues" when it comes to my site.
In those 19 IP's/DC's only 91-96 out of 643 pages are fully indexed and cached with the rest of the pages being URL only partially indexed.
These 19 IP's/DC's are...
64.233.189.104
216.239.53.99
216.239.57.99
216.239.59.99
66.102.11.99
66.102.9.99
66.102.7.99
216.239.59.104
216.239.53.104
66.102.11.104
66.102.9.104
66.102.7.104
216.239.57.98
216.239.57.105
216.239.59.105
66.102.7.105
66.102.7.147
216.239.57.147
216.239.57.98
On the surface, it appears if they're trying to rebuild their index from scratch.
Dave |
|
|
| Back to top |
|
|
CrankyDave
Moderator
Joined: 12 Dec 2005
Posts: 3230
Location: Playing with fire!
|
|
Posted: Wed Mar 08, 2006 10:45 pm
|
|
| Post subject: |
|
|
I went through and checked several of the top ranked sites for KP's I follow on some of the IP's/DC's I listed above. All of the sites had scores of pages placed in the supplemental index.
<edit to add>
This appears to be a far more reaching issue than possible problems with duplicate content filtering or 301 pages. Far too many pages being placed in the supplemental index from what I see.
</edit>
Dave |
|
|
| Back to top |
|
|
Tsyle
Member
Joined: 24 Feb 2006
Posts: 46
|
|
Posted: Thu Mar 09, 2006 12:19 am
|
|
| Post subject: |
|
|
| This might be a newbie question, but what does it mean for the site to go into supplemental index? |
|
|
| Back to top |
|
|
Mel
Site Admin
Joined: 03 Sep 2003
Posts: 9060
|
|
Posted: Thu Mar 09, 2006 1:11 am
|
|
| Post subject: |
|
|
The supplemental index is the very last place Google looks for pages to satisfy a query. First they go to the short barrels, if they find enough ranking pool candidates there (originally they were looking for 40,000 pages but it may well be more now) then they look no further and proceed to rank those pages for the query.
If they don't find enough there, then they go to the long barrels for ranking pool candidates.
Only if they don't find enough pages from the combination of the short and long barrels do they try the supplemental index.
In a nutshell the only thing any supplemental pages ever rank for are strage and usual queries. |
_________________
Expert SEO Services - Buy Cheap Used Cars |
|
| Back to top |
|
|
Mel
Site Admin
Joined: 03 Sep 2003
Posts: 9060
|
|
Posted: Thu Mar 09, 2006 6:21 am
|
|
| Post subject: |
|
|
OK I have had a bit of time to look into this problem on one site and find in this case that all the pages which are in the supplemental index are old pages that do not actually exist any longer (due to a site reorganization eight months ago) and which were 301'd to a new location with new content in most cases.
This confirms WilliamC comments about Big Daddy putting 301'd pages into the supplemental index.
I have verified that clicking on the supplemental listed link does indeed take you to the new page and that it does return a proper 301 response, so it looks like this is a case of Google not handling 301's correctly.
| Quote: |
#1 Server Response: http://www.xxxxxx.xxx
HTTP Status Code: HTTP/1.1 301 Moved Permanently
Date: Thu, 09 Mar 2006 06:14:10 GMT
Server: Apache/1.3.33 (Unix) mod_auth_passthrough/1.8 mod_log_bytes/1.2 mod_bwlimited/1.4 PHP/4.3.10 FrontPage/5.0.2.2635 mod_ssl/2.8.22 OpenSSL/0.9.6b
X-Powered-By: PHP/4.3.10
Location: http://xxxxx.xxx
Connection: close
Content-Type: text/html
Redirect Target: http://xxxxx.xxx
#2 Server Response: http://xxxxx.xxx
HTTP Status Code: HTTP/1.1 200 OK
Date: Thu, 09 Mar 2006 06:14:11 GMT
Server: Apache/1.3.33 (Unix) mod_auth_passthrough/1.8 mod_log_bytes/1.2 mod_bwlimited/1.4 PHP/4.3.10 FrontPage/5.0.2.2635 mod_ssl/2.8.22 OpenSSL/0.9.6b
X-Powered-By: PHP/4.3.10
Connection: close
Content-Type: text/html
|
|
_________________
Expert SEO Services - Buy Cheap Used Cars |
|
| Back to top |
|
|
timbo
Advanced Member
Joined: 07 Aug 2004
Posts: 440
Location: Australia
|
|
Posted: Thu Mar 09, 2006 6:45 am
|
|
| Post subject: |
|
|
Post by Googleguy on Webmaster World:
| Quote: |
| Hey, I wanted to stop by and give an update. I think we found what the immediate issue was. Future indexing should start picking up most affected people's pages again, though it may take a few more days for it to be visible. I'll check in again after the weekend is over to see if most people are seeing pages returning. |
|
_________________
search engine marketing | online coupons |
|
| Back to top |
|
|
Mel
Site Admin
Joined: 03 Sep 2003
Posts: 9060
|
|
Posted: Thu Mar 09, 2006 6:54 am
|
|
| Post subject: |
|
|
Thats good news Timbo, but I guess the big question is why the hell did it happen in the first place.
Don't they test out these changes before they go live with them??? |
_________________
Expert SEO Services - Buy Cheap Used Cars |
|
| Back to top |
|
|
|
|
|
|
