October 18, 2008
3:56 am

Google has replaced the noindex style command with a new line into their robots.txt files, that makes Google Profiles crawlable by search engines, which until now, were hidden from search engines indexes. The new entry tells search engines to use “http://www.gstatic.com/s2/sitemaps/profiles-sitemap.xml” as a sitemap. The sitemap looks something like this:

http://www.gstatic.com/s2/sitemaps/sitemap-000.txt
2008-10-15

http://www.gstatic.com/s2/sitemaps/sitemap-001.txt
2008-10-15

Source:→ ZDNet

Loading

Contextual Related Posts:

No followup yet

Leave a Response

Comment Preview
« First Click Free: Find, get indexed your restricted contents in Google SearchAdvanced Windows task management with MKN TaskExplorer »
Feed Icon

Subscribe via RSS or email: