The Google Webmaster Central Blog announced that Google prevent feeds from being returned in Google’s search results with the exception of podcast feeds.
As a webmaster, you may have been concerned about your RSS/Atom feeds crowding out their associated HTML pages in Google’s search results. By serving feeds, we could cause a poor user experience:
- Feeds increase the likelihood that users see duplicate search results.
- Users clicking on a feed may miss valuable content available only in the HTML page.
We continue to allow podcasts, because we noticed a significant number of them are standalone documents (i.e. no HTML page has the same content) or they have more complete item descriptions than the associated HTML page. However, if, as a webmaster, you’d like your podcasts to be excluded from Google’s search results (e.g. if you have a vlog, its feed is probably a podcast), you can use Yahoo’s spec for noindex feeds. If you use FeedBurner, making your podcast noindex is as simple as checking a box (“Noindex” under the “Publicize” tab).
We’re aware that there are a few non-podcast feeds out there with no associated HTML pages, and thus removing these feeds for now from the search results might be less than ideal. We remain open to other feedback on how to improve the handling of feeds, and especially welcome your comments and questions in the Crawling, Indexing and Ranking subtopic of our Webmaster Help Group.
A quick way to tell if RSS feeds are out of the index, is to do a site command on a popular RSS feed producer, FeedBurner. Google shows zero results for the site:feeds.feedburner.com command, while Yahoo shows me 8,461,464 results.