Optimize your 'crawling, indexing & ranking' issues

Questions about website architecture, crawling and indexing, and even ranking issues can be boiled down to one central issue: How easy is it for search engines to crawl your site? Google has a finite number of resources, Googlebot’s only able to find and crawl a percentage of that content. URLs are like the bridges between your […]

Questions about website architecture, crawling and indexing, and even ranking issues can be boiled down to one central issue: How easy is it for search engines to crawl your site? Google has a finite number of resources, Googlebot’s only able to find and crawl a percentage of that content. URLs are like the bridges between your website and a search engine's crawler. In the slides below, you can see some real-life examples of homegrown URL hacks and encodings, parameters masquerading as part of the URL path, infinite crawl spaces, and more. You'll also find some recommendations for straightening out that labyrinth of URLs and helping crawlers find more of your content faster: