SEO Tip #136: Why Aren’t Geographic Target and Query Parameters Specified in Robots.txt

SEO Tip #136: Why Aren’t Geographic Target and Query Parameters Specified in Robots.txt

Matt Cutts: I understand the question but you have to be a little bit careful. You don’t want to throw everything in the kitchen sink into the Robots.txt file. The Robots.txt predates even Google and it’s really well established and there are parts of that txt code that a lot of people rely on. So typically it’s better to not necessarily go in and monkey with something that’s well understood
Continue Reading »

Google SEO Tip #5 – Can I use Robots.txt to Optimize Google’s Crawl?

Google SEO Tip #5 – Can I use Robots.txt to Optimize Google’s Crawl?

Matt Cutts: This is another one of those NOOO kind of videos. I swear I had completely brown hair until you asked this question and then suddenly gray just popped in like that. That’s where the gray came from, really.

So no, please don’t use robots.txt in an attempt to sort of shunt Googlebot all the way over to one section of a website, but only for


Continue Reading »