Google SEO Tip #5 – Can I use Robots.txt to Optimize Google’s Crawl?
Matt Cutts: This is another one of those NOOO kind of videos. I swear I had completely brown hair until you asked this question and then suddenly gray just popped in like that. That’s where the gray came from, really.
So no, please don’t use robots.txt in an attempt to sort of shunt Googlebot all the way over to one section of a website, but only for
Continue Reading »