If I don’t need to block crawlers, should I create a robots.txt file?

If I dont need to block crawlers should I create a robots.txt file If I dont need to block crawlers, should I create a robots.txt file? If I don't need to block crawlers, should I create a robots.txt file? Is it better to have a blank robots.txt file, a robots.txt that contains User-agent: * Disallow:" or no robots.txt file at all?" Corey S, Pennsylvania Have a question? Ask it in our Webmaster Help Forum: www.google.com Want your question to be answered on a video like this? Follow us on Twitter and look for an announcement when we take new questions: twitter.com More videos: www.youtube.com Webmaster Central Blog: googlewebmastercentral.blogspot.com Webmaster Central: www.google.com

Watch The Video

Written by

Driving down the Information Superhighway is a daunting task for anyone that does not already know the roads. Luckily, Dustin Salmons of Brand Personalization invites you along for the ride to travel down the paths you don't understand and some that you didn't even know existed. Dustin has been paving the way since 1996 even before the Internet was known as the Information Superhighway. Dustin has been blazing the trail regardless if he was consulting multinational corporations were learning the best ways to get his own retail stores found online. Even now that the roads are nicely paved it is difficult to read the signs. Many people's fear of getting off the wrong exit prevents them from starting their journey in the first place. While the roads may seem foreign at first, with the right guide that can translate in simple to understand terms, will help you to venture out on your own. Regardless if you choose to do everything completely by yourself or with assistance, you will now have the information that you need. Even if you choose to take the route of service providers, it is still important to understand what they are doing and why. So, regardless if you would like to learn more about social media or Search Engine Optimization, or Online Branding in general, Dustin will light your path and hold your hand along the way. Dustin gives you the keys every week to travel down the road of success so buckle up and enjoy the ride!

No Comments Yet.

Leave a Reply

You must be logged in to post a comment.