[BNM] Is a robots.txt file necessary for SEO?
AndrewGill73@gmail.com
andrewgill73 at gmail.com
Tue May 30 16:17:51 BST 2006
Until recently I havent bothered including a robots.txt file in any
websites. Search engines spidered these websites ok.
After reading so many recommendations on the web about SEO, I've added a
robots.txt file containing just two lines (below) which apparently will mean
that search engines will spider the website (it was happening anyway).
Robots.txt just contains:
User-agent: *
Disallow:
Does anybody know whether I will see a noticeable difference in traffic or
will it be exactly the same?
Should i spend time adding this file to all websites in the future or is
this just a waste of time?
Cheers
Andy
_______________________________________
Andrew Gill
Mobile: +44 7880 730096 | Skype: andrewgill73 |
http://www.linkedin.com/in/andrewgill
More information about the BNMList mailing list
BNMList is hosted by Screenlists, a Screen-Play.net service