Looking to see how much of the robots.txt file is honoured/followed, I have placed a link within the robots.txt file here and more importantly over at http://www.deancruddace.co.uk/robots.txt to see if the URL within that file gets picked up and indexed, knowing fine well that the site receives rare bot traffic I thought I would drop a hint through posting here to give the search bots a little nudge.