[mythtv-users] visit from googlebot
lists at Thyroff.net
Sat Sep 30 20:33:51 UTC 2006
> What happened? Did everything get deleted? Maybe mythweb should
> include a robots.txt to keep this from happeneing?
I am not sure if the googlebot is the worst thing that can happen if
you have a public mythweb page; don't leave your mythweb unprotected!
Instead of a default robots.txt maybe better would be a
default .htaccess that disallows all access, so that you have to think
about that before you can use it.
More information about the mythtv-users