Re: Allow robot access to protected content
- From: John Bokma <john@xxxxxxxxxxxxxxx>
- Date: 7 Jun 2006 20:59:08 GMT
"Sholom" <sdeen@xxxxxxxxxxxx> wrote:
Thanks to all for the replies. I had no idea this was such a sensitive
Of course it is. Do you like it when on Google's SERP it appears that the
content is freely available and next you're greeted with a register page?
(As an aside, re the cache issue, I was under the impression that a
"robots=nocache" meta tag prevents the search engine from showing a
Yup, that's cloaking, and I report it when I see it.
John Freelance Perl programmer: http://castleamber.com/
Creating a customized Command Prompt shortcut: