Allow robot access to protected content
- From: "Sholom" <sdeen@xxxxxxxxxxxx>
- Date: 7 Jun 2006 11:54:28 -0700
Anyone know how to allow Google's robots to index protected content?
My company has a site that requires a subscription to access the info,
but we'd like to have google index those pages. I see there are many
sites who've managed this.
I can't allow by user-agent since my authentication software doesn't
allow that. Is there any way to give Google a username and password? Or
is there an IP, or range of IPs, that google uses?