Re: Do HTTP headers get spidered?



__/ [ canadafred ] on Friday 31 March 2006 21:29 \__

"Roy Schestowitz" <newsgroups@xxxxxxxxxxxxxxx> wrote in message
news:5155077.qVxqJIUKLR@xxxxxxxxxxxxxxxxxx

Im using classic ASP.
Do strings in my HTTP headers get spidered.

No, but they should be interpreted for instructions, I imagine.

Code should always be considered visible to an intelligent spider.

By "spidered", I suppose the intent is to say "recorded", in which case
the
answer is probably not. However, it would be nice to keep track of
redirection information. That might get stored in the crawler's server,
but
never made public. No-one knows. Not me anyway...


Should I have my HTTP headers show
search engine optimization type strings?

I suppose it depends on the intent; whether you want to manipulate the
search engine or simply guide it.

How do you reckon you can SEO HTTP header? Identify oneself as the key
words?

I was refering to tags like <meta http-equiv="Keywords" content="">

Ahh... that's different. It's embedded in the page itself rather than
associated with server configuration and the network layer.

Best Wishes,

Roy

--
Roy S. Schestowitz | "How do I set my laser printer on stun?"
http://Schestowitz.com | SuSE Linux ¦ PGP-Key: 0x74572E8E
9:40pm up 23 days 11:25, 10 users, load average: 0.30, 0.46, 0.60
http://iuron.com - next generation of search paradigms
.



Relevant Pages

  • Re: Do HTTP headers get spidered?
    ... Do strings in my HTTP headers get spidered. ... redirection information. ... search engine or simply guide it. ...
    (alt.internet.search-engines)
  • Re: Do HTTP headers get spidered?
    ... Do strings in my HTTP headers get spidered. ... No, but they should be interpreted for instructions, I imagine. ... search engine or simply guide it. ...
    (alt.internet.search-engines)