Re: Do HTTP headers get spidered?
- From: Roy Schestowitz <newsgroups@xxxxxxxxxxxxxxx>
- Date: Fri, 31 Mar 2006 19:54:53 +0100
__/ [ canadafred ] on Friday 31 March 2006 18:44 \__
"Sorcerdon" <sorcerdon@xxxxxxxxx> wrote in message
news:1143823597.711292.23840@xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
Im using classic ASP.
Do strings in my HTTP headers get spidered.
No, but they should be interpreted for instructions, I imagine.
Code should always be considered visible to an intelligent spider.
By "spidered", I suppose the intent is to say "recorded", in which case the
answer is probably not. However, it would be nice to keep track of
redirection information. That might get stored in the crawler's server, but
never made public. No-one knows. Not me anyway...
Should I have my HTTP headers show
search engine optimization type strings?
I suppose it depends on the intent; whether you want to manipulate the
search engine or simply guide it.
How do you reckon you can SEO HTTP header? Identify oneself as the key words?
Best wishes,
Roy
--
Roy S. Schestowitz
http://Schestowitz.com | SuSE Linux ¦ PGP-Key: 0x74572E8E
7:50pm up 23 days 9:35, 10 users, load average: 0.67, 1.12, 1.05
http://iuron.com - Open Source knowledge engine project
.
- Follow-Ups:
- Re: Do HTTP headers get spidered?
- From: canadafred
- Re: Do HTTP headers get spidered?
- From: John Bokma
- Re: Do HTTP headers get spidered?
- References:
- Do HTTP headers get spidered?
- From: Sorcerdon
- Re: Do HTTP headers get spidered?
- From: canadafred
- Do HTTP headers get spidered?
- Prev by Date: Re: Do HTTP headers get spidered?
- Next by Date: Re: Internally linking between pages. .
- Previous by thread: Re: Do HTTP headers get spidered?
- Next by thread: Re: Do HTTP headers get spidered?
- Index(es):
Relevant Pages
|