Rocky 1,224 Posted November 25, 2003 Share Posted November 25, 2003 Most users ever online was 97 on Nov 21 2003, 21:19 Damn, 3 off the big 100! Quote Link to post Share on other sites
Super-Bob 0 Posted November 25, 2003 Share Posted November 25, 2003 About 50 of those was spiders. Quote Link to post Share on other sites
NYR_32 6 Posted November 25, 2003 Share Posted November 25, 2003 Whats a spider?... I know its an aracnid....but what do you mean in this context? Quote Link to post Share on other sites
Super-Bob 0 Posted November 26, 2003 Share Posted November 26, 2003 Search engine spider. Quote Link to post Share on other sites
Rocky 1,224 Posted November 26, 2003 Author Share Posted November 26, 2003 Damn it SB, you party pooper. Quote Link to post Share on other sites
Ruin 17 Posted November 26, 2003 Share Posted November 26, 2003 ROFLMFAO! That's a LOT of spiders! Quote Link to post Share on other sites
NYR_32 6 Posted November 26, 2003 Share Posted November 26, 2003 Search engine spider. ... ...yeah but whats that? Whats it do....? Please excuse my ignorance on this subject... Quote Link to post Share on other sites
magnumkp 0 Posted November 26, 2003 Share Posted November 26, 2003 When you submit your site to a search engine, it will send out a spider to "spider" your web site. That is, look at the content, follow links (into other sites sometimes). It then reports back with all this information to the main chap (i.e. google, altavista etc). It is then the search engine can see how "good" your site is and put it in its database (or not as the case may be). In fact you don't need to submit a site to an se, my site was metioned on the front page of gr.net a few months back, and on the "crawl" (that is the spider going through the site) it picked up my site and then went off to crawl that. I appeared in the results 2 days later. If I had submitted it by the google form it would have probably taken a month. You will see high spider activity just before Google (85% of searchs are done on a google based engine) updates its data. It does not do this everyday as many think, usually about once a month is the major change, (unless you are in the lucky few for regular crawling). There are some variations on this, with the "everflux" and things like that, but for now, your Search engine lesson is over. Quote Link to post Share on other sites
NYR_32 6 Posted November 26, 2003 Share Posted November 26, 2003 Thanks Magnum Quote Link to post Share on other sites
Super-Bob 0 Posted November 26, 2003 Share Posted November 26, 2003 You will see high spider activity just before Google (85% of searchs are done on a google based engine) updates its data. It does not do this everyday as many think, usually about once a month is the major change, (unless you are in the lucky few for regular crawling). There are some variations on this, with the "everflux" and things like that, but for now, your Search engine lesson is over. Actually most spiders come from HotBot, don't know why, but its true. Quote Link to post Share on other sites
magnumkp 0 Posted November 26, 2003 Share Posted November 26, 2003 Strange one that. Maybe google has stopping trying to crawl boards such as this? Rumours abound that google throws a bit of a fit if it has a) a long url and b) a ? in the name. I think they are making progress in this field (they had better as most e-com stores use this sort of URL). Still, sorry to make this topic so boring. Quote Link to post Share on other sites
Super-Bob 0 Posted November 26, 2003 Share Posted November 26, 2003 Strange one that. Maybe google has stopping trying to crawl boards such as this? Rumours abound that google throws a bit of a fit if it has a) a long url and b) a ? in the name. I think they are making progress in this field (they had better as most e-com stores use this sort of URL). Still, sorry to make this topic so boring. When theres more than 2 variables in the URL, thats why IPB 1.2 has short tags; to show a topic 1.1 has act=ST, f=forum#, and t=topic#; 1.2 just showtopic=topic#. Quote Link to post Share on other sites
Recon 0 Posted November 26, 2003 Share Posted November 26, 2003 When you submit your site to a search engine, it will send out a spider to "spider" your web site. That is, look at the content, follow links (into other sites sometimes). It then reports back with all this information to the main chap (i.e. google, altavista etc). It is then the search engine can see how "good" your site is and put it in its database (or not as the case may be). In fact you don't need to submit a site to an se, my site was metioned on the front page of gr.net a few months back, and on the "crawl" (that is the spider going through the site) it picked up my site and then went off to crawl that. I appeared in the results 2 days later. If I had submitted it by the google form it would have probably taken a month. You will see high spider activity just before Google (85% of searchs are done on a google based engine) updates its data. It does not do this everyday as many think, usually about once a month is the major change, (unless you are in the lucky few for regular crawling). There are some variations on this, with the "everflux" and things like that, but for now, your Search engine lesson is over. If your website link is in your sig (on these forums) will the spider find it and go to it? Quote Link to post Share on other sites
magnumkp 0 Posted November 26, 2003 Share Posted November 26, 2003 I don't think it will. AFAIK it can't get beyond the main index page of the forums. If you search for a phrase from the forums on google, it returns no results, so I don't think it does. Quote Link to post Share on other sites
Recon 0 Posted November 26, 2003 Share Posted November 26, 2003 This google search brings up a result with a "?" in the address. So I think google can handle ?'s. Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.