Author Topic: Ew Spiders, that;s it I'm leaving... (Read 7529 times)

animecyberrat · « **on:** March 21, 2008, 04:10:02 PM »

The stupid Who's On says there are 15 spiders using this board, I hate spiders I can't stand those icky creatures, Someone please call an exterminator.

animecyberrat · « **Reply #1 on:** March 21, 2008, 04:13:15 PM »

now there's 22 of them, their multiplying!

NinGurl69 *huggles · « **Reply #2 on:** March 21, 2008, 04:33:27 PM »

They artificially inflate the recorded number of users visiting the forum. Kill them.

animecyberrat · « **Reply #3 on:** March 21, 2008, 05:13:09 PM »

I liked it when the Spiders crawled my forums, they kept me company along with the spam bots. It was lonely in there just me and the spiders...

Maverick · « **Reply #4 on:** March 21, 2008, 06:20:07 PM »

Quote from: animecyberrat on March 21, 2008, 05:13:09 PM

I liked it when the Spiders crawled my forums, they kept me company along with the spam bots. It was lonely in there just me and the spiders...

I feel the same way. I figured out that the best way to not have to rely on the spiders for company is to not suck. Unfortunately I haven't figured out how to do that part yet.

mdm · « **Reply #5 on:** March 21, 2008, 09:18:40 PM »

I like spiders but only when they are inside some kind of orifice

nickmitch · « **Reply #6 on:** March 21, 2008, 09:22:44 PM »

You sound like a pervert.

animecyberrat · « **Reply #7 on:** March 22, 2008, 11:19:24 AM »

I had regular posters, but they left after the mafia game and came back here

vudu · « **Reply #8 on:** March 22, 2008, 11:38:27 AM »

I tried getting people to use the gamerzjackpot forum when NWR was down for a few days in February, but your forums were dead.

You have no one to blame but yourself.

Maverick · « **Reply #9 on:** March 22, 2008, 12:14:00 PM »

He could blame the spiders.

ShyGuy · « **Reply #10 on:** March 22, 2008, 01:58:23 PM »

Spiders that commit identity theft!

animecyberrat · « **Reply #11 on:** March 22, 2008, 04:48:35 PM »

Gamerzjackpot closed shop in December. I was talking about ratscollectibles, those forums are long gone also.

wandering · « **Reply #12 on:** March 23, 2008, 03:16:06 AM »

animecyberrat · « **Reply #13 on:** March 23, 2008, 12:43:43 PM »

I HATE YOU WONDERING! THAT WAS JUST WRONG!

stevey · « **Reply #14 on:** March 23, 2008, 07:21:21 PM »

98% of all bandwidth used on the forums is by yahoo O_O (It's making it really hard to stock other posters

)

NinGurl69 *huggles · « **Reply #15 on:** March 23, 2008, 07:36:20 PM »

THIS IS WOLF. WOLF IS IN SMASH BROTHERS.

Shift Key · « **Reply #16 on:** March 23, 2008, 08:59:12 PM »

Quote from: stevey on March 23, 2008, 07:21:21 PM

98% of all bandwidth used on the forums is by yahoo O_O (It's making it really hard to stock other posters )

I'm sure, if it was a bandwidth issue, Megabyte could direct the spiders and bots away from the forums (or parts of the site) for periods of time.

http://help.yahoo.com/l/us/yahoo/search/webcrawler/
http://www.google.com/support/webmasters/bin/topic.py?topic=8459
http://help.live.com/help.aspx?mkt=en-us&project=wl_webmasters
http://www.robotstxt.org/orig.html

and so on and so on

animecyberrat · « **Reply #17 on:** March 24, 2008, 02:28:08 PM »

No way, I wanted the Spiders Crawling the forums, it was the only way people found my website.

Shift Key · « **Reply #18 on:** March 24, 2008, 06:36:07 PM »

Quote from: animecyberrat on March 24, 2008, 02:28:08 PM

No way, I wanted the Spiders Crawling the forums, it was the only way people found my website.

The spiders are there crawling for new stuff. If your site isn't updated often its only wasting bandwidth.

animecyberrat · « **Reply #19 on:** March 24, 2008, 06:41:50 PM »

That was what the forums were for, I was posting new articles every day. Then I added a news area but that failed to catch on so I replaced that with my blog that also failed to catch on.

Gamerz Jackpot got updated every single day we had the site going, rats collectibles, hey come on I can't update if I don't get something new to add, sell something to replace. I needed the forums to give the spiders something *to* crawl.

Shift Key · « **Reply #20 on:** March 24, 2008, 06:56:46 PM »

Quote from: animecyberrat on March 24, 2008, 06:41:50 PM

Gamerz Jackpot got updated every single day we had the site going, rats collectibles, hey come on I can't update if I don't get something new to add, sell something to replace. I needed the forums to give the spiders something *to* crawl.

The key word I should have emphasized there is often. The frequency at which spiders will visit your site is based on traffic to the site (how it measures this varies, but typically its based on visitors from a search engine to your site).

A high-traffic site may be indexed hourly, a low-traffic site may be indexed fortnightly. It doesn't matter how often you update. Its how interested the search engines are in your site that determines spider activity.

And when a spider does come and index your site, it will index everything it can find. Images. Files. Webpages. Other. That's why a robots.txt file is recommended no matter how important the spiders are. The file tells them which parts of the site you want indexed and which parts are off-limits.

animecyberrat · « **Reply #21 on:** March 24, 2008, 07:10:18 PM »

GC did about 30,000 total visitors (that is of course counting the spiders) in the 6 months we had it. Rats Collectibles is less than 10,000 visitors in more than 5 years.

but you're right and all this I already know I just don't know how to edit the robots.txt file cuz I'm not a "real" web developer.

News:

Author Topic: Ew Spiders, that;s it I'm leaving... (Read 7529 times)