DIR Return Create A Forum - Home
---------------------------------------------------------
Create A Forum - Support Forums
HTML https://support.createaforum.com
---------------------------------------------------------
*****************************************************
DIR Return to: General Support
*****************************************************
#Post#: 2973--------------------------------------------------
Web Crawlers
DIR By: CB
Date: December 3, 2011, 1:33 pm
---------------------------------------------------------
I'm curious to know how Web Crawlers, Spiders, and Bots work.
More often than not, when checking to see who is online, Guest
(Spiders) will be attempting to post in existing threads. Is
this a glitch in the software as I can't really think there are
that many dumb people out there that would continually try to do
this if they haven't yet registered on the site.
I also get a lot of people "Registering to the forum", but never
get any email notification. And when I check in Admin and look
in the Waiting for Approval, there isn't any there to approve.
Just odd.
#Post#: 2988--------------------------------------------------
Re: Web Crawlers
DIR By: CB
Date: December 6, 2011, 10:05 am
---------------------------------------------------------
Can anyone give me some info on this?
#Post#: 3013--------------------------------------------------
Re: Web Crawlers
DIR By: xboi209
Date: December 11, 2011, 11:38 am
---------------------------------------------------------
Well the bots click on every link they see. They also record all
text on the page, so if there's the word "mario" a hundred times
on a page and I go to google and type in "mario" then I can
expect your forum to be in between pages 1 - 30 on google
because the bot can expect there'll be more information on mario
which would make your forum more relevant.
#Post#: 3017--------------------------------------------------
Re: Web Crawlers
DIR By: CB
Date: December 11, 2011, 11:46 am
---------------------------------------------------------
Okay. Thanks.
Any info regarding "Registering to Forum" or "Posting In Thread"
that I see a lot when checking to see who is online. I know that
the people/bots that are posting are not in fact registered with
the forum.
#Post#: 3020--------------------------------------------------
Re: Web Crawlers
DIR By: xboi209
Date: December 11, 2011, 11:51 am
---------------------------------------------------------
Well the bot doesn't have common sense, cause it's a bot.... If
it sees a link, it goes there. They might be stuck at that link
because they can't get past it.
#Post#: 3021--------------------------------------------------
Re: Web Crawlers
DIR By: CB
Date: December 11, 2011, 11:53 am
---------------------------------------------------------
Well, if a Bot is stuck at a link, then I guess I shouldn't be
too concerned with them rising up and taking over the human race
then. ;D
#Post#: 3023--------------------------------------------------
Re: Web Crawlers
DIR By: xboi209
Date: December 11, 2011, 12:02 pm
---------------------------------------------------------
They might be smart enough to all pile up on a website and
overload the server :P
#Post#: 3097--------------------------------------------------
Re: Web Crawlers
DIR By: investigator1
Date: December 27, 2011, 6:48 am
---------------------------------------------------------
how do you get the bots and spiders on the forum basically how
do you activate them or allow them on your forum
#Post#: 3105--------------------------------------------------
Re: Web Crawlers
DIR By: xboi209
Date: December 27, 2011, 3:03 pm
---------------------------------------------------------
They automatically come to your forum. No need to activate them
whatsoever
#Post#: 3174--------------------------------------------------
Re: Web Crawlers
DIR By: investigator1
Date: January 6, 2012, 5:37 pm
---------------------------------------------------------
but i have never seen one yet ??? ??? ???
*****************************************************
Page 1 of 2
DIR Next Page