Welcome, Guest. Please Login or Register.
November 19, 2024, 08:19:18 PM
Home Help Search Log in Register
News: If you are still using YaBB SE, please consider upgrading to SMF as soon as possible.

YaBB SE Community  |  Development  |  Mod Ideas and Creation  |  search engine spidering « previous next »
Pages: [1] 2 3 4 Reply Ignore Print
Author Topic: search engine spidering  (Read 2316 times)
groundup
Disciple of Joe, Head Cleric
Mod Team
YaBB God
*****
Posts: 2983


Error 309: Please notify the administrator of this

WWW
search engine spidering
« on: November 10, 2002, 05:13:41 AM »
Reply with quote

We should figure out a way to change the ? and the ; to / so that way search engines will spider every thread and page in the forum. (just look at vBSpiderFriend - http://www.vbulletin.org/forum/showthread.php?s=&threadid=15628)

If someone has a vb license, I would really like to see that hack :)
Logged

http://www.fastfinancialfreedom.org - financial freedom is a myth
http://www.fastfinancialfreedom.org - financial freedom is a myth
http://www.fastfinancialfreedom.org - financial freedom is a myth
fastfinancialfreedom.org
Spaceman-Spiff
Mod Team
YaBB God
*****
Posts: 3689


My $txt[228]

Re:search engine spidering
« Reply #1 on: November 10, 2002, 05:28:54 AM »
Reply with quote

i've read somewhere that u can do this if u have access to mod_rewrite or something in apache...
i think zef is doing that for keytopic...
Logged

   My mods, ysePak, codes, tutorials
    Support question IMs = bad.
groundup
Disciple of Joe, Head Cleric
Mod Team
YaBB God
*****
Posts: 2983


Error 309: Please notify the administrator of this

WWW
Re:search engine spidering
« Reply #2 on: November 10, 2002, 05:49:29 AM »
Reply with quote

there is a way to make it a mod, i don't really think that most people have access to that.
Logged

http://www.fastfinancialfreedom.org - financial freedom is a myth
http://www.fastfinancialfreedom.org - financial freedom is a myth
http://www.fastfinancialfreedom.org - financial freedom is a myth
fastfinancialfreedom.org
Spaceman-Spiff
Mod Team
YaBB God
*****
Posts: 3689


My $txt[228]

Re:search engine spidering
« Reply #3 on: November 10, 2002, 07:34:02 AM »
Reply with quote

is keytopic using mod_rewrite?
google still lists some stuffs inside my forum...

btw, been wondering for a long time, how does YSE uses ; instead of & ?
Logged

   My mods, ysePak, codes, tutorials
    Support question IMs = bad.
Gobalopper
Mod Team
YaBB God
*****
Posts: 993


Cookie Monster

WWW
Re:search engine spidering
« Reply #4 on: November 10, 2002, 08:10:10 AM »
Reply with quote

How or why? QueryString is what splits the actions up but to me it would make more sense to use & instead as php splits up variables automatically when you use that.
Logged
David
Destroyer Dave
Global Moderator
YaBB God
*****
Posts: 5761


I'm not a llama!

WWW
Re:search engine spidering
« Reply #5 on: November 10, 2002, 08:40:53 AM »
Reply with quote

Quote from: Gobalopper on November 10, 2002, 08:10:10 AMHow or why? QueryString is what splits the actions up but to me it would make more sense to use & instead as php splits up variables automatically when you use that.
Yeah, I never understoog the ; thing, unless it was left over from the Perl version.
Logged

Nemesis
What's an Admin?
Global Moderator
YaBB God
*****
Posts: 2199


WWW
Re:search engine spidering
« Reply #6 on: November 10, 2002, 10:10:32 AM »
Reply with quote

Quote from: groundup on November 10, 2002, 05:13:41 AMIf someone has a vb license, I would really like to see that hack :)

Don't know if that would work. VB boards automatically install the mods from the vbhack site forum. User don't even get to see the mod file. It is all automatically installed.

They just see a mod they like on their forum.

Click on a button on top of the forum page called installed. (Next to where we normaly see reply.)

Then it automatically installed the mod on their board.

Pretty unique VB feature if you ask me! User does not have to do anything. After you press the install button, it just says in the thread. "ModName:" installed. If you go to that user board, it truly is installed.  ;) All this is done right in the vbhack forum.
Logged


Want to say thanks?
*************************************
DONATE or check out my WishList
*********************************
Nemesis
What's an Admin?
Global Moderator
YaBB God
*****
Posts: 2199


WWW
Re:search engine spidering
« Reply #7 on: November 10, 2002, 10:34:41 AM »
Reply with quote

Quote from: groundup on November 10, 2002, 05:13:41 AMWe should figure out a way to change the ? and the ; to / so that way search engines will spider every thread and page in the forum. (just look at vBSpiderFriend - http://www.vbulletin.org/forum/showthread.php?s=&threadid=15628)

If someone has a vb license, I would really like to see that hack :)

Duh just though of something.

There are several ways you can do this. I would suggest trying to use "mod_rewrite"

Here is an article on mod_rewrite from sitepoint:
http://www.webmasterbase.com/article/910

Another thing you may try but not tested is, explode the path. IE:
list($dummy, $page, $id) = explode('/', $PATH_INFO);

Here is another soulution. Place this in your .htaccess file
RewriteEngine on
RewriteBase /
RewriteRule ^yourpage/(.*)\.html$ /yourpage.php?id=$1

That will turn something like this:
http://www.yoursite.com/yourpage.php?id=10
to
http://www.yoursite.com/yourpage/10.html

Hope that helps...
Logged


Want to say thanks?
*************************************
DONATE or check out my WishList
*********************************
cyc
Noobie
*
Posts: 30


I love YaBB SE!

WWW
Re:search engine spidering
« Reply #8 on: November 11, 2002, 12:07:59 AM »
Reply with quote

Quote from: Nemesis on November 10, 2002, 10:34:41 AMHere is another soulution. Place this in your .htaccess file
RewriteEngine on
RewriteBase /
RewriteRule ^yourpage/(.*)\.html$ /yourpage.php?id=$1

That will turn something like this:
http://www.yoursite.com/yourpage.php?id=10
to
http://www.yoursite.com/yourpage/10.html

Hope that helps...

Do you know of a wroking example of this? I tried it but have a small problem:
http://www.cyclingforums.com/index.php?board=19
to
http://www.cyclingforums.com/index/19.php

cheers!
Logged

groundup
Disciple of Joe, Head Cleric
Mod Team
YaBB God
*****
Posts: 2983


Error 309: Please notify the administrator of this

WWW
Re:search engine spidering
« Reply #9 on: November 11, 2002, 01:21:50 AM »
Reply with quote

i know you have to edit querystring.php and probably edit each action. Not sure though.
Logged

http://www.fastfinancialfreedom.org - financial freedom is a myth
http://www.fastfinancialfreedom.org - financial freedom is a myth
http://www.fastfinancialfreedom.org - financial freedom is a myth
fastfinancialfreedom.org
Nemesis
What's an Admin?
Global Moderator
YaBB God
*****
Posts: 2199


WWW
Re:search engine spidering
« Reply #10 on: November 11, 2002, 09:42:37 AM »
Reply with quote

RewriteEngine on
RewriteBase /
RewriteRule ^index/(.*)\.html$ /index.php?board=$1

try this
Logged


Want to say thanks?
*************************************
DONATE or check out my WishList
*********************************
pege
Full Member
***
Posts: 146


Re:search engine spidering
« Reply #11 on: November 11, 2002, 07:20:56 PM »
Reply with quote

I'd like to see this as an option in YaBBSE admin, to make your pages so they can be spidered.  I'm a little leary of trying to hack this feature.
Logged
Ben_S
Disciple of Joe
Support Team
YaBB God
*****
Posts: 1586


I Love YaBB SE!

WWW
Re:search engine spidering
« Reply #12 on: November 11, 2002, 09:30:02 PM »
Reply with quote

I just wonder what will happen if someone does it and google spiders 100,000 posts. The server will probably die
Logged
groundup
Disciple of Joe, Head Cleric
Mod Team
YaBB God
*****
Posts: 2983


Error 309: Please notify the administrator of this

WWW
Re:search engine spidering
« Reply #13 on: November 11, 2002, 10:11:17 PM »
Reply with quote

I wouldn't be worried.. imagine all of the hits your site will receive after that :D
Logged

http://www.fastfinancialfreedom.org - financial freedom is a myth
http://www.fastfinancialfreedom.org - financial freedom is a myth
http://www.fastfinancialfreedom.org - financial freedom is a myth
fastfinancialfreedom.org
groundup
Disciple of Joe, Head Cleric
Mod Team
YaBB God
*****
Posts: 2983


Error 309: Please notify the administrator of this

WWW
Re:search engine spidering
« Reply #14 on: November 11, 2002, 10:15:41 PM »
Reply with quote

nemesis: would that work to change ?, ;, and = to /?

since everything in the url bar is a variable which are only letters and everything on the other side of the = are only numbers, I think it would be feasible to change everything to /

also, I really would like a way to do this without .htaccess.
Logged

http://www.fastfinancialfreedom.org - financial freedom is a myth
http://www.fastfinancialfreedom.org - financial freedom is a myth
http://www.fastfinancialfreedom.org - financial freedom is a myth
fastfinancialfreedom.org
Pages: [1] 2 3 4 Reply Ignore Print 
YaBB SE Community  |  Development  |  Mod Ideas and Creation  |  search engine spidering « previous - next »
 


Powered by MySQL Powered by PHP YaBB SE Community | Powered by YaBB SE
© 2001-2003, YaBB SE Dev Team. All Rights Reserved.
SMF 2.1.4 © 2023, Simple Machines
Valid XHTML 1.0! Valid CSS

Page created in 0.043 seconds with 20 queries.