search engine spidering

[cyc]

Getting rid of ? and  ; would do the trick.

It needs to looks as if its a directory:

/index.php?board=6;action=display;threadid=2608

Would look like:

/index/6/2608.php

I would like google to index all my posts, atm they are wasted (good quality content thats not indexed anywhere)

[pege]

Someone try this out, and let me know what actually gets their articles listed on search engines.  I think this is something important YaBB should come out with soon.

Thanks

[Alex Rolko]

its entirely possible to change the ; in the querystring to something else. (just as & was changed to ;)

if anyone has ever looked at QueryString.php in the main folder ofr YaBBSE

Code Select Expand

if(strlen($QUERY_STRING)>0)
{
   $str = (substr($QUERY_STRING,0,5)=="url=/")?$HTTP_SERVER_VARS["REDIRECT_QUERY_STRING"]:$QUERY_STRING;
   $query_strings = split("[;&]",URLdecode($str));
   foreach ($query_strings as $tmp)
   {
      if(preg_match("/^([^=]+)[=](.*)/", $tmp, $parts)) {
         $GLOBALS[$parts[1]] = $parts[2];
      }
   }
}

[Compuart]

The problem is that a question mark (?) is necesary to discern the filename from it's parameters. Adjusting Querystring.php can't change that. I guess you'd have to adjust .htaccess somehow to make it possible.

btw: the reason for using ; instead of & is that links with an ampersand (&) are not HTML 4.01 compliant. Links would have to look like this to be compliant and still be recognized as standard querystring input: http://www.yabb.info/community/index.php?action=post&threadid=14858

[Mach8]

I use : instead of ; in URLs, looks tidier

[Ben_S]

A question mark isnt really a problem

[groundup]

from what I hear, ? aren't that good for the engine.

[Spaceman-Spiff]

so, anyone interested in making an .htaccess file that works for yse?
im not that familiar with regex and pattern matching...

some info sites:
http://httpd.apache.org/docs/misc/rewriteguide.html
http://httpd.apache.org/docs/mod/mod_rewrite.html
http://www.searchengineworld.com/spiders/index.htm

[cyc]

so, anyone interested in making an .htaccess file that works for yse?
im not that familiar with regex and pattern matching...

some info sites:
http://httpd.apache.org/docs/misc/rewriteguide.html
http://httpd.apache.org/docs/mod/mod_rewrite.html
http://www.searchengineworld.com/spiders/index.htm

There is some good in at those websites, has anyone had any luck with this?

cheers

[Daniel Hofverberg]

A question mark isnt really a problem

For some search engines, you're right - But at least some search engines won't index any URL:s with a question mark or ampersand in it.

[rochen]

Not sure about other search engines, but Google sure spiders it when a "?" is used.

[Daniel Hofverberg]

You're right - Google seems to support question marks in URL:s correctly. But FAST/AllTheWeb, AltaVista and several others don't.

[Ben_S]

alltheweb seems to spider stuff with question marks in it on my site..

In fact its actually spidered a couple of threads

Hope this works

[Daniel Hofverberg]

alltheweb seems to spider stuff with question marks in it on my site..

I just tested, and it seems like you're right. AllTheWeb has ignored URL:s with question marks in the past, but it seems like they actually do spider such links nowadays. Some of their help pages still list that they don't though...  

[Ben_S]

im just curious as to why its spidered a few threads but not all of them