Forum rules
Under no circumstances is spamming or advertising of any kind allowed. Do not post any abusive, obscene, vulgar, slanderous, hateful, threatening, sexually-orientated or any other material that may violate others security. Profanity or any kind of insolent behavior to other members (regardless of rank) will not be tolerated. Remember, what you don’t find offensive can be offensive to other members. Please treat each other with the kind of reverence you’d expect from other members.
Failure to comply with any of the above will result in users being banned without notice. If any further details are needed, contact: “The team” using the link at the bottom of the forum page. Thank you.
ArtVandelay
Posts: 5
Joined: Thu Jan 25, 2007 3:06 pm

Disallow indexing empty search results for search engines

Fri Jan 26, 2007 10:22 am

Hi!

Many other sites place automatically generated links to opensubtitles.org. So Google follow this links and put it into their index.

If you search for "site:www.opensubtitles.org 24.S06E05" you get results like this one:
http://www.opensubtitles.org/en/fixinpu ... iD-24FEVER

But there is no search result for this query. It would be good if you place a "noindex"-meta tag into empty search results because it doesn't make sense:

<meta name="robots" content="noindex">

Perhaps it isn't easy to write such a meta tag into the head area of the page because the database request is made after generation of the head of the html page. But I think it's not really necessary to place such Meta tags into the HEAD area. You can also add the meta tag to the message: "No results found..." so it can be easy implemented.

Greetz
Jens

User avatar
oss
Site Admin
Posts: 5884
Joined: Sat Feb 25, 2006 11:26 pm
Contact: Website

Fri Jan 26, 2007 10:35 am

no, thats ok, I will do that right now. At the beginning I had disabled all search results...also I dont know why it is indexing these empty pages google - they are similar each other, thats funny.

Thanks for suggestion.

ArtVandelay
Posts: 5
Joined: Thu Jan 25, 2007 3:06 pm

Fri Jan 26, 2007 4:57 pm

Wow, great! That was *really fast*! :)

BTW: the pages with the empty search results aren't complete similar.
- The search query is set as value for the search field so the pages are different and also have different content lengths. And also the statistic on the bottom of the page changes continuously.

I guess that's the reason why Google takes them to their index and doesn't indentify as "duplicate content".

User avatar
oss
Site Admin
Posts: 5884
Joined: Sat Feb 25, 2006 11:26 pm
Contact: Website

Fri Jan 26, 2007 9:07 pm

I make some research, and these changes are minor to all content, so google should report them as similar...I did some SEO before, and this is often problem - pages on site are similar. If you look on google, and query:
site:opensubtitles.org - click on some 100th result, and all those next result are hidden, because they are "similar"...

Return to “Developing”

Who is online

Users browsing this forum: No registered users and 20 guests