Forum rules
Under no circumstances is spamming or advertising of any kind allowed. Do not post any abusive, obscene, vulgar, slanderous, hateful, threatening, sexually-orientated or any other material that may violate others security. Profanity or any kind of insolent behavior to other members (regardless of rank) will not be tolerated. Remember, what you don’t find offensive can be offensive to other members. Please treat each other with the kind of reverence you’d expect from other members.
Failure to comply with any of the above will result in users being banned without notice. If any further details are needed, contact: “The team” using the link at the bottom of the forum page. Thank you.
fana
Posts: 17
Joined: Thu Mar 15, 2007 9:05 pm

Mirror of opensubtitles.org for Subdownloader?

Tue Dec 23, 2008 5:28 pm

Hi,
is it possible to set up some kind of "mirror-server" of opensubtitles.org and configure it in Subdownloader as fallback or maybe as list of available servers to use?

User avatar
eduo
Posts: 716
Joined: Sat Feb 10, 2007 1:40 am
Location: Information Technology
Contact: ICQ Website Yahoo Messenger

Tue Feb 03, 2009 10:51 pm

Some of us have been asking for this for years now. I even offered to set it up myself :)

It's not currently in OS's plans and the subject obviously only comes up when there are problems (like these days).
http://eduo.info/
[url=http://eduo.info/soleol/]OpenSubtitles from your desktop: SolEol for Mac/Windows/Linux[/url]
[url=http://forums.plexapp.com/index.php?showtopic=325&st=0&p=2480&#entry2480]My current episode processing work flow[/url].

User avatar
oss
Site Admin
Posts: 5879
Joined: Sat Feb 25, 2006 11:26 pm
Contact: Website

Sat Feb 07, 2009 9:22 am

I was thinking about something...as I know, opensubtitles is getting bigger and bigger, more complicated and so on. I started this project as hobby, fun and so on, and of course I was not expert in programming (and still I am not), maybe should be nice to start code this project from the scratch. It is big thing, but I think it should be the best.

I am just looking for some people who are interested in this, and still thinking what should be the best for community. Also making some spare servers for XMLRPC (API) access should be nice.

Have to think about this more.

capiscuas
Posts: 82
Joined: Mon Apr 17, 2006 5:33 am

Mon Apr 27, 2009 9:44 am

Due that API users have become now majority of the load of www.opensubtitles.org , from SubDownloader team will be glad to set up a mirror server that will make their servers less charged and focused just to web users (where the site gets money from).

The ball now is on "os" side which owns the site and their subtitles, we are good coders of django, so it can be done as an opensource project or so and cloned mirrors, even using P2P to share subtitles.

User avatar
eduo
Posts: 716
Joined: Sat Feb 10, 2007 1:40 am
Location: Information Technology
Contact: ICQ Website Yahoo Messenger

Wed Apr 29, 2009 12:10 am

I actually offered to do this as well. Was also offering several alternatives that would make the transition from single-sever to mirrored-servers better.

Obviously the two biggest responsible for the lousy performance of the server are the MySQL queries and the files themselves. One ties up the CPU and the other steals bandwidth.

At the very least the files could be mirrored in severa places, to take the bandwidth load off and focus on the MySQL side of the equation.

The more difficult part would be the database itself. Obviously MySQL mirroring is not the way to go here but it wouldn't too far off to consider OS creating overnight data batches to be shared daily to the mirrors (big file, would benefit from P2P). All of the API could be run from the mirrors leaving the main server servicing the web users alone.

P2P... I don't think it'd make sense for sharing subtitles. P2P actually doesn't make sense unless you have dozens of servers and it would be better for database sharing than subtitle sharing (most subtitles take up less than 20K compressed, P2P would impose too much overhead transferring those, unless it was made in bulk).
http://eduo.info/
[url=http://eduo.info/soleol/]OpenSubtitles from your desktop: SolEol for Mac/Windows/Linux[/url]
[url=http://forums.plexapp.com/index.php?showtopic=325&st=0&p=2480&#entry2480]My current episode processing work flow[/url].

capiscuas
Posts: 82
Joined: Mon Apr 17, 2006 5:33 am

Wed Apr 29, 2009 9:48 am

Hi eduo,

for share subtitles for P2P, I agree sharing only 20k everytime would be a big overload in the newtork, but what about in packages of 20 subs? , that is 400K ? That way that user can be a potencial sharer too later on.

For example, i want movie1.srt , I get 20 subtitles more (movie2.srt to movie20.srt) (hidden in subdownloader torrent folder) and subdownloader saves that movie1.srt on my movie folder, so user won't realize anything.

now, user2 wants movie2.srt, now user1 and subdownloader torrent server can give me that movie2.srt , etc

it will arrive a moment in time where subdownloader torrent will be only necessary when sharing new torrents.

User avatar
eduo
Posts: 716
Joined: Sat Feb 10, 2007 1:40 am
Location: Information Technology
Contact: ICQ Website Yahoo Messenger

Thu Apr 30, 2009 10:15 pm

Oh. I hadn't understood.

I still don't really like the idea, but now I understand what you want. I thought you had meant mirror servers but having the users be mirrors is highly intrusive and polemic. Unless the user agrees to it it's worse than setting up a botnet with trojans.

I would notice if a single file was downloaded other than what I wanted. I must keep the disks very controlled as the files are picked up by the XBMC/Plex library scrapers.
http://eduo.info/
[url=http://eduo.info/soleol/]OpenSubtitles from your desktop: SolEol for Mac/Windows/Linux[/url]
[url=http://forums.plexapp.com/index.php?showtopic=325&st=0&p=2480&#entry2480]My current episode processing work flow[/url].

Return to “Programs using OS”

Who is online

Users browsing this forum: No registered users and 35 guests