Create Hashes offline?

[James]

I have many many films without subtitles, and when I search for this collections new subtitles, I must wait and create hashes from all of them every time.

Option: Store hashes will be nice. In first time program calculate hash, and store it for disk (ex. in the same dir like video file, .hash). And in Search procedure program finds if exist hash for video file on the disk, if not, calcute them, if yes, skip generate and use this file.

When I have ~40 700-1.4GB films, and check it periodically all the time, this feature will help a lot for me.

I finally try to look on sources, and implement this by my own... I add one option to Misc Menu in Options, first test looks promising. Searching subtitles without create hashes on large (50 GB) data works much much faster!.

I modified a few files in SubDownloader sources. But I dont know, how make translate for new strings.. But I think, autor can handle with this... I send modified files to authors email, for those who want faster search on large amount of data:

Source modified files: http://www.edisk.cz/stahni/44900/Modifi ... .13KB.html

Compiled subdownloader.exe: http://www.edisk.cz/stahni/65342/SubDow ... .94MB.html or http://massmirror.com/dd7f0aa75050b697a ... 07255.html

it has 10 more MBs than original 1.2.9 version, dont know why (maybe some special setup on compile PC), but seems to work.. You can try it if you want

[oss]

I am suggesting OSCAR and SubDownloader must have same format for subs, so they will work together.

[capiscuas]

Hi James,

your contribution in Subdownloader 1.2.9 is great. Would you help us to port it for our Subdownloader 2.0 based in pyqt?

https://launchpad.net/subdownloader

Thanks.

[eduo]

I haven't seen how offline subs have been implemented but they do sound like a great idea. Selecting and hashing files is cumbersome and slow.

There is a potential problem, though. If you are not forced to clean-up offline filelists periodically you may end up hitting the anti-leech limits of OpenSubtitles. You may not know you're testing hundreds of movies every time.

According to OS if the query is above 250 the remainder is ignored. And I also think the API doesn't ever return more than 100 results anyway.

@os: You may want to clear that up if I got it wrong, or if there will be changes for registered users.

Maybe a good option would be "Save Hashes for one month", with each hash having an expiry date after a month.

On SubDownloader 2, I'll keep trying to make it work in Mac OS X but QT4, Python and PyQT give a lot of problems in OSX Leopard. This coupled with MMPython not even running in Mac OS X makes it a bit of a challenge.

[capiscuas]

Hi eduo,

I think the mmpython module is optional in Subdownloader2 now. I'll try to install the Leopard as a Virtual Machine to try to generate a DMG to simplify things.

For the offline hash, why do we need to have a time expiration? If we store (filename, filesize) = HASH? How this can be expire? If those files coincide again, 99% of changes that it's the same file i did the hash before.

Is tha what u meant, otherwise sorry I didn't understand well.

[eduo]

No. I wasn't clear, sorry.

I meant that if a user starts storing hashes for offline checks and those hashes keep being more and more, the list of offline files checked every time would be too big eventually.

I admit I haven't seen how the patch works, but that's what I found in my own version. I stored hashes for offline checks and they would keep being more and more...

[capiscuas]

This request is in our whislists currently.

https://bugs.launchpad.net/subdownloader/+bug/242699

Please discuss there.