Problem scraping opensubtitles.org
Posted: Tue Jan 12, 2021 7:18 am
Hi, I'm writing a scraper for opensubtitles.org. I've used requests to retrieve xml versions of pages, retrieve download link and download subtitles. I had some polishing to do, but meanwhile they've changed something and now I can't just request download link and get a zip file.
For example when I have a subpage for a subtitle like this:
[URL removed by SmallBrother]
It seems like I can only use the download link in the same browser and only shortly after requesting the subtitle subpage.
It also seems like the downloading is a side effect of clicking the download link. If I try to get the subtitles with requests I just get some other page with ads.
I have no idea how to download subtitles in a script and I'm hoping for some advice from you guys.
Thanks in advance!
For example when I have a subpage for a subtitle like this:
[URL removed by SmallBrother]
It seems like I can only use the download link in the same browser and only shortly after requesting the subtitle subpage.
It also seems like the downloading is a side effect of clicking the download link. If I try to get the subtitles with requests I just get some other page with ads.
I have no idea how to download subtitles in a script and I'm hoping for some advice from you guys.
Thanks in advance!