Page 1 of 1

Problem scraping

Posted: Tue Jan 12, 2021 7:18 am
by Hauslabuland
Hi, I'm writing a scraper for I've used requests to retrieve xml versions of pages, retrieve download link and download subtitles. I had some polishing to do, but meanwhile they've changed something and now I can't just request download link and get a zip file.

For example when I have a subpage for a subtitle like this: ... version-en

It seems like I can only use the download link in the same browser and only shortly after requesting the subtitle subpage.

It also seems like the downloading is a side effect of clicking the download link. If I try to get the subtitles with requests I just get some other page with ads.

I have no idea how to download subtitles in a script and I'm hoping for some advice from you guys.

Thanks in advance!

Re: Problem scraping

Posted: Thu Jan 14, 2021 6:07 am
by oss

scraping is not permitted.