Commit graph

151 commits

Author SHA1 Message Date
TheBeastLT
89e24bf81a [scraper] increase rarbg retry delay 2021-03-02 21:38:12 +01:00
TheBeastLT
e7d0c2b620 [scraper] fix rutor list seeders 2021-02-19 22:43:22 +01:00
TheBeastLT
9c4bd3604e [scraper] add japanese lang matcher for rutor 2021-02-15 18:04:11 +01:00
TheBeastLT
817d64f2eb [scraper] disallow rutor russian series without imdb id 2021-02-15 17:43:03 +01:00
TheBeastLT
991db7432c [scraper] fix rutor starting page 2021-02-15 14:09:50 +01:00
TheBeastLT
e20ed50f17 [scraper] add rutor scraper 2021-02-15 12:38:43 +01:00
TheBeastLT
31b0c85fcf [scraper] clean up torrent galaxy provider 2021-02-01 19:46:46 +01:00
TheBeastLT
d7313ecb91 [scraper] add torrent galaxy provider 2021-01-31 21:11:42 +01:00
TheBeastLT
5074551c41 [scraper] disables tpb seeders update 2021-01-18 14:45:39 +01:00
TheBeastLT
2c3abf242c [scraper] re-enables tpb api seeders 2021-01-17 23:04:04 +01:00
TheBeastLT
4de4801b13 [scraper] update seeders for tpb from trackers not website 2021-01-11 09:57:16 +01:00
TheBeastLT
f8258c596d [scraper] updates active scrapers 2020-12-31 12:02:40 +01:00
TheBeastLT
a1a3fdba61 [scraper] improves nyaapantsu printed error 2020-12-22 11:44:27 +01:00
TheBeastLT
b39e54e2e0 [scraper] encode uri component for kitsu id query 2020-12-19 14:52:39 +01:00
TheBeastLT
cdb221a2cd [scraper] disable nyaasi seeders update request 2020-12-02 10:44:54 +01:00
TheBeastLT
63a0c39a00 [scraper] simplifies nyaa 404 error message 2020-12-01 14:01:26 +01:00
TheBeastLT
b4c217f4e7 [scraper] adds nyaa si scraper 2020-12-01 10:59:29 +01:00
TheBeastLT
c1eb2c3164 [scraper] includes torrent link in nyaa pantsu record 2020-12-01 09:23:39 +01:00
TheBeastLT
eba2e5f9cf [scraper] updates eztv url 2020-11-20 12:19:03 +01:00
TheBeastLT
225bdc7503 [scraper] increases eztv timeout 2020-10-18 12:50:19 +02:00
TheBeastLT
f893f7c01c [scraper] increases eztv timeout 2020-10-17 22:57:22 +02:00
TheBeastLT
f795f5315c [scraper] adds nyaa pantsu scraper 2020-10-17 22:26:15 +02:00
TheBeastLT
2be400baba [scraper] do not pass date year to name-to-imdb 2020-10-03 14:35:06 +02:00
TheBeastLT
ad7ce57c36 [scraper] fixes 1337x overwrite behaviour 2020-10-02 23:06:36 +02:00
TheBeastLT
31e3b0bf5f [scraper] check if episode imdbid fro eztv 2020-10-02 14:06:51 +02:00
TheBeastLT
5426707dd9 [scraper] reduces number of calls to 1337x 2020-10-02 12:49:45 +02:00
TheBeastLT
0f86b77a24 [scraper] adds response and read timeouts fro eztv 2020-09-21 11:08:20 +02:00
TheBeastLT
1e0e99a903 [scraper] disables eztv seeders scrapeing 2020-09-20 19:24:09 +02:00
TheBeastLT
03852d76f1 [scraper] fixes to not use eztv imdb id for talk shows 2020-09-19 20:05:51 +02:00
TheBeastLT
a7b23a1313 [scraper] disables imdb id seeders update for eztv 2020-09-18 21:19:42 +02:00
TheBeastLT
d9eb5f3b35 [scraper] removes proxy for katcr 2020-09-17 21:33:38 +02:00
TheBeastLT
e9b88dd0ad [scraper] removes proxy for rarbg and updates agent name 2020-09-17 21:33:16 +02:00
TheBeastLT
3a3e9a9d73 [scrapper] updates hs mapping 2020-08-27 10:11:47 +02:00
TheBeastLT
12dc20c144 [scrapper] fixes rarbg api error handling 2020-08-13 15:17:56 +02:00
TheBeastLT
ecb578bd8c [scraper] updates hs mapping 2020-07-29 10:26:17 +02:00
TheBeastLT
f886e2a078 [scraper] updates horriblesubs mapping 2020-07-20 18:45:55 +02:00
TheBeastLT
f0939f9943 [scraper] implements custom rargb api class 2020-05-26 23:22:08 +02:00
TheBeastLT
51a9d2401d [scraper] bumps rarbg-api version 2020-05-11 10:40:46 +02:00
TheBeastLT
0d98b6b3ae [scraper] includes Movies/x265/1080 category for rarbg 2020-05-07 13:14:05 +02:00
TheBeastLT
9ce3f72e5d [scraper] checks for torrent contents when updating existing torrent 2020-05-06 11:59:53 +02:00
TheBeastLT
9b1982abfe [scraper] limits pages per category for 1337x 2020-05-02 22:40:51 +02:00
TheBeastLT
9123c1ffd8 [scraper] reduces concurrent entry processing limit 2020-05-02 22:20:19 +02:00
TheBeastLT
2bb0570194 [scraper] adds proxy for kat and 1337x 2020-05-02 17:35:50 +02:00
TheBeastLT
9dba42ebfe [scraper] fixes hs api to not use redirects due to node hotfix 2020-04-30 09:43:29 +02:00
TheBeastLT
50aa4d4f1e [scraper] updates horriblesubs mapping 2020-04-28 18:33:15 +02:00
TheBeastLT
529f5ba76c [scraper] simplify update seeders query 2020-04-28 09:29:40 +02:00
TheBeastLT
a6f3e85c34 [scraper] adds pagination to new tpb browse api 2020-04-27 12:22:43 +02:00
TheBeastLT
ee24dbebb8 [scraper] handles non json tpb request results 2020-04-26 11:42:24 +02:00
TheBeastLT
10615e4aed [scraper] updates 1337x search api to extend results 2020-04-25 10:37:21 +02:00
TheBeastLT
eb2211ddcb [scraper] add jitter for eztv retries 2020-04-23 23:22:11 +02:00
TheBeastLT
5e25bac52a [scraper] fixes eztv api search function 2020-04-23 21:19:35 +02:00
TheBeastLT
1387f38074 [scraper] refactor tpb scraper to use new api 2020-04-23 21:08:23 +02:00
TheBeastLT
d0e0d7b581 [scraper] fixes seeders update for imdb search providers 2020-04-23 20:49:04 +02:00
TheBeastLT
aa0bf8da44 [scraper] fixes seeders updating if provider not found 2020-04-23 17:08:18 +02:00
TheBeastLT
9ea3932af1 [scraper] rework scraper scheduling and added seeders updating 2020-04-23 16:46:04 +02:00
TheBeastLT
d01e2c9b35 [scraper] updates rarbg dump scraper 2020-04-23 15:15:52 +02:00
TheBeastLT
3299bc2d06 [scraper] fixes periodic hs all shows scraping with disabled seeders updating 2020-04-17 19:05:55 +02:00
TheBeastLT
adc78fdea7 [scraper] adds retries for rarbg 2020-04-15 16:47:53 +02:00
TheBeastLT
6d0763ba20 [scraper] include languages from tpb 2020-04-15 14:46:26 +02:00
TheBeastLT
fd7057f3dc [scraper] fixes eztv latest scraper method 2020-04-14 11:05:01 +02:00
TheBeastLT
7e959609ea [scraper] adds eztv scraper 2020-04-14 08:29:08 +02:00
TheBeastLT
a58843d75f [scraper] reduces tpb scraped pages 2020-04-13 22:48:35 +02:00
TheBeastLT
6bfba11692 [scraper] updates includes api extracted languages 2020-04-13 22:46:17 +02:00
TheBeastLT
ac0c0b041f [scraper] adds yts scraper 2020-04-13 10:06:06 +02:00
TheBeastLT
31e3970272 [scraper] updates hs scraper to update seeders for existing latest entries 2020-04-11 17:57:30 +02:00
TheBeastLT
f3952dcc3e [scraper] updates hs mapping 2020-04-11 16:37:24 +02:00
TheBeastLT
ce0e330172 [scraper] adds update seeders cron 2020-04-08 16:06:02 +02:00
TheBeastLT
d3cc8c6b57 [scraper] updates hs mapping 2020-04-08 10:35:07 +02:00
TheBeastLT
6e911150f4 [scraper] updates hs mapping 2020-04-05 12:36:34 +02:00
TheBeastLT
760c577ca7 [scraper] removes proxy from kat 2020-04-03 16:28:54 +02:00
TheBeastLT
7dac31ae61 [scraper] fixes torrent size update method for horriblesubs 2020-04-03 14:39:23 +02:00
TheBeastLT
a8e76cd46e [scraper] fixes horriblesubs spread operator object 2020-04-03 14:10:31 +02:00
TheBeastLT
d2eb8d04c0 [scraper] updates horriblesubs mapping 2020-04-03 12:25:19 +02:00
TheBeastLT
2833c9d3a2 [scraper] adds helper class for proxy and user agent 2020-04-02 22:47:52 +02:00
TheBeastLT
db78f5873b [scraper] get torrent size for horriblesubs 2020-04-02 20:58:08 +02:00
TheBeastLT
97cbe5d6c1 [scraper] fixes update seeders method 2020-03-30 14:48:22 +02:00
TheBeastLT
951add6851 [scraper] updates horriblesubs mapping 2020-03-29 11:47:55 +02:00
TheBeastLT
e79064019e [scraper] fixes tpb browse request url 2020-03-27 19:51:35 +01:00
TheBeastLT
0e802c74d2 [scraper] check for if new episode when decomposing 2020-03-26 18:19:14 +01:00
TheBeastLT
83ef6e09af [scraper] fixes academia horriblesubs mapping 2020-03-21 12:43:20 +01:00
TheBeastLT
5f429ebdc0 [scraper] do not use imdbId for series from tpb 2020-03-20 14:25:05 +01:00
TheBeastLT
7948f4877e [scraper] fixes cron expression 2020-03-17 08:28:41 +01:00
TheBeastLT
8e67c5f40e [scraper] updates horriblesubs mapping 2020-03-17 08:25:31 +01:00
TheBeastLT
7e7e46a5f3 [scraper] updates tpb proxies 2020-03-16 14:48:57 +01:00
TheBeastLT
b05d4dee33 [scraper] retrieve latest entries in sequence 2020-03-16 10:53:36 +01:00
TheBeastLT
6c56d76f98 [scraper] overwrite torrent type if differs from metadata type 2020-03-15 20:46:41 +01:00
TheBeastLT
5e4ed626e9 [scraper] includes 1337x sort api option 2020-03-15 20:45:48 +01:00
TheBeastLT
e904dea5e6 [scraper] fixes 1337x size parsing 2020-03-15 11:54:55 +01:00
TheBeastLT
2ea787c0c7 [scraper] updates tpb dum scraper 2020-03-15 11:24:18 +01:00
TheBeastLT
3ca4479d8a [scraper] add html entities escape 2020-03-14 22:54:44 +01:00
TheBeastLT
326a07b82e [scraper] updates scrapers and unique index 2020-03-14 22:25:51 +01:00
TheBeastLT
1efaa0451c [scraper] check existing torrent for 1337x once infohash is defined 2020-03-13 23:15:25 +01:00
TheBeastLT
542c96a2c3 [scraper] updates scapers limiter usage 2020-03-13 22:24:22 +01:00
TheBeastLT
c09d7cf566 [scraper] filter non mapped horriblesubs episodes 2020-03-13 18:38:57 +01:00
TheBeastLT
21338b3aee [scraper] date handling 2020-03-13 15:46:39 +01:00
TheBeastLT
972d4b8a43 [scraper] updates rarbg dum scraper with better logging 2020-03-13 09:48:01 +01:00
TheBeastLT
c6e0c01850 [scraper] adds scheduling flag to enable it 2020-03-12 09:02:50 +01:00
TheBeastLT
fadda7a914 [scraper] adds a warning if horriblesubs episode is out of mapped bounds 2020-03-11 19:13:59 +01:00
TheBeastLT
a2ea880cb6 pads zeros to imdbId if missing 2020-03-10 21:37:20 +01:00
TheBeastLT
a83c75a702 filter horriblesubs entries having a magnetlink 2020-03-10 16:26:47 +01:00