Creepso/torrentio-scraper
1
0
Fork 0
mirror of https://github.com/TheBeastLT/torrentio-scraper.git synced 2026-04-21 15:11:56 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
890 commits 13 branches 0 tags 16 MiB
Commit graph

501 commits

Author SHA1 Message Date
TheBeastLT
3bf13e68ba try use p-limit instead of bottleneck 2024-01-28 02:12:41 +02:00
TheBeastLT
64b8a55f3b do not limit stream request named queue 2024-01-26 01:30:25 +02:00
TheBeastLT
9366ad1ccb fix request named queue 2024-01-26 01:20:35 +02:00
TheBeastLT
4681cb1f1b add named queue for stream requests 2024-01-26 01:12:44 +02:00
TheBeastLT
af7511a610 export named queue creation 2024-01-26 01:12:02 +02:00
TheBeastLT
0a06018f83 reduce limiter concurrent 2024-01-26 00:27:17 +02:00
TheBeastLT
3f1624cd8e add temp logging 2024-01-26 00:14:52 +02:00
TheBeastLT
a71a846dbd bring back sw stats 2024-01-26 00:09:18 +02:00
TheBeastLT
a22d7d4b10 improve psql pool config 2024-01-22 21:58:53 +02:00
TheBeastLT
0fdc968a86 remove psql pool evict 2024-01-22 00:13:27 +02:00
TheBeastLT
a51ddc53c5 revert bypassing mongo 2024-01-21 23:46:15 +02:00
TheBeastLT
f22df6c5cb try to test bypassing mongo 2024-01-21 23:36:07 +02:00
TheBeastLT
1572ae4af5 add psql pool config 2024-01-21 23:31:58 +02:00
TheBeastLT
777241fdfa add mongo pool size 2024-01-21 23:25:07 +02:00
TheBeastLT
4ee220a1ad move limiter before mongo call 2024-01-21 23:14:44 +02:00
TheBeastLT
8a4eb4cdfe add limiter options 2024-01-19 10:30:13 +02:00
TheBeastLT
94ec4a7a52 retry offcloud download on error 2024-01-15 15:04:21 +02:00
TheBeastLT
e907953cde delete putio transfer when file doesnt exist before adding new transfer 2024-01-15 15:03:13 +02:00
TheBeastLT
ead029d48e increase concurrency and add debrid catalog cache max age 2024-01-15 14:31:25 +02:00
TheBeastLT
a1f2f2a9f1 reduce rd timeout and increase concurrency 2024-01-15 00:24:48 +02:00
TheBeastLT
087ea37c2a increase limiter concurrency 2024-01-14 23:55:28 +02:00
TheBeastLT
25d5a6fa03 remove sw stats 2024-01-14 06:55:06 +02:00
TheBeastLT
124bfae953 try to fix putio 2024-01-07 11:29:55 +02:00
TheBeastLT
ac7a5ff3aa add offcloud download error message 2023-12-30 10:18:28 +02:00
TheBeastLT
96879c13cd change addon name based on debrid configured 2023-12-17 10:52:48 +02:00
TheBeastLT
8ea437e992 improve offcloud link resolving 2023-12-17 10:40:40 +02:00
TheBeastLT
740b01714b increase rd timeout 2023-12-17 10:40:11 +02:00
TheBeastLT
afa1458144 use custom fn to detect same filename in debrids 2023-12-16 19:04:53 +02:00
TheBeastLT
2c4da0679f add bingeGroup for debrid meta streams 2023-12-16 14:59:17 +02:00
TheBeastLT
cf3eb270a3 resolve infoHash for offcloud and premiumize debrid metas 2023-12-16 14:53:52 +02:00
TheBeastLT
66988c6604 check offcloud status of torrent as info from history has inconsistent data 2023-12-16 14:37:11 +02:00
TheBeastLT
bdf05a12ea fix install link copy functionality 2023-12-16 11:13:17 +02:00
edde746
fb3fe2767c
remove clipboard permission prompt (#176) 2023-12-16 10:04:02 +01:00
TheBeastLT
2924869a43 fix offcloud catalog meta access for single file torrents 2023-12-15 19:48:49 +02:00
TheBeastLT
84448aded4 resolve offcloud url for single file torrents 2023-12-15 16:47:49 +02:00
TheBeastLT
c2a46db833 add name when creating magnet link 2023-12-15 13:29:50 +02:00
TheBeastLT
6be344423c fix selecting offcloud unrestricted link for multi dir torrents 2023-12-15 13:18:47 +02:00
TheBeastLT
fc9ecaa1f8 bump axios 2023-11-11 12:34:46 +02:00
TheBeastLT
19b26e1705 adjust debrid timeouts 2023-11-11 12:33:12 +02:00
TheBeastLT
4c2f4306b1 add resolver queue per debrid 2023-11-11 12:30:29 +02:00
TheBeastLT
3366903107 temporary reduce RD timeout due to RD hanging requests 2023-11-10 17:39:27 +02:00
TheBeastLT
7b76236d36 add skip extra to debrid catalogs 2023-11-02 11:59:59 +02:00
TheBeastLT
6eeeb7b674 add catalog access for putio 2023-11-02 11:58:55 +02:00
TheBeastLT
1a02cb2004 do not include invalid tr when creating magnet 2023-11-02 10:47:31 +02:00
TheBeastLT
394c2fab42 fix putio moch client 2023-11-02 10:29:38 +02:00
TheBeastLT
deb982a409 fix putio moch client 2023-11-02 10:27:58 +02:00
TheBeastLT
f9a28c15c2 append filename to debrid meta streams 2023-11-01 17:19:27 +02:00
TheBeastLT
5c2b5a59be fix debrid filename matching for title with non unicode chars 2023-11-01 17:12:32 +02:00
TheBeastLT
614c3f4643 enable tokyotosho and anidex providers 2023-11-01 12:50:40 +02:00
TheBeastLT
25313192d2 try to handle common debrid error for catalog retrieval 2023-10-31 22:26:26 +02:00
TheBeastLT
8a2f0093c6 do not encode realdebrid cachedIds into stream url 2023-10-31 21:27:36 +02:00
TheBeastLT
77db08c9b2 move rate limiting directly to handler 2023-10-31 21:01:02 +02:00
TheBeastLT
a4cdccc469 add swagger stats 2023-10-31 18:39:32 +02:00
TheBeastLT
d2abfc1d81 audit fix npm packages 2023-10-31 17:02:56 +02:00
TheBeastLT
4c83c8d69b bump version 2023-10-31 14:25:03 +02:00
TheBeastLT
86cf502725 migrate to esm structure 2023-10-31 14:21:04 +02:00
TheBeastLT
c7fa8e9c50 add video size filter to configuration options, closes #131 2023-10-31 13:29:57 +02:00
TheBeastLT
9990acf36e retrieve resolver host from request instead of static value 2023-10-31 11:23:30 +02:00
TheBeastLT
cf1ab4212d reduce non cached rd availability cache time 2023-10-31 09:36:35 +02:00
TheBeastLT
7a70255761 bump parse title 2023-10-31 09:23:40 +02:00
TheBeastLT
0967bdc950 bump parse title 2023-10-30 20:22:39 +02:00
TheBeastLT
9013ab1d04 display eng lang for dub anime 2023-10-30 19:15:05 +02:00
TheBeastLT
8e0cd5ba14 bump parse title 2023-10-30 18:48:29 +02:00
TheBeastLT
8575e0604d parse provider language with srt extension 2023-10-30 16:42:02 +02:00
TheBeastLT
12286cba02 fix bingeGroup npe 2023-10-17 20:44:20 +03:00
TheBeastLT
b43da7a882 add (disabled) possibility to return stream subtitles for non debrid streams 2023-10-17 20:37:05 +03:00
TheBeastLT
76c3e9ac3f fix alldebrid retry create torrent 2023-10-12 09:03:29 +03:00
Matt Lewis
d89ff90475
fix: HRD -> HDR (#147) 2023-09-11 20:23:34 +02:00
TheBeastLT
a40cb93812 restore trackers list url 2023-09-02 09:39:06 +03:00
TheBeastLT
80db20c5b9 temp fix trackers url 2023-08-29 08:13:51 +03:00
TheBeastLT
4733b66dbb remove mongo reconnect flag 2023-05-16 10:08:50 +02:00
TheBeastLT
2f7260dd4f more languages 2023-05-11 22:27:30 +02:00
TheBeastLT
018558b181 return zero seeders download links when needed 2023-05-11 22:24:38 +02:00
TheBeastLT
b1611097ad remove nyaapantsu 2023-05-11 10:00:09 +02:00
TheBeastLT
93f8da3d9d bump parse title 2023-05-10 09:45:41 +02:00
TheBeastLT
0eee56aaaf fix brazuca config 2023-05-09 08:34:22 +02:00
TheBeastLT
171125e9e2 bump version 2023-05-08 19:05:53 +02:00
TheBeastLT
978ab408ac add latino language 2023-05-08 16:01:14 +02:00
TheBeastLT
a63e377607 add Cinecalidad provider 2023-05-08 15:44:16 +02:00
TheBeastLT
bc09352a40 add bludv provider 2023-05-08 15:42:58 +02:00
TheBeastLT
b335b2fb42 remove deprecated pt providers 2023-05-08 15:42:33 +02:00
TheBeastLT
c0a45acf63 allow selecting multiple foreign languages, closes #97 2023-05-08 13:35:26 +02:00
TheBeastLT
45bce6ea2f fix limit being applied incorrectly 2023-05-07 21:21:11 +02:00
TheBeastLT
554d10b5af include even 0 seeders streams for series when cached in debrid 2023-05-07 14:06:18 +02:00
TheBeastLT
4d01ef63ad bootstrap multiselect only on desktop 2023-04-27 21:36:14 +02:00
TheBeastLT
a5aefbfbab use number type for limit input in configure page 2023-04-27 17:32:47 +02:00
TheBeastLT
170d4693db detect tv device to not load multiselect js 2023-04-27 17:20:32 +02:00
TheBeastLT
eb0fda6e45 update configure page multiselect 2023-04-27 15:05:31 +02:00
TheBeastLT
bdfb476903 improve configure page 2023-04-27 14:39:18 +02:00
TheBeastLT
def60844b2 potentially resolve RD downloads items metadata 2023-04-25 22:09:26 +02:00
TheBeastLT
4eb167ccc3 remove debrid meta type override 2023-04-25 17:21:15 +02:00
TheBeastLT
ba57412728 override debrid meta type if series 2023-04-25 17:15:40 +02:00
TheBeastLT
6889975485 remove meta id overriding when enriching 2023-04-25 16:54:37 +02:00
TheBeastLT
cb381881a5 enrich metadata for some debrid providers' metas 2023-04-25 16:35:45 +02:00
TheBeastLT
cb3f920fb3 do not return cache headers for RD downloads meta 2023-04-18 20:03:35 +02:00
TheBeastLT
6c7b267764 add RD downloads meta to real debrid catalog 2023-04-18 19:31:43 +02:00
TheBeastLT
ffcf22a920 add socketTimeoutMS for mongodb 2023-04-18 19:31:43 +02:00
TheBeastLT
354774b23b
do not concat null sources 2023-03-26 14:52:57 +02:00
dependabot[bot]
6e85f16afc
Bump sequelize from 6.27.0 to 6.29.0 in /addon (#109) 
Bumps [sequelize](https://github.com/sequelize/sequelize) from 6.27.0 to 6.29.0.
- [Release notes](https://github.com/sequelize/sequelize/releases)
- [Commits](https://github.com/sequelize/sequelize/compare/v6.27.0...v6.29.0)

---
updated-dependencies:
- dependency-name: sequelize
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-02-26 14:59:15 +01:00
TheBeastLT
78770dc14c re-enable cache 2023-02-26 10:50:49 +01:00
TheBeastLT
bd00282e64 try to disable remote mongo cache 2023-02-26 09:01:37 +01:00
TheBeastLT
d50acf1f28 do not cache failed access stream links 2023-02-15 09:03:52 +01:00
TheBeastLT
dab8fe0ae3 reduce cdn cache time 2023-01-13 17:18:00 +02:00
TheBeastLT
588e9b9330 include ts as video extension 2023-01-12 11:08:27 +02:00
TheBeastLT
627f65d62c bump parse title 2023-01-12 10:56:08 +02:00
TheBeastLT
683776ab6d retry downloading single file when no link found or only torrent rar available 2023-01-08 20:38:20 +02:00
TheBeastLT
e947a0827d bump parse title 2023-01-08 18:14:06 +02:00
TheBeastLT
26e8f13c3b include default stremio trackers in stream responses 2023-01-07 19:04:01 +02:00
TheBeastLT
957397d3c2 bump parse title 2023-01-06 11:06:00 +02:00
TheBeastLT
d5d528baa0 improve sources for russian providers 2023-01-05 14:05:34 +02:00
TheBeastLT
84507951e6 add rutracker 2023-01-05 13:34:50 +02:00
TheBeastLT
0b375e6bd5 update mongodb cache options 2023-01-02 08:50:16 +02:00
dependabot[bot]
0b3f69cd62
Bump moment-timezone from 0.5.34 to 0.5.40 in /addon (#92) 
Bumps [moment-timezone](https://github.com/moment/moment-timezone) from 0.5.34 to 0.5.40.
- [Release notes](https://github.com/moment/moment-timezone/releases)
- [Changelog](https://github.com/moment/moment-timezone/blob/develop/changelog.md)
- [Commits](https://github.com/moment/moment-timezone/compare/0.5.34...0.5.40)

---
updated-dependencies:
- dependency-name: moment-timezone
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-12-29 11:34:10 +01:00
dependabot[bot]
257d36b4ad
Bump express from 4.17.1 to 4.18.2 in /addon (#90) 
Bumps [express](https://github.com/expressjs/express) from 4.17.1 to 4.18.2.
- [Release notes](https://github.com/expressjs/express/releases)
- [Changelog](https://github.com/expressjs/express/blob/master/History.md)
- [Commits](https://github.com/expressjs/express/compare/4.17.1...4.18.2)

---
updated-dependencies:
- dependency-name: express
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-12-29 11:33:37 +01:00
dependabot[bot]
b884ea1c45
Bump qs from 6.5.2 to 6.5.3 in /addon (#87) 
Bumps [qs](https://github.com/ljharb/qs) from 6.5.2 to 6.5.3.
- [Release notes](https://github.com/ljharb/qs/releases)
- [Changelog](https://github.com/ljharb/qs/blob/main/CHANGELOG.md)
- [Commits](https://github.com/ljharb/qs/compare/v6.5.2...v6.5.3)

---
updated-dependencies:
- dependency-name: qs
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-12-29 11:33:04 +01:00
dependabot[bot]
68b69ed878
Bump minimist and mkdirp in /addon (#77) 
Bumps [minimist](https://github.com/substack/minimist) and [mkdirp](https://github.com/isaacs/node-mkdirp). These dependencies needed to be updated together.

Updates `minimist` from 0.0.8 to 1.2.6
- [Release notes](https://github.com/substack/minimist/releases)
- [Commits](https://github.com/substack/minimist/commits)

Updates `mkdirp` from 0.5.1 to 0.5.6
- [Release notes](https://github.com/isaacs/node-mkdirp/releases)
- [Changelog](https://github.com/isaacs/node-mkdirp/blob/main/CHANGELOG.md)
- [Commits](https://github.com/isaacs/node-mkdirp/compare/0.5.1...v0.5.6)

---
updated-dependencies:
- dependency-name: minimist
  dependency-type: indirect
- dependency-name: mkdirp
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-12-29 11:32:44 +01:00
dependabot[bot]
25af538da1
Bump moment from 2.29.2 to 2.29.4 in /addon (#60) 
Bumps [moment](https://github.com/moment/moment) from 2.29.2 to 2.29.4.
- [Release notes](https://github.com/moment/moment/releases)
- [Changelog](https://github.com/moment/moment/blob/develop/CHANGELOG.md)
- [Commits](https://github.com/moment/moment/compare/2.29.2...2.29.4)

---
updated-dependencies:
- dependency-name: moment
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-12-29 11:32:13 +01:00
TheBeastLT
7447355877 bump parse title 2022-12-29 12:30:03 +02:00
TheBeastLT
c96d6441cc add mejortorrent, closes #72 2022-12-28 18:05:43 +02:00
TheBeastLT
7ad484f55c support anime type in manifest 2022-12-28 10:01:17 +02:00
TheBeastLT
8160a7ffbd bump dependencies 2022-12-19 18:53:27 +01:00
TheBeastLT
a085e59d09 include magnetdl provider 2022-12-19 18:12:43 +01:00
TheBeastLT
b253560b0e bump parse title 2022-12-19 18:11:58 +01:00
TheBeastLT
b8265f1db1 move AD retry condition to correct place 2022-12-08 18:45:07 +01:00
TheBeastLT
c430b6e5b1 try to delete magnet in AD if too many 2022-12-08 18:30:38 +01:00
TheBeastLT
05b0876e1c reduce bottleneck limits 2022-11-01 10:34:44 +01:00
TheBeastLT
9e8e76e09f reduce empty response cache time 2022-10-25 11:32:56 +02:00
TheBeastLT
4b47b307b3 handle banned user AD error 2022-10-25 11:26:36 +02:00
TheBeastLT
340fbfff4b fix cache header with 0 age 2022-10-22 16:49:25 +02:00
TheBeastLT
d666716140 retrieve only first page of torrents from rd 2022-10-22 16:46:23 +02:00
TheBeastLT
adbd2f41f4 bump addon sdk 2022-10-22 16:45:11 +02:00
TheBeastLT
8ef48b59ee change catalog cache age to 1ms 2022-10-22 15:48:19 +02:00
TheBeastLT
c986088f47 display error stream response for expires rd sub 2022-10-09 13:46:48 +02:00
TheBeastLT
14dc202cde allow excluding remux and hdr qualities, closes #67 2022-10-07 23:54:22 +02:00
TheBeastLT
050aced0d2 display multiple hdr profiles 2022-10-07 23:49:54 +02:00
TheBeastLT
47d87a10f9 increase resolve queue concurrency 2022-09-14 18:14:09 +02:00
TheBeastLT
bb5c06008b add AdoroCinema to providers 2022-08-27 19:59:59 +02:00
TheBeastLT
b132c7291c add copy to clipboard on clickin install 2022-07-29 20:47:40 +02:00
TheBeastLT
a5b6dd3646 show specific error for infringing file removed error 2022-07-27 09:36:13 +02:00
TheBeastLT
202b211303 remove lapumia 2022-07-19 20:11:18 +02:00
TheBeastLT
2042ca7067 screener quality always in name 2022-07-11 09:42:19 +02:00
TheBeastLT
63cb307760 bump parse title 2022-07-10 11:00:51 +02:00
TheBeastLT
eb86b83170 add insecure parse to docker cmd 2022-06-24 09:09:42 +03:00
TheBeastLT
9117d574b4 revert axios downgrade 2022-06-24 08:53:52 +03:00
TheBeastLT
39a0d2b158 downgrade axios 2022-06-23 16:23:54 +03:00
TheBeastLT
f57db5d66b add insecureHTTPParser flag for axios 2022-06-23 16:12:53 +03:00
TheBeastLT
10c13268ab add back all time range 2022-06-18 16:49:52 +03:00
TheBeastLT
ae077dda8c bump dependencies 2022-06-17 22:25:20 +03:00
TheBeastLT
37d4623b9e remove eslint deps 2022-06-17 22:14:08 +03:00
TheBeastLT
96c8b300aa fix offcloud error handling 2022-06-17 22:04:56 +03:00