84 Commits

Author SHA1 Message Date
Urban Guacamole
683aa0cb49 Update README 2022-01-18 17:28:16 +01:00
Urban Guacamole
c5a35e441b Fix ipfs versoin 2022-01-18 15:36:07 +01:00
Urban Guacamole
b4f47ba374 Update to use generic naming 2022-01-17 22:48:01 +01:00
Urban Guacamole
add5b2a9a5 Add dumps 2022-01-17 22:24:13 +01:00
Urban Guacamole
bf19077ad9 Fix inability to crawl TPB; TLDR TPB has idiotic devs 2022-01-01 12:47:06 +01:00
Urban Guacamole
0bbf642143 Fix nonexistent error handling crawlrss 2021-12-03 13:13:37 +01:00
Urban Guacamole
e514583e25 Update webpage with "Faster than ever" 2021-12-03 12:34:38 +01:00
Urban Guacamole
fe8e18058b Rename seedleech-daemon to seedleech 2021-12-03 12:32:45 +01:00
Urban Guacamole
0d4b9c979f Update documentation 2021-12-03 12:29:54 +01:00
Urban Guacamole
2abcb39b47 Fix error handling in api 2021-12-03 12:29:12 +01:00
Urban Guacamole
bc04c150ad Polish seedleech tuning 2021-12-03 12:28:43 +01:00
Urban Guacamole
ed1964a21e Update index-generator deps 2021-08-17 14:56:09 +02:00
Mingye Wang
dc63bd5e64 feat: set q parameter when searching
This makes refershes work.
2021-08-17 14:53:08 +02:00
Mingye Wang
81bb90c141 feat: interpret q parameter as query
Closes #6.
2021-08-17 14:53:08 +02:00
Urban Guacamole
774c2a98b0 Harden security 2021-07-24 14:00:21 +02:00
Urban Guacamole
fa8357a0bc Update crawling intervals 2021-04-09 20:08:48 +02:00
Urban Guacamole
19224e723c Fix search 2021-02-11 11:01:35 +01:00
Urban Guacamole
e3cce3988b Fix uppercase infohashes 2021-01-03 10:36:05 +01:00
Urban Guacamole
716b0b036b Update EZTV RSS URL 2020-12-30 16:05:04 +01:00
Urban Guacamole
a0de20aa54 Add sort by size 2020-09-02 16:25:05 +02:00
Urban Guacamole
a82e8bef03 Add support for quotes and exclusion for search
You can now use "" and - to require exact match or exclude some terms.
2020-09-02 16:20:59 +02:00
Urban Guacamole
bae9fe5760 Add torrent name to magnet link
So your torrent client shows the name of a torrent even before
it downloads metadata
2020-08-01 09:50:19 +02:00
Urban Guacamole
848d3c73db Update IPFS site to match new writing 2020-08-01 09:37:11 +02:00
Urban Guacamole
aa63077e39 Launch v2.0 frontend 2020-07-20 18:02:45 +02:00
Urban Guacamole
b6537dbcea Add import-magnetico-db
For importing https://github.com/boramalper/magnetico/issues/218
2020-07-20 15:57:59 +02:00
Urban Guacamole
a6715616fb Fix DoS if refreshing of matview takes too long
Refreshing the view after many changes (such as the 8 million new torrents
in 2.0) can take, if the disk is a bottleneck, take longer than 60 min.
2020-07-19 22:38:46 +02:00
Urban Guacamole
4cdd60306e Fix overflow on mobile 2020-07-18 14:55:41 +02:00
Urban Guacamole
995d4970fc Fix seedleech; 5x perf for minseed=0
By removing LIMIT from the query, I was able to 5x the trackerdata/sec
2020-07-17 14:46:45 +02:00
Urban Guacamole
450b018fac Tweak seedleech
In prep for 2.0 w/ 12 million torrents indexed and fresh
2020-07-14 11:49:09 +02:00
Urban Guacamole
446fdf4762 Update seedleech params
In anticipation of more new trackers (6) and significantly more torrents
(2 million -> 20 million).

Required seedleech freshness now updated to guarantee very fresh counts
for popular torrents at the expense of torrents with 1-3 seeds.

I also again changed the sleep time for workfetcher with minseed 0: computing all torrents without a trackerdata entry is computionally expensive, impossible with 20 mil torrents.
2020-07-10 14:11:27 +02:00
Urban Guacamole
0b5b4ae88d Update trackerlist 2020-07-10 11:31:48 +02:00
Urban Guacamole
b8932f1dd0 Add TPB recent video to crawl-rss 2020-07-10 10:23:10 +02:00
Urban Guacamole
1016951321 Update dependencies 2020-07-10 10:22:07 +02:00
Urban Guacamole
2113ee6e1a Add alert on zero results 2020-07-10 10:19:52 +02:00
Urban Guacamole
c7b468384e Fork shiyanhui/dht 2020-07-08 12:57:33 +02:00
Urban Guacamole
3304722c76 Remove import TPB dump tool
The Pirate Bay no longer provides dumps AFAIK.

Commit 8fdc8d6 added crawling of top 48h TPB torrents list.
2020-07-05 14:04:35 +02:00
Urban Guacamole
8fdc8d6508 Add crawl of TPB 48h top to crawl-rss
I still miss most of the trending torrents because I source new torrents mainly from the DHT.
2020-07-05 12:31:28 +02:00
Urban Guacamole
6f9f970979 Add eztv.io to crawl-rss 2020-07-04 14:48:26 +02:00
Urban Guacamole
8b4d9bf5a8 Filter results 2020-06-30 17:27:52 +02:00
Urban Guacamole
d43227bda0 Update FontAwesome 2020-06-30 17:26:29 +02:00
Urban Guacamole
4245ff6e47 Update donated amounts 2020-06-29 13:13:34 +02:00
Urban Guacamole
26a2d1a2ad Add automatic DB index refresh to crawl-rss
Since this is the only service that runs a simple timer, I decided
to add it there.
2020-03-29 14:06:41 +02:00
Urban Guacamole
899086d02b Add Go modules support 2020-03-29 13:39:02 +02:00
Urban Guacamole
240d7d48fc Add RSS crawl service
To provide more fresh content, starting with YIFY/YTS.
2020-03-29 13:38:48 +02:00
Urban Guacamole
78f9d4fbe0 Remove changes notification 2020-01-19 14:30:46 +01:00
Urban Guacamole
496520e336 Fix relative URLs
Previously, TP did not work on alternative domains
2020-01-19 14:30:09 +01:00
Urban Guacamole
e95a82f67d Update deploy scripts 2019-12-25 13:25:26 +01:00
Urban Guacamole
cf6989303c Add Vote and Donate 2019-12-25 13:20:18 +01:00
Urban Guacamole
8dabe0d215 Add onclick telemetry 2019-12-25 13:19:47 +01:00
Urban Guacamole
dd341ba88b Add lightning fast server side search
More features like better ranking, more torrents, etc are coming!
2019-12-25 13:18:02 +01:00