188 Commits (bbaeb50f60cec37ff01e0fc91e93ff1725ef5d1f)

Author SHA1 Message Date
ghost eef23cc830 update readme 2 years ago
ghost 345c59b5f4 collect target location links on page redirect available 2 years ago
ghost 5a47c66e55 fix readme description 2 years ago
ghost f49076bb0c index homepages and shorter URL with higher priority 2 years ago
ghost 3b1590cf7b update readme 2 years ago
ghost 69eb8d4ed4 update readme 2 years ago
ghost 52bd900ad4 update readme 2 years ago
ghost fc687f7f2c update readme 2 years ago
ghost 3113057a36 update readme 2 years ago
ghost 6e45c85ce4 update readme 2 years ago
ghost d88b30925c update readme 2 years ago
ghost 3d100568d7 update readme 2 years ago
ghost 940d5b0042 update readme 2 years ago
ghost 56a706948e update readme 2 years ago
ghost 35acabeab9 update readme 2 years ago
ghost ae7467ad75 update readme 2 years ago
ghost df195249df update readme 2 years ago
ghost 81f7ea1e1e implement multi-storage snap downloads 2 years ago
ghost afb014cdb2 update readme 2 years ago
ghost 1969707eeb integrate optional MEGA/cmd snap storage 2 years ago
ghost 134b70e130 update readme 2 years ago
ghost 0d19004e86 make local snap storage optimization 2 years ago
ghost efc66d5dab update local snap storage paths 2 years ago
ghost 375a94a510 update readme 2 years ago
ghost 2f7d99079d implement local snaps 2 years ago
ghost eeeb3dceac implement index explorer 2 years ago
ghost 371670fadf add media referrers info 2 years ago
ghost 89d1b2230b update readme 2 years ago
ghost 34e25a1d94 update readme 2 years ago
ghost db0e66c846 refactor to mime-based content index #1 2 years ago
ghost 7dc7c89d9e update readme 2 years ago
ghost d186fff48f skip curl download on response data size reached 2 years ago
ghost 377d4935ad update readme 2 years ago
ghost 25b6bce2ec add crawler/cleaner logs 2 years ago
ghost b6605b9132 implement not reachable resources ban feature with timeout to prevent extra http requests 2 years ago
ghost cfa5d01db1 update readme 2 years ago
ghost 702a14b634 add mime content type crawling #1 2 years ago
ghost d945fdfd91 update readme 2 years ago
ghost bca05e66e9 update readme 2 years ago
ghost c45592b459 update readme 2 years ago
ghost ff187cfd60 update readme 2 years ago
ghost b1ac5e64a1 update readme 2 years ago
ghost 376476c7b0 update readme 2 years ago
ghost 44b4b50336 update readme 2 years ago
ghost d1312a2ade update readme 2 years ago
ghost e99dae84dd update readme 2 years ago
ghost 14541ae5e3 update readme 2 years ago
ghost 052c829b64 update readme 2 years ago
ghost a1d8522006 update readme 2 years ago
ghost 05fedc6fa6 update readme 2 years ago