87 Commits (2257ce771fb300fcf065862f519c96388ba8c484)

Author SHA1 Message Date
yggverse 2257ce771f apply cleaner to the current url configuration 10 months ago
yggverse 3884f375d4 save document body text to index 10 months ago
ghost 1f27a7e105 trim extra spaces before query escape 10 months ago
ghost d6b5f8b210 build combined search query 10 months ago
ghost 1c2e8dafb2 collect keywords from document headers 11 months ago
ghost cfbc84cbaf sort queue by rank asc 11 months ago
ghost db9dc8d4ba force results to string 11 months ago
ghost ff8461835d calculate initial rank 11 months ago
ghost 50dc9d315a add rank field 11 months ago
ghost 6f4abe4729 set crc32url as document id 11 months ago
ghost 93baed4b90 delete deprecated documents with HTTP code not 200 on second scan 1 year ago
ghost 17d6171d95 fix directory existion check #2 1 year ago
ghost 100806af02 complete local snaps feature #2 1 year ago
ghost 33cc778999 crawl newest pages by rand in queue 1 year ago
ghost 811c700049 add http code notice 1 year ago
ghost 35ad144a9e add stripos url rules for crawl snaps 1 year ago
ghost 0e06ff3c0f fix debug message 1 year ago
ghost e066223bd2 fix link container 1 year ago
ghost 51d52dea7d fix destination name 1 year ago
ghost 87ca594860 add debug levels 1 year ago
ghost 33d657cb72 apply sleep on timeout value provided only 1 year ago
ghost bc00f0c851 make tmp subfolders storage optimization 1 year ago
ghost f613b44d3f disable sort by RAND() in crawler queue 1 year ago
ghost fa3c0491e2 fix chromium -webkit-autofill input colors 1 year ago
ghost 9087c4b0d7 add footer links settings, implement nodes registry with database download list 1 year ago
ghost 4cec81c893 make extended search mode disabled by default #7 1 year ago
ghost f0da3caaf5 add extended search mode option 1 year ago
ghost d3f8d1c0e3 fix result output 1 year ago
ghost 86b20cbc51 add debug output on skip condition 1 year ago
ghost 3306dc1961 add skip url filter by stripos condition 1 year ago
ghost ee074b684a add semaphore namespace prefix 1 year ago
ghost 880764aa49 make paths relative 1 year ago
ghost 24904f667e add Utils::escape note 1 year ago
ghost 27946ff27c define missed crc32url field value 1 year ago
ghost 38fbc32151 fix document fields update 1 year ago
ghost 08995e6199 randomize new pages queue 1 year ago
ghost 3f7eb2f0e3 show random results on empty search request 1 year ago
ghost 6a9117757b reset http code to 404 on page index initiation 1 year ago
ghost 015221eafb fix semaphore condition #5 1 year ago
ghost a499c363f6 prevent multi-thread execution #5 1 year ago
ghost 2961045c76 implement index cleaner tool #5 1 year ago
ghost 7ea9cbffcd fix found totals 1 year ago
ghost 02dd3649a7 add CURL options that prevent crawl queue stuck 1 year ago
ghost 783c60fd25 update snaps list 1 year ago
ghost d247338c13 update download snap filename 1 year ago
ghost 82de3c73ab remove unixtime 1 year ago
ghost 5b166a6245 implement remote snap download API #2 1 year ago
ghost 94a5a82a56 add remote snaps list #2 1 year ago
ghost 349f26f5ea update option name 1 year ago
ghost 133548a98c fix url check conditions 1 year ago