140 Commits (7bb1eb5b612fb7c32a724ff6d76c4df082239334)

Author SHA1 Message Date
ghost 7bb1eb5b61 add class deprecation notice 1 year ago
ghost 034a683df7 add YGGstate DB crawl integration 1 year ago
ghost c5ae6974bd fix PDO calls 1 year ago
ghost b3ec1d42a7 fix empty URI processing 1 year ago
ghost 513addc7af add query totals counting, update crawler debug 1 year ago
ghost 6e03a76ed8 add CURLOPT_SSL_VERIFYHOST/CURLOPT_SSL_VERIFYPEER options 1 year ago
ghost 142d496108 fix SQL syntax error 1 year ago
ghost 80b33f619c fix PAGES_LIMIT condition 1 year ago
ghost d024ffd770 implement unlimited settings customization for each host 1 year ago
ghost ab6c0379c8 implement hosts crawl queue, move robots, sitemaps, manifests to this task 1 year ago
ghost 71724ae33f refactor manifest crawling 1 year ago
ghost b24d31f360 refactor cleaner, delegate tasks to crawler, init hostSetting table 1 year ago
ghost 02612d098b delete getFoundHostPage method, update API version 1 year ago
ghost 11e02da66d memory usage optimization, rename methods, remove memchached dependency from the model 1 year ago
ghost 1d7deffc4c update PR generation, delegate PR value from redirecting pages, update method names 1 year ago
ghost b7a48b905e update method names 1 year ago
ghost 48e0482dbd update Filter::searchQuery method 1 year ago
ghost d119756a41 fix index size 1 year ago
ghost 662351cc46 make meta fields index separated, set search priority by document title 1 year ago
ghost 5791877a4e update Filter::searchQuery method, fix search by URL 1 year ago
ghost 0bda87fbe6 fix priority calculation on zero value in PR 1 year ago
ghost bf69d894ca change search results piority, add PR to the page weight 1 year ago
ghost d3c628b477 update Filter::searchQuery method 1 year ago
ghost 61a0652f51 update Filter::searchQuery method 1 year ago
ghost 3d6bc54b66 update Filter::searchQuery method 1 year ago
ghost 9c0f361601 refactor snap storage 1 year ago
ghost a242d7b05a fix hostPageSnapId to hostPageId 1 year ago
ghost 0ea665f6e7 change method name 1 year ago
ghost 1dbb9f0366 keep native functions inside the nlistr method 1 year ago
ghost 000b9ad8dd add FS cleaning features, lock execution on active crontab tasks, disable hostPageSnap/localhost untested constructions 1 year ago
ghost 3e3b7ee2ef optimize snaps, delete unused constructions 1 year ago
ghost 307eb03600 build host/host page URL in SQL query 1 year ago
ghost a5a48f37f7 read sitemap location in user-agent:* only 1 year ago
ghost 43f53f0967 fix method name 1 year ago
ghost 0c2b42eff1 fix color formatting 1 year ago
ghost 86ab00e258 fix typo 1 year ago
ghost 8a2a79b65c add hostPageSnapStorage table to the optimization queue 1 year ago
ghost c0922ef536 add CLI::brake method 1 year ago
ghost c5b4bebd98 init CLI helper 1 year ago
ghost c160549cf5 add list metod 1 year ago
ghost 712d67f6bf implement unlimited snap storage mirrors, delete megaCMD integration 1 year ago
ghost 9b52e3b7f5 delete unused constructions 1 year ago
ghost 1dd0a8ee2c make page rank procedural, optimize performance 1 year ago
ghost 4a4394fb27 add memcached support 1 year ago
ghost 0fb2e8a78c fix active pages total 1 year ago
ghost a4b4ea324b change top rating from hosts to pages 1 year ago
ghost 2e2501b437 implement sitemap support 1 year ago
ghost 407e0d7f18 implement top page 1 year ago
ghost 3a610d5ccb add hostPageSnap truncate command 1 year ago
ghost 443eaec64e autodelete failed snaps 1 year ago