507 Commits (d46c4921c59618c311b48f62baaed8c183f9b839)
 

Author SHA1 Message Date
ghost 32d0f390d3 update http code and mime type on page/image ban event 2 years ago
ghost 84dcecf50b add svg images support, fix mime validation 2 years ago
ghost e9d5137dfe allow svg images mime content type 2 years ago
ghost e6da2e729a fix images ban update 2 years ago
ghost 8fbd7f3516 count totals using sphinx index instead of database 2 years ago
ghost bf1eeb332c fix page/image mime content type detection 2 years ago
ghost 25b6bce2ec add crawler/cleaner logs 2 years ago
ghost dcdc2c50ad update debug string names 2 years ago
ghost ea04220de3 add curl requests debug 2 years ago
ghost 1aba060d34 fix variable name 2 years ago
ghost fdd18de373 remove abstraction 2 years ago
ghost 4801360a51 update api version 2 years ago
ghost 6c41dd5831 fix ban time update / count affected rows only 2 years ago
ghost 20514c455f add banned items counters 2 years ago
ghost b6605b9132 implement not reachable resources ban feature with timeout to prevent extra http requests 2 years ago
ghost cfa5d01db1 update readme 2 years ago
ghost 702a14b634 add mime content type crawling #1 2 years ago
ghost 0bd95d7f4d fix comments 2 years ago
ghost f88d2ee9ff implement MIME content-type crawler filter 2 years ago
ghost d945fdfd91 update readme 2 years ago
ghost 0e7220f7f8 display url decoded links 2 years ago
ghost bca05e66e9 update readme 2 years ago
ghost bed5d3f149 fix offset out of bounds error 2 years ago
ghost c45592b459 update readme 2 years ago
ghost ff187cfd60 update readme 2 years ago
ghost b1ac5e64a1 update readme 2 years ago
ghost 376476c7b0 update readme 2 years ago
ghost 44b4b50336 update readme 2 years ago
ghost d1312a2ade update readme 2 years ago
ghost e99dae84dd update readme 2 years ago
ghost 14541ae5e3 update readme 2 years ago
ghost 052c829b64 update readme 2 years ago
ghost a1d8522006 update readme 2 years ago
ghost 05fedc6fa6 update readme 2 years ago
ghost ce16d2dd9f update readme 2 years ago
ghost 6a3f4d1904 update readme 2 years ago
ghost 747caccea5 update readme 2 years ago
ghost b09ac5eb43 update readme 2 years ago
ghost 463b81af5e update readme 2 years ago
ghost 4d54e5cc8f update readme 2 years ago
ghost 32e81ede31 update readme 2 years ago
ghost 5999fb3a73 add distributed hosts crawling using yggo nodes manifest 2 years ago
ghost f0b2eb1613 show images total instead of pages in placeholder on image search page 2 years ago
ghost 5297e6e918 fix condition error 2 years ago
ghost 297563d4a5 display related pages in priority to the unique host by rank, rand() order 2 years ago
ghost 34b7291228 add related to image hostpages limit 2 years ago
ghost adc791f378 fix updateTime init 2 years ago
ghost 317a58cfa2 add main container paddings for mobile browsers 2 years ago
ghost 5310c3423b update search page header 2 years ago
ghost 0cc712f24e fix variable definition 2 years ago