299 Commits (8a3b25b31c21cd891dff1cb7ff325c6cfe5516bd)
 

Author SHA1 Message Date
ghost ea04220de3 add curl requests debug 2 years ago
ghost 1aba060d34 fix variable name 2 years ago
ghost fdd18de373 remove abstraction 2 years ago
ghost 4801360a51 update api version 2 years ago
ghost 6c41dd5831 fix ban time update / count affected rows only 2 years ago
ghost 20514c455f add banned items counters 2 years ago
ghost b6605b9132 implement not reachable resources ban feature with timeout to prevent extra http requests 2 years ago
ghost cfa5d01db1 update readme 2 years ago
ghost 702a14b634 add mime content type crawling #1 2 years ago
ghost 0bd95d7f4d fix comments 2 years ago
ghost f88d2ee9ff implement MIME content-type crawler filter 2 years ago
ghost d945fdfd91 update readme 2 years ago
ghost 0e7220f7f8 display url decoded links 2 years ago
ghost bca05e66e9 update readme 2 years ago
ghost bed5d3f149 fix offset out of bounds error 2 years ago
ghost c45592b459 update readme 2 years ago
ghost ff187cfd60 update readme 2 years ago
ghost b1ac5e64a1 update readme 2 years ago
ghost 376476c7b0 update readme 2 years ago
ghost 44b4b50336 update readme 2 years ago
ghost d1312a2ade update readme 2 years ago
ghost e99dae84dd update readme 2 years ago
ghost 14541ae5e3 update readme 2 years ago
ghost 052c829b64 update readme 2 years ago
ghost a1d8522006 update readme 2 years ago
ghost 05fedc6fa6 update readme 2 years ago
ghost ce16d2dd9f update readme 2 years ago
ghost 6a3f4d1904 update readme 2 years ago
ghost 747caccea5 update readme 2 years ago
ghost b09ac5eb43 update readme 2 years ago
ghost 463b81af5e update readme 2 years ago
ghost 4d54e5cc8f update readme 2 years ago
ghost 32e81ede31 update readme 2 years ago
ghost 5999fb3a73 add distributed hosts crawling using yggo nodes manifest 2 years ago
ghost f0b2eb1613 show images total instead of pages in placeholder on image search page 2 years ago
ghost 5297e6e918 fix condition error 2 years ago
ghost 297563d4a5 display related pages in priority to the unique host by rank, rand() order 2 years ago
ghost 34b7291228 add related to image hostpages limit 2 years ago
ghost adc791f378 fix updateTime init 2 years ago
ghost 317a58cfa2 add main container paddings for mobile browsers 2 years ago
ghost 5310c3423b update search page header 2 years ago
ghost 0cc712f24e fix variable definition 2 years ago
ghost 834ac68cce create separated pagination settings for page/image search types 2 years ago
ghost d8449d4f7d update db prototype 2 years ago
ghost dad9a2633c increase h3 margins 2 years ago
ghost d4f66c83e7 fix image crawling errors 2 years ago
ghost baa8b0d2f0 fix data type formatting 2 years ago
ghost 79878d17fe add crawler / proxy user agent settings 2 years ago
ghost 73f212e3d7 set crawler queue order priority to item rank, rand() 2 years ago
ghost 9ed8411d2f add image queue crawler 2 years ago