567 Commits (ebe42dfe18bffe1a4a972620834a2a4273c2c596)
 

Author SHA1 Message Date
ghost ebe42dfe18 update readme 1 year ago
ghost f26edf5af6 update readme 1 year ago
ghost f9cf414901 reduce quantity of http requests for each page in queue by CRAWL_HOST_PAGE_SECONDS_DELAY setting 1 year ago
ghost 468ef50ee3 delete deprecated constructions 1 year ago
ghost eccb7ea241 refactor hostPageDom tables, add multiple selectors and children values support 1 year ago
ghost 42b34d0783 fix settings procesing, remove unused variables 1 year ago
ghost b1bfd79b80 change DEFAULT_HOST_URL_REGEXP check from host to page URL 1 year ago
ghost a8ffe14349 implement 'hostPage add' CLI method 1 year ago
ghost 56c376474f fix foreach continue level 1 year ago
ghost 1012759c65 update config example 1 year ago
ghost 88d2b16699 implement hostPageDom delete action 1 year ago
ghost 3a9d78b7c4 implement hostPageDom delete action 1 year ago
ghost 0f127ddb91 upgrade hostPageDom crawler to Symfony\Component\DomCrawler 1 year ago
ghost 055b15333e fix variable name 1 year ago
ghost ec3fc1e15d remove debug constructions 1 year ago
ghost 37d01013db add semaphores namespace 1 year ago
ghost 8fd422b5c2 generate hostPageDom target value based on source selector 1 year ago
ghost d1b115d11c add semaphores namespace 1 year ago
ghost 0638bc6742 update DEFAULT_HOST_PAGES_DOM_SELECTORS format 1 year ago
ghost 175209813f add findLastHostPageDomBySelector method 1 year ago
ghost 0b4abd2b50 update DEFAULT_HOST_PAGES_DOM_SELECTORS syntax 1 year ago
ghost e3138faeac delete deprecated method 1 year ago
ghost 2b49ff5f6a move hostPageDescription.data field data to hostPageDom.value 1 year ago
ghost 665563e0b8 update setting options 1 year ago
ghost 70db9620ec replace simple_html_dom library with Symfony\Component\DomCrawler 1 year ago
ghost caa0df67ee update readme 1 year ago
ghost 644270ee11 update readme 1 year ago
ghost c081f27766 update readme 1 year ago
ghost a27cb61f69 replace memcached to Yggverse\Cache\Memory API 1 year ago
ghost 30520f6047 search page speed optimization, yggverse/cache library integration begin 1 year ago
ghost dc1b3a169c add peak memory usage debug 1 year ago
ghost e7201c33de add memory usage debug 1 year ago
ghost c9a354e4ba implement hostSetting set/get methods 1 year ago
ghost b2d7fb2fef fix line break return 1 year ago
ghost 6085677e67 upgrade yggstate db query 1 year ago
ghost ab0391e29e fix url parser path 1 year ago
ghost f8845c620f update installation/setup guide 1 year ago
ghost 183ae91ccc add composer support, refactor FS tree to psr-4 1 year ago
ghost 7bb1eb5b61 add class deprecation notice 1 year ago
ghost 034a683df7 add YGGstate DB crawl integration 1 year ago
ghost 3d9db381e8 fix CRAWL_MANIFEST_API_VERSION 1 year ago
ghost 3c3443b3fd freeze crawl on remote storage connection lost, infinitely repeat new attempt after 60 seconds until storage connected again 1 year ago
ghost 872ea25d00 remove deprecated condition 1 year ago
ghost fff75d4d86 update debug message 1 year ago
ghost 6eefd9b762 fix undefined variable 1 year ago
ghost e953c01eaa update debug message 1 year ago
ghost bd212edb97 update debug message 1 year ago
ghost 1b287c8d28 update debug message 1 year ago
ghost 562b97ba8f update debug message 1 year ago
ghost c5ae6974bd fix PDO calls 1 year ago