Commit Graph

  • 7e3248ca2c rename method name ghost 2023-08-03 10:26:14 +0300
  • 772975059c add mysql conf example ghost 2023-08-03 09:25:43 +0300
  • 7c407e0d1f update crontab example ghost 2023-08-03 08:34:51 +0300
  • 1249e8d29c fix CRAWL_PAGE_RANK_UPDATE condition ghost 2023-08-02 21:22:31 +0300
  • 5df59661d8 add page rank update optional in the crawl queue ghost 2023-08-02 21:21:23 +0300
  • a5a2ec233e unify mime-based search results template ghost 2023-08-02 17:29:02 +0300
  • 6d5901c101 display shortened page URL instead of host address, change column name ghost 2023-08-02 15:47:44 +0300
  • 1d7deffc4c update PR generation, delegate PR value from redirecting pages, update method names ghost 2023-08-02 15:43:44 +0300
  • bba718c901 remove host pages total column ghost 2023-08-02 15:36:26 +0300
  • b7a48b905e update method names ghost 2023-08-02 14:25:48 +0300
  • e65c24f6f3 uodate roadmap ghost 2023-08-02 12:44:10 +0300
  • 1655ec63b2 skip xmpp links ghost 2023-08-02 11:57:54 +0300
  • 06c136f05c fix meta/nofollow attribute processing ghost 2023-08-02 10:56:25 +0300
  • 39ba77fce5 fix page info conditions ghost 2023-08-01 22:17:54 +0300
  • ef170f62f3 update cli ghost 2023-08-01 21:55:18 +0300
  • 43776b5ff4 fix semaphores ghost 2023-08-01 17:53:14 +0300
  • 48e0482dbd update Filter::searchQuery method ghost 2023-08-01 17:20:42 +0300
  • cc0cca346b allow empty search queries ghost 2023-08-01 16:47:39 +0300
  • d119756a41 fix index size ghost 2023-08-01 16:23:40 +0300
  • 662351cc46 make meta fields index separated, set search priority by document title ghost 2023-08-01 14:15:14 +0300
  • 5791877a4e update Filter::searchQuery method, fix search by URL ghost 2023-08-01 13:50:07 +0300
  • 0bda87fbe6 fix priority calculation on zero value in PR ghost 2023-08-01 11:17:29 +0300
  • bf69d894ca change search results piority, add PR to the page weight ghost 2023-08-01 11:13:06 +0300
  • d3c628b477 update Filter::searchQuery method ghost 2023-08-01 11:01:08 +0300
  • 61a0652f51 update Filter::searchQuery method ghost 2023-07-31 23:33:06 +0300
  • 3235133cd0 extract keywords from URI ghost 2023-07-31 22:42:49 +0300
  • 3d6bc54b66 update Filter::searchQuery method ghost 2023-07-31 22:07:59 +0300
  • 2ef9948342 change default CRAWL_PAGE_HOME_SECONDS_OFFSET value to 1 month ghost 2023-07-31 22:04:27 +0300
  • fd3444a379 change timestamp sort order ghost 2023-07-31 14:25:38 +0300
  • 9c0f361601 refactor snap storage ghost 2023-07-31 13:33:30 +0300
  • 5d7bcba42b minor optimization ghost 2023-07-31 01:45:34 +0300
  • a242d7b05a fix hostPageSnapId to hostPageId ghost 2023-07-31 01:28:11 +0300
  • aacbdfebc8 enable localhost DB-FS relations sync ghost 2023-07-30 23:33:31 +0300
  • 0ea665f6e7 change method name ghost 2023-07-30 23:32:02 +0300
  • 9e53618193 add snap file existing message ghost 2023-07-30 22:24:16 +0300
  • 1e6451f863 update output message on snap index deletion ghost 2023-07-30 22:12:30 +0300
  • 3546e07d6a fix roadmap in the CLI hostPageSnap section ghost 2023-07-30 22:08:05 +0300
  • 9f23a0ebe4 move clean/crawl commans to the crontab options ghost 2023-07-30 22:05:37 +0300
  • 1dbb9f0366 keep native functions inside the nlistr method ghost 2023-07-30 22:00:18 +0300
  • 000b9ad8dd add FS cleaning features, lock execution on active crontab tasks, disable hostPageSnap/localhost untested constructions ghost 2023-07-30 21:53:30 +0300
  • 547cd6717b prevent scheduled execution on cli/yggo running ghost 2023-07-30 21:47:09 +0300
  • 3e3b7ee2ef optimize snaps, delete unused constructions ghost 2023-07-30 19:09:41 +0300
  • 36becf6fe1 remove dots ghost 2023-07-30 18:13:23 +0300
  • db7e92391d remove undefined variable from CLI output ghost 2023-07-30 18:06:46 +0300
  • fde30da74c fix variable name ghost 2023-07-30 17:59:15 +0300
  • 30a81ca6fb delete snaps from registry when not found in the any of storage available ghost 2023-07-30 17:42:36 +0300
  • 1972b3411c fix snap file location ghost 2023-07-30 14:46:07 +0300
  • 3c4a89d16d fix host page snap storage id ghost 2023-07-30 14:39:21 +0300
  • 307eb03600 build host/host page URL in SQL query ghost 2023-07-30 13:02:24 +0300
  • b13293988a add search index by host and host page URL ghost 2023-07-30 12:39:41 +0300
  • 1e664ba4cd cover snap deletion in transaction ghost 2023-07-30 12:18:35 +0300
  • 1f33205236 add script tag support ghost 2023-07-30 00:52:55 +0300
  • b9ec787bbb decrease length of link previews ghost 2023-07-30 00:21:45 +0300
  • b433fa6b3c add link tag support ghost 2023-07-30 00:17:28 +0300
  • a5a48f37f7 read sitemap location in user-agent:* only ghost 2023-07-29 23:37:25 +0300
  • 051bfb2e81 update snap reindex CLI output ghost 2023-07-29 20:23:43 +0300
  • 43f53f0967 fix method name ghost 2023-07-29 20:07:44 +0300
  • 0c2b42eff1 fix color formatting ghost 2023-07-29 20:05:30 +0300
  • cd30be8147 fix CLI::danger method name ghost 2023-07-29 20:02:53 +0300
  • 2673f3d316 add snap reindex [purge] option, fix storage crc32name index ghost 2023-07-29 20:02:08 +0300
  • 79d07dd1a5 fix snap fs init ghost 2023-07-29 19:53:31 +0300
  • 6eb45fdad2 fix snap crc32name index ghost 2023-07-29 19:38:09 +0300
  • 99860bb4aa update readme ghost 2023-07-29 17:52:51 +0300
  • be1e83c5e4 add explore page ghost 2023-07-29 17:52:38 +0300
  • 0e39ee7361 implement snap reindex command, cover CLI output ghost 2023-07-29 17:49:07 +0300
  • 86ab00e258 fix typo ghost 2023-07-29 17:31:53 +0300
  • 8a2a79b65c add hostPageSnapStorage table to the optimization queue ghost 2023-07-29 17:27:55 +0300
  • c0922ef536 add CLI::brake method ghost 2023-07-29 17:22:25 +0300
  • c5b4bebd98 init CLI helper ghost 2023-07-29 17:04:20 +0300
  • dcf15fb49f add connection close ghost 2023-07-29 16:00:04 +0300
  • c160549cf5 add list metod ghost 2023-07-29 15:50:49 +0300
  • 712d67f6bf implement unlimited snap storage mirrors, delete megaCMD integration ghost 2023-07-29 14:37:01 +0300
  • 9b52e3b7f5 delete unused constructions ghost 2023-07-28 12:55:25 +0300
  • 2c17c93e2f fix broken snaps autodelection ghost 2023-07-28 12:54:15 +0300
  • 1dd0a8ee2c make page rank procedural, optimize performance ghost 2023-07-28 12:49:43 +0300
  • 4a4394fb27 add memcached support ghost 2023-07-27 17:53:36 +0300
  • 0fb2e8a78c fix active pages total ghost 2023-07-27 16:53:25 +0300
  • a4b4ea324b change top rating from hosts to pages ghost 2023-07-27 15:09:58 +0300
  • 2e2501b437 implement sitemap support ghost 2023-07-27 11:44:42 +0300
  • a905499926 fix api version ghost 2023-07-26 13:22:21 +0300
  • abc75c9adf update footer links ghost 2023-07-26 13:07:55 +0300
  • 14b281cd0c update readme ghost 2023-07-26 13:06:42 +0300
  • 407e0d7f18 implement top page ghost 2023-07-26 12:51:00 +0300
  • dca45c69ce fix default font color ghost 2023-07-26 12:18:53 +0300
  • 56c21a47c6 add htmlentities ghost 2023-07-25 23:40:41 +0300
  • 9104dbd61d remove unused dependencies ghost 2023-07-25 22:41:52 +0300
  • 8550570f32 update readme ghost 2023-07-25 20:52:44 +0300
  • 3a610d5ccb add hostPageSnap truncate command ghost 2023-07-25 20:33:25 +0300
  • 39046fe290 fix branch name ghost 2023-07-25 18:45:02 +0300
  • 9a33ff1b9d update margins ghost 2023-07-23 14:54:37 +0300
  • b08cd801d9 make paddings relative ghost 2023-07-23 14:50:33 +0300
  • 3d301faa10 update readme ghost 2023-07-13 17:50:19 +0300
  • 07ae53df60 add crawl/clean commands to the CLI tool ghost 2023-07-12 21:30:53 +0300
  • 4cb27f563f fix meta index/nofollow processing ghost 2023-07-12 12:27:30 +0300
  • b7c415a8b0 crawl host page DOM selectors on meta robots:index/follow condition enabled only ghost 2023-07-12 12:16:26 +0300
  • 5c0cee7561 change project link ghost 2023-07-07 12:43:56 +0300
  • 95deeb90c7 add links description in the title tag ghost 2023-07-07 12:41:48 +0300
  • 443eaec64e autodelete failed snaps ghost 2023-07-07 12:30:07 +0300
  • 4298203cab make paths absolute ghost 2023-06-30 14:38:29 +0300
  • 01d5356791 remove extra brackets ghost 2023-06-30 13:41:07 +0300