Commit Graph

517 Commits

Author SHA1 Message Date
ghost
d3c628b477 update Filter::searchQuery method 2023-08-01 11:01:08 +03:00
ghost
61a0652f51 update Filter::searchQuery method 2023-07-31 23:33:06 +03:00
ghost
3235133cd0 extract keywords from URI 2023-07-31 22:42:49 +03:00
ghost
3d6bc54b66 update Filter::searchQuery method 2023-07-31 22:07:59 +03:00
ghost
2ef9948342 change default CRAWL_PAGE_HOME_SECONDS_OFFSET value to 1 month 2023-07-31 22:04:27 +03:00
ghost
fd3444a379 change timestamp sort order 2023-07-31 14:25:38 +03:00
ghost
9c0f361601 refactor snap storage 2023-07-31 13:33:30 +03:00
ghost
5d7bcba42b minor optimization 2023-07-31 01:45:34 +03:00
ghost
a242d7b05a fix hostPageSnapId to hostPageId 2023-07-31 01:28:11 +03:00
ghost
aacbdfebc8 enable localhost DB-FS relations sync 2023-07-30 23:33:31 +03:00
ghost
0ea665f6e7 change method name 2023-07-30 23:32:02 +03:00
ghost
9e53618193 add snap file existing message 2023-07-30 22:24:16 +03:00
ghost
1e6451f863 update output message on snap index deletion 2023-07-30 22:12:30 +03:00
ghost
3546e07d6a fix roadmap in the CLI hostPageSnap section 2023-07-30 22:08:05 +03:00
ghost
9f23a0ebe4 move clean/crawl commans to the crontab options 2023-07-30 22:05:37 +03:00
ghost
1dbb9f0366 keep native functions inside the nlistr method 2023-07-30 22:00:18 +03:00
ghost
000b9ad8dd add FS cleaning features, lock execution on active crontab tasks, disable hostPageSnap/localhost untested constructions 2023-07-30 21:53:30 +03:00
ghost
547cd6717b prevent scheduled execution on cli/yggo running 2023-07-30 21:47:09 +03:00
ghost
3e3b7ee2ef optimize snaps, delete unused constructions 2023-07-30 19:09:41 +03:00
ghost
36becf6fe1 remove dots 2023-07-30 18:13:23 +03:00
ghost
db7e92391d remove undefined variable from CLI output 2023-07-30 18:06:46 +03:00
ghost
fde30da74c fix variable name 2023-07-30 17:59:15 +03:00
ghost
30a81ca6fb delete snaps from registry when not found in the any of storage available 2023-07-30 17:42:36 +03:00
ghost
1972b3411c fix snap file location 2023-07-30 14:46:07 +03:00
ghost
3c4a89d16d fix host page snap storage id 2023-07-30 14:39:21 +03:00
ghost
307eb03600 build host/host page URL in SQL query 2023-07-30 13:02:24 +03:00
ghost
b13293988a add search index by host and host page URL 2023-07-30 12:39:41 +03:00
ghost
1e664ba4cd cover snap deletion in transaction 2023-07-30 12:18:35 +03:00
ghost
1f33205236 add script tag support 2023-07-30 00:52:55 +03:00
ghost
b9ec787bbb decrease length of link previews 2023-07-30 00:21:45 +03:00
ghost
b433fa6b3c add link tag support 2023-07-30 00:17:28 +03:00
ghost
a5a48f37f7 read sitemap location in user-agent:* only 2023-07-29 23:37:25 +03:00
ghost
051bfb2e81 update snap reindex CLI output 2023-07-29 20:23:43 +03:00
ghost
43f53f0967 fix method name 2023-07-29 20:07:44 +03:00
ghost
0c2b42eff1 fix color formatting 2023-07-29 20:05:30 +03:00
ghost
cd30be8147 fix CLI::danger method name 2023-07-29 20:02:53 +03:00
ghost
2673f3d316 add snap reindex [purge] option, fix storage crc32name index 2023-07-29 20:02:08 +03:00
ghost
79d07dd1a5 fix snap fs init 2023-07-29 19:53:31 +03:00
ghost
6eb45fdad2 fix snap crc32name index 2023-07-29 19:38:09 +03:00
ghost
99860bb4aa update readme 2023-07-29 17:52:51 +03:00
ghost
be1e83c5e4 add explore page 2023-07-29 17:52:38 +03:00
ghost
0e39ee7361 implement snap reindex command, cover CLI output 2023-07-29 17:49:07 +03:00
ghost
86ab00e258 fix typo 2023-07-29 17:31:53 +03:00
ghost
8a2a79b65c add hostPageSnapStorage table to the optimization queue 2023-07-29 17:27:55 +03:00
ghost
c0922ef536 add CLI::brake method 2023-07-29 17:22:25 +03:00
ghost
c5b4bebd98 init CLI helper 2023-07-29 17:04:20 +03:00
ghost
dcf15fb49f add connection close 2023-07-29 16:00:04 +03:00
ghost
c160549cf5 add list metod 2023-07-29 15:50:49 +03:00
ghost
712d67f6bf implement unlimited snap storage mirrors, delete megaCMD integration 2023-07-29 14:37:01 +03:00
ghost
9b52e3b7f5 delete unused constructions 2023-07-28 12:55:25 +03:00