Commit Graph

415 Commits

Author SHA1 Message Date
ghost
4a4394fb27 add memcached support 2023-07-27 17:53:36 +03:00
ghost
0fb2e8a78c fix active pages total 2023-07-27 16:53:25 +03:00
ghost
a4b4ea324b change top rating from hosts to pages 2023-07-27 15:09:58 +03:00
ghost
2e2501b437 implement sitemap support 2023-07-27 11:44:42 +03:00
ghost
a905499926 fix api version 2023-07-26 13:22:21 +03:00
ghost
abc75c9adf update footer links 2023-07-26 13:07:55 +03:00
ghost
14b281cd0c update readme 2023-07-26 13:06:42 +03:00
ghost
407e0d7f18 implement top page 2023-07-26 12:51:00 +03:00
ghost
dca45c69ce fix default font color 2023-07-26 12:18:53 +03:00
ghost
56c21a47c6 add htmlentities 2023-07-25 23:40:41 +03:00
ghost
9104dbd61d remove unused dependencies 2023-07-25 22:41:52 +03:00
ghost
8550570f32 update readme 2023-07-25 20:52:44 +03:00
ghost
3a610d5ccb add hostPageSnap truncate command 2023-07-25 20:33:25 +03:00
ghost
39046fe290 fix branch name 2023-07-25 18:45:02 +03:00
ghost
9a33ff1b9d update margins 2023-07-23 14:54:37 +03:00
ghost
b08cd801d9 make paddings relative 2023-07-23 14:50:33 +03:00
ghost
3d301faa10 update readme 2023-07-13 17:50:19 +03:00
ghost
07ae53df60 add crawl/clean commands to the CLI tool 2023-07-12 21:30:53 +03:00
ghost
4cb27f563f fix meta index/nofollow processing 2023-07-12 12:27:30 +03:00
ghost
b7c415a8b0 crawl host page DOM selectors on meta robots:index/follow condition enabled only 2023-07-12 12:16:26 +03:00
ghost
5c0cee7561 change project link 2023-07-07 12:43:56 +03:00
ghost
95deeb90c7 add links description in the title tag 2023-07-07 12:41:48 +03:00
ghost
443eaec64e autodelete failed snaps 2023-07-07 12:30:07 +03:00
ghost
4298203cab make paths absolute 2023-06-30 14:38:29 +03:00
ghost
01d5356791 remove extra brackets 2023-06-30 13:41:07 +03:00
ghost
3218add372 add custom home page reindex settings 2023-06-30 13:28:22 +03:00
ghost
f4bf6b9fa4 fix crawl queue message 2023-06-27 13:14:53 +03:00
ghost
d912caeb0c fix variable name 2023-06-27 13:01:46 +03:00
ghost
6702c3f402 add hostPageDom generate [selectors] attribute 2023-06-26 17:15:28 +03:00
ghost
29197ab904 remove testing construction 2023-06-26 15:59:08 +03:00
ghost
ed240d53b0 show available snaps only 2023-06-25 23:29:30 +03:00
ghost
2c5128382b fix semaphore ID 2023-06-25 22:16:05 +03:00
ghost
a79943dbae update readme 2023-06-25 22:12:07 +03:00
ghost
ebc1a573dc initiate CLI tool 2023-06-25 22:11:49 +03:00
ghost
5346b13602 implement custom hostPageDom elements index 2023-06-25 22:10:47 +03:00
ghost
5df598a1d4 fix variable name 2023-06-24 15:21:47 +03:00
ghost
1c5346bc07 remove single char words 2023-06-22 13:37:12 +03:00
ghost
e16a7b8171 fix HY000/1366 error processing 2023-06-17 11:33:32 +03:00
ghost
dc2d971ba0 clean up banned pages extra data 2023-06-16 16:53:14 +03:00
ghost
a657d31e1d fix enum data type 2023-06-16 16:32:46 +03:00
ghost
d96abb8ea8 ban host page on encoding not detected 2023-06-16 13:23:52 +03:00
ghost
d2469e9adc fix meta variables overwrite 2023-06-14 02:53:14 +03:00
ghost
0949d7f871 set default encoding 2023-06-14 02:20:09 +03:00
ghost
1d5d5ead5d fix DomDocument initiation without encoding provided 2023-06-14 02:20:00 +03:00
ghost
fcda6b9885 remove MIME filters from explorer search form 2023-06-13 23:25:17 +03:00
ghost
f3475035c2 show page size in explorer view, hide not available data 2023-06-13 23:20:22 +03:00
ghost
8a747de341 fix HTML/multimedia content detection 2023-06-13 23:09:44 +03:00
ghost
93c6067fd9 fix host page mime detection 2023-06-13 22:29:28 +03:00
ghost
c07d6af52f add new mime preset 2023-06-13 21:57:01 +03:00
ghost
052b08ea26 show results quantity in the mime filter titles 2023-06-13 21:20:02 +03:00