Commit Graph

378 Commits

Author SHA1 Message Date
ghost
e99dae84dd update readme 2023-05-05 13:09:38 +03:00
ghost
14541ae5e3 update readme 2023-05-05 12:59:46 +03:00
ghost
052c829b64 update readme 2023-05-05 12:52:20 +03:00
ghost
a1d8522006 update readme 2023-05-05 12:49:07 +03:00
ghost
05fedc6fa6 update readme 2023-05-05 12:25:22 +03:00
ghost
ce16d2dd9f update readme 2023-05-05 12:17:48 +03:00
ghost
6a3f4d1904 update readme 2023-05-05 11:56:53 +03:00
ghost
747caccea5 update readme 2023-05-05 11:55:50 +03:00
ghost
b09ac5eb43 update readme 2023-05-05 11:53:32 +03:00
ghost
463b81af5e update readme 2023-05-05 11:49:16 +03:00
ghost
4d54e5cc8f update readme 2023-05-05 11:46:03 +03:00
ghost
32e81ede31 update readme 2023-05-05 11:41:40 +03:00
ghost
5999fb3a73 add distributed hosts crawling using yggo nodes manifest 2023-05-05 05:26:53 +03:00
ghost
f0b2eb1613 show images total instead of pages in placeholder on image search page 2023-05-05 01:42:44 +03:00
ghost
5297e6e918 fix condition error 2023-05-04 11:35:22 +03:00
ghost
297563d4a5 display related pages in priority to the unique host by rank, rand() order 2023-05-04 10:53:37 +03:00
ghost
34b7291228 add related to image hostpages limit 2023-05-04 10:17:47 +03:00
ghost
adc791f378 fix updateTime init 2023-05-04 10:11:13 +03:00
ghost
317a58cfa2 add main container paddings for mobile browsers 2023-05-04 09:55:52 +03:00
ghost
5310c3423b update search page header 2023-05-04 09:52:08 +03:00
ghost
0cc712f24e fix variable definition 2023-05-04 09:24:21 +03:00
ghost
834ac68cce create separated pagination settings for page/image search types 2023-05-04 09:20:34 +03:00
ghost
d8449d4f7d update db prototype 2023-05-04 08:55:03 +03:00
ghost
dad9a2633c increase h3 margins 2023-05-04 08:53:41 +03:00
ghost
d4f66c83e7 fix image crawling errors 2023-05-04 08:51:45 +03:00
ghost
baa8b0d2f0 fix data type formatting 2023-05-04 07:58:07 +03:00
ghost
79878d17fe add crawler / proxy user agent settings 2023-05-04 07:38:22 +03:00
ghost
73f212e3d7 set crawler queue order priority to item rank, rand() 2023-05-04 06:55:05 +03:00
ghost
9ed8411d2f add image queue crawler 2023-05-04 06:45:04 +03:00
ghost
d905e33b4f update host images info on search requests 2023-05-04 06:12:51 +03:00
ghost
68581960a3 add image.data field 2023-05-04 05:19:29 +03:00
ghost
9c24eda833 switch to native curl library 2023-05-04 04:56:25 +03:00
ghost
100d12c6ab update curl library constructor 2023-05-04 04:55:26 +03:00
ghost
bb4e97eea3 use curl for image connections to prevent queue timeout 2023-05-04 04:42:07 +03:00
ghost
63b51f71c6 fix space offset 2023-05-04 04:20:54 +03:00
ghost
f980b6318c add page meta to the image index 2023-05-04 04:20:20 +03:00
ghost
250e20bbcd remove separator 2023-05-04 04:19:38 +03:00
ghost
6b18202588 implement proxied image search #1 2023-05-04 03:48:57 +03:00
ghost
baf78e2bf5 add hostImage examples to sphinx configuration 2023-05-04 01:34:12 +03:00
ghost
0741a3e9ef implement image crawler 2023-05-04 01:04:39 +03:00
ghost
78931ebc74 normalize host image description storage 2023-05-03 21:52:00 +03:00
ghost
1122cb9798 update DB prototype 2023-05-03 21:51:26 +03:00
ghost
db617f9939 refactor image storage model 2023-05-03 21:27:15 +03:00
ghost
74fb0d50be add DB prototype scheme 2023-05-03 21:26:32 +03:00
ghost
1ee2ac4f0b add yggo:manifest namespace 2023-05-03 09:38:58 +03:00
ghost
56c79d8f3a update config documentation 2023-05-03 09:31:40 +03:00
ghost
f8e0a50db6 add manifest url filter 2023-05-03 09:26:48 +03:00
ghost
6d8f4f4882 create manifests registry 2023-05-03 09:22:14 +03:00
ghost
219a56d6cd update manifest API 2023-05-03 05:47:02 +03:00
ghost
eb3e70a7b7 fix robots.txt conditions 2023-05-03 04:17:58 +03:00