245 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
ghost	6c41dd5831	fix ban time update / count affected rows only	2023-05-06 10:11:25 +03:00
ghost	20514c455f	add banned items counters	2023-05-06 08:50:41 +03:00
ghost	b6605b9132	implement not reachable resources ban feature with timeout to prevent extra http requests	2023-05-06 08:45:37 +03:00
ghost	cfa5d01db1	update readme	2023-05-06 07:33:34 +03:00
ghost	702a14b634	add mime content type crawling #1	2023-05-06 07:25:54 +03:00
ghost	0bd95d7f4d	fix comments	2023-05-05 21:39:48 +03:00
ghost	f88d2ee9ff	implement MIME content-type crawler filter	2023-05-05 21:25:57 +03:00
ghost	d945fdfd91	update readme	2023-05-05 20:29:12 +03:00
ghost	0e7220f7f8	display url decoded links	2023-05-05 20:09:15 +03:00
ghost	bca05e66e9	update readme	2023-05-05 19:53:54 +03:00
ghost	bed5d3f149	fix offset out of bounds error	2023-05-05 15:16:36 +03:00
ghost	c45592b459	update readme	2023-05-05 13:32:56 +03:00
ghost	ff187cfd60	update readme	2023-05-05 13:27:57 +03:00
ghost	b1ac5e64a1	update readme	2023-05-05 13:22:53 +03:00
ghost	376476c7b0	update readme	2023-05-05 13:20:50 +03:00
ghost	44b4b50336	update readme	2023-05-05 13:20:23 +03:00
ghost	d1312a2ade	update readme	2023-05-05 13:15:49 +03:00
ghost	e99dae84dd	update readme	2023-05-05 13:09:38 +03:00
ghost	14541ae5e3	update readme	2023-05-05 12:59:46 +03:00
ghost	052c829b64	update readme	2023-05-05 12:52:20 +03:00
ghost	a1d8522006	update readme	2023-05-05 12:49:07 +03:00
ghost	05fedc6fa6	update readme	2023-05-05 12:25:22 +03:00
ghost	ce16d2dd9f	update readme	2023-05-05 12:17:48 +03:00
ghost	6a3f4d1904	update readme	2023-05-05 11:56:53 +03:00
ghost	747caccea5	update readme	2023-05-05 11:55:50 +03:00
ghost	b09ac5eb43	update readme	2023-05-05 11:53:32 +03:00
ghost	463b81af5e	update readme	2023-05-05 11:49:16 +03:00
ghost	4d54e5cc8f	update readme	2023-05-05 11:46:03 +03:00
ghost	32e81ede31	update readme	2023-05-05 11:41:40 +03:00
ghost	5999fb3a73	add distributed hosts crawling using yggo nodes manifest	2023-05-05 05:26:53 +03:00
ghost	f0b2eb1613	show images total instead of pages in placeholder on image search page	2023-05-05 01:42:44 +03:00
ghost	5297e6e918	fix condition error	2023-05-04 11:35:22 +03:00
ghost	297563d4a5	display related pages in priority to the unique host by rank, rand() order	2023-05-04 10:53:37 +03:00
ghost	34b7291228	add related to image hostpages limit	2023-05-04 10:17:47 +03:00
ghost	adc791f378	fix updateTime init	2023-05-04 10:11:13 +03:00
ghost	317a58cfa2	add main container paddings for mobile browsers	2023-05-04 09:55:52 +03:00
ghost	5310c3423b	update search page header	2023-05-04 09:52:08 +03:00
ghost	0cc712f24e	fix variable definition	2023-05-04 09:24:21 +03:00
ghost	834ac68cce	create separated pagination settings for page/image search types	2023-05-04 09:20:34 +03:00
ghost	d8449d4f7d	update db prototype	2023-05-04 08:55:03 +03:00
ghost	dad9a2633c	increase h3 margins	2023-05-04 08:53:41 +03:00
ghost	d4f66c83e7	fix image crawling errors	2023-05-04 08:51:45 +03:00
ghost	baa8b0d2f0	fix data type formatting	2023-05-04 07:58:07 +03:00
ghost	79878d17fe	add crawler / proxy user agent settings	2023-05-04 07:38:22 +03:00
ghost	73f212e3d7	set crawler queue order priority to item rank, rand()	2023-05-04 06:55:05 +03:00
ghost	9ed8411d2f	add image queue crawler	2023-05-04 06:45:04 +03:00
ghost	d905e33b4f	update host images info on search requests	2023-05-04 06:12:51 +03:00
ghost	68581960a3	add image.data field	2023-05-04 05:19:29 +03:00
ghost	9c24eda833	switch to native curl library	2023-05-04 04:56:25 +03:00
ghost	100d12c6ab	update curl library constructor	2023-05-04 04:55:26 +03:00