132 Commits

Author	SHA1	Message	Date
ghost	0d19004e86	make local snap storage optimization	2023-05-14 01:45:55 +03:00
ghost	efc66d5dab	update local snap storage paths	2023-05-13 11:06:40 +03:00
ghost	2f7d99079d	implement local snaps	2023-05-13 10:15:07 +03:00
ghost	d98b8f5c94	remove hostPageToHostPage.quantity field because of implements wrong duplicates counting on reindex	2023-05-13 06:30:40 +03:00
ghost	eeeb3dceac	implement index explorer	2023-05-13 05:54:15 +03:00
ghost	377b519a2c	implement host page info mode	2023-05-13 03:51:34 +03:00
ghost	371670fadf	add media referrers info	2023-05-13 03:01:00 +03:00
ghost	ced7d7c9d6	remove unused css construction	2023-05-11 08:00:46 +03:00
ghost	9ad03c8153	add meta data description	2023-05-11 07:40:09 +03:00
ghost	b83ad6cc3a	fix default mime	2023-05-11 01:45:36 +03:00
ghost	acafdfcf3a	add method filters	2023-05-11 01:34:09 +03:00
ghost	4486bdc215	show mime type options that match search results only	2023-05-10 20:37:05 +03:00
ghost	db0e66c846	refactor to mime-based content index #1	2023-05-10 12:47:36 +03:00
ghost	272a885039	add line separator	2023-05-09 16:37:56 +03:00
ghost	12c33d8ed6	add line separator	2023-05-09 16:34:33 +03:00
ghost	c13842b6c0	remove extra query	2023-05-09 16:30:36 +03:00
ghost	0ffcee1efb	fix image description updates timing	2023-05-09 15:53:21 +03:00
ghost	2c5ca1b630	fix image description duplicate	2023-05-09 15:23:32 +03:00
ghost	28bf526d53	add host nsfw settings	2023-05-09 13:26:19 +03:00
ghost	ef4de6b245	fix image search page errors	2023-05-09 08:53:33 +03:00
ghost	23ead4e12c	update page / image description models, implement history snap crawling	2023-05-09 08:19:49 +03:00
ghost	0e9d29675f	implement host page description history crawling	2023-05-09 01:29:32 +03:00
ghost	32d0f390d3	update http code and mime type on page/image ban event	2023-05-08 14:13:53 +03:00
ghost	84dcecf50b	add svg images support, fix mime validation	2023-05-08 13:12:16 +03:00
ghost	e6da2e729a	fix images ban update	2023-05-08 13:00:02 +03:00
ghost	8fbd7f3516	count totals using sphinx index instead of database	2023-05-08 12:28:49 +03:00
ghost	fdd18de373	remove abstraction	2023-05-06 14:03:43 +03:00
ghost	4801360a51	update api version	2023-05-06 13:55:05 +03:00
ghost	b6605b9132	implement not reachable resources ban feature with timeout to prevent extra http requests	2023-05-06 08:45:37 +03:00
ghost	702a14b634	add mime content type crawling #1	2023-05-06 07:25:54 +03:00
ghost	0e7220f7f8	display url decoded links	2023-05-05 20:09:15 +03:00
ghost	f0b2eb1613	show images total instead of pages in placeholder on image search page	2023-05-05 01:42:44 +03:00
ghost	297563d4a5	display related pages in priority to the unique host by rank, rand() order	2023-05-04 10:53:37 +03:00
ghost	317a58cfa2	add main container paddings for mobile browsers	2023-05-04 09:55:52 +03:00
ghost	5310c3423b	update search page header	2023-05-04 09:52:08 +03:00
ghost	834ac68cce	create separated pagination settings for page/image search types	2023-05-04 09:20:34 +03:00
ghost	dad9a2633c	increase h3 margins	2023-05-04 08:53:41 +03:00
ghost	79878d17fe	add crawler / proxy user agent settings	2023-05-04 07:38:22 +03:00
ghost	9ed8411d2f	add image queue crawler	2023-05-04 06:45:04 +03:00
ghost	d905e33b4f	update host images info on search requests	2023-05-04 06:12:51 +03:00
ghost	68581960a3	add image.data field	2023-05-04 05:19:29 +03:00
ghost	9c24eda833	switch to native curl library	2023-05-04 04:56:25 +03:00
ghost	bb4e97eea3	use curl for image connections to prevent queue timeout	2023-05-04 04:42:07 +03:00
ghost	6b18202588	implement proxied image search #1	2023-05-04 03:48:57 +03:00
ghost	0741a3e9ef	implement image crawler	2023-05-04 01:04:39 +03:00
ghost	1ee2ac4f0b	add yggo:manifest namespace	2023-05-03 09:38:58 +03:00
ghost	219a56d6cd	update manifest API	2023-05-03 05:47:02 +03:00
ghost	0bd765064b	implement extended search mode support #9	2023-05-01 20:09:28 +03:00
ghost	f7807cf43e	add extended syntax filter to prevent sphinxql query error #9	2023-05-01 18:39:46 +03:00
ghost	9ae91ee187	remove phrase search mask, allow sphinx macroses	2023-04-29 07:41:59 +03:00
ghost	a16a13b395	add application mode settings	2023-04-25 20:25:12 +03:00
ghost	9396c52313	change manifest API key names	2023-04-25 19:53:52 +03:00
ghost	957f15188b	add CRAWL_PAGE_SECONDS_OFFSET info	2023-04-25 19:38:17 +03:00
ghost	a2fc14c8cf	implement manifest API	2023-04-25 19:35:52 +03:00
ghost	57f64f6b90	add hostPage weight and rank info	2023-04-25 16:53:13 +03:00
ghost	fcee7f62ef	fix max_matches error	2023-04-23 09:29:24 +03:00
ghost	8dbb4a06af	add disk quota validation	2023-04-23 04:05:00 +03:00
ghost	0df47efa8b	fix API_ENABLED condition	2023-04-23 03:25:43 +03:00
ghost	9916fb701f	implement basic api	2023-04-23 03:01:51 +03:00
ghost	9018acd0e2	update meta tags	2023-04-09 01:22:36 +03:00
ghost	139e2c88eb	add robots.txt	2023-04-09 01:16:53 +03:00
ghost	df6f2a1869	implement CRAWL_ROBOTS_POSTFIX_RULES configuration #5	2023-04-08 22:28:31 +03:00
ghost	2495a2bbc7	implement MySQL/Sphinx data model #3, add basical robots.txt support #2	2023-04-07 04:04:24 +03:00
ghost	183ad99ccd	change repository address	2023-04-03 17:56:51 +03:00
ghost	bac2ffa635	add image dimentions for low connection UI optimization	2023-04-03 01:57:52 +03:00
ghost	5c55ee0e3f	update search page style	2023-04-03 01:55:26 +03:00
ghost	74578b7aad	fix extension to webp	2023-04-03 01:38:01 +03:00
ghost	18edb66ab0	urlencode identicon requests	2023-04-03 01:33:23 +03:00
ghost	ff95df72c1	implement hostname identicons	2023-04-03 01:30:09 +03:00
ghost	c00e4c7e70	fix empty request title	2023-04-02 23:49:04 +03:00
ghost	a3bdccddd6	fix pagination link condition	2023-04-02 23:39:13 +03:00
ghost	4ea01bf8b4	implement search results pagination	2023-04-02 23:36:35 +03:00
ghost	baf0925d36	add copyright notice	2023-04-02 23:06:02 +03:00
ghost	b40ff3c7a6	update input paddings	2023-04-02 22:05:47 +03:00
ghost	f990a93835	add css animation on the home page	2023-04-02 22:04:41 +03:00
ghost	747fb1e52c	fix text contrast in chromium browser	2023-04-02 22:02:53 +03:00
ghost	04dbbc3adf	make url/src column ukeys digital by using crc32	2023-04-02 18:56:56 +03:00
ghost	b218b8bbc3	make url/src columns unique keys, add insert/ignore construction	2023-04-02 18:09:44 +03:00
ghost	8aeadcb604	fix tags case	2023-04-02 16:07:57 +03:00
ghost	d5f33ad643	add ceawl in queue notification	2023-04-02 01:30:50 +03:00
ghost	4b95eaaecc	fix meow	2023-04-01 19:56:47 +03:00
ghost	72985eaf9e	initial commit	2023-04-01 19:29:39 +03:00