143 Commits

Author	SHA1	Message	Date
ghost	be81299c84	update readme	2023-06-13 17:35:47 +03:00
ghost	20726fca45	update readme	2023-06-10 00:20:39 +03:00
ghost	a79993a94b	add an mk	2023-06-08 00:11:02 +03:00
ghost	3d3fcdda87	update readme	2023-06-05 13:44:23 +03:00
ghost	a1249859a8	update readme	2023-06-05 13:42:19 +03:00
ghost	eef23cc830	update readme	2023-06-05 13:40:35 +03:00
ghost	345c59b5f4	collect target location links on page redirect available	2023-06-04 14:58:33 +03:00
ghost	5a47c66e55	fix readme description	2023-06-04 11:49:25 +03:00
ghost	f49076bb0c	index homepages and shorter URL with higher priority	2023-06-04 11:38:56 +03:00
ghost	3b1590cf7b	update readme	2023-06-01 00:07:11 +03:00
ghost	69eb8d4ed4	update readme	2023-05-31 16:30:05 +03:00
ghost	52bd900ad4	update readme	2023-05-31 16:28:58 +03:00
ghost	fc687f7f2c	update readme	2023-05-18 14:13:00 +03:00
ghost	3113057a36	update readme	2023-05-18 14:11:42 +03:00
ghost	6e45c85ce4	update readme	2023-05-17 13:52:50 +03:00
ghost	d88b30925c	update readme	2023-05-17 13:50:04 +03:00
ghost	3d100568d7	update readme	2023-05-17 13:48:56 +03:00
ghost	940d5b0042	update readme	2023-05-15 21:54:37 +03:00
ghost	56a706948e	update readme	2023-05-15 21:25:54 +03:00
ghost	35acabeab9	update readme	2023-05-15 21:18:30 +03:00
ghost	ae7467ad75	update readme	2023-05-15 09:34:36 +03:00
ghost	df195249df	update readme	2023-05-15 09:33:16 +03:00
ghost	81f7ea1e1e	implement multi-storage snap downloads	2023-05-15 09:18:18 +03:00
ghost	afb014cdb2	update readme	2023-05-14 19:42:55 +03:00
ghost	1969707eeb	integrate optional MEGA/cmd snap storage	2023-05-14 19:41:20 +03:00
ghost	134b70e130	update readme	2023-05-14 01:51:30 +03:00
ghost	0d19004e86	make local snap storage optimization	2023-05-14 01:45:55 +03:00
ghost	efc66d5dab	update local snap storage paths	2023-05-13 11:06:40 +03:00
ghost	375a94a510	update readme	2023-05-13 10:18:05 +03:00
ghost	2f7d99079d	implement local snaps	2023-05-13 10:15:07 +03:00
ghost	eeeb3dceac	implement index explorer	2023-05-13 05:54:15 +03:00
ghost	371670fadf	add media referrers info	2023-05-13 03:01:00 +03:00
ghost	89d1b2230b	update readme	2023-05-11 08:46:44 +03:00
ghost	34e25a1d94	update readme	2023-05-10 14:32:36 +03:00
ghost	db0e66c846	refactor to mime-based content index #1	2023-05-10 12:47:36 +03:00
ghost	7dc7c89d9e	update readme	2023-05-09 10:22:41 +03:00
ghost	d186fff48f	skip curl download on response data size reached	2023-05-09 10:21:37 +03:00
ghost	377d4935ad	update readme	2023-05-09 08:28:09 +03:00
ghost	25b6bce2ec	add crawler/cleaner logs	2023-05-08 11:04:59 +03:00
ghost	b6605b9132	implement not reachable resources ban feature with timeout to prevent extra http requests	2023-05-06 08:45:37 +03:00
ghost	cfa5d01db1	update readme	2023-05-06 07:33:34 +03:00
ghost	702a14b634	add mime content type crawling #1	2023-05-06 07:25:54 +03:00
ghost	d945fdfd91	update readme	2023-05-05 20:29:12 +03:00
ghost	bca05e66e9	update readme	2023-05-05 19:53:54 +03:00
ghost	c45592b459	update readme	2023-05-05 13:32:56 +03:00
ghost	ff187cfd60	update readme	2023-05-05 13:27:57 +03:00
ghost	b1ac5e64a1	update readme	2023-05-05 13:22:53 +03:00
ghost	376476c7b0	update readme	2023-05-05 13:20:50 +03:00
ghost	44b4b50336	update readme	2023-05-05 13:20:23 +03:00
ghost	d1312a2ade	update readme	2023-05-05 13:15:49 +03:00