7 Commits

Author	SHA1	Message	Date
ghost	d186fff48f	skip curl download on response data size reached	2023-05-09 10:21:37 +03:00
ghost	ea04220de3	add curl requests debug	2023-05-08 08:27:21 +03:00
ghost	f88d2ee9ff	implement MIME content-type crawler filter	2023-05-05 21:25:57 +03:00
ghost	79878d17fe	add crawler / proxy user agent settings	2023-05-04 07:38:22 +03:00
ghost	100d12c6ab	update curl library constructor	2023-05-04 04:55:26 +03:00
ghost	e7e4bb686c	fix curl exec double call	2023-04-03 04:47:31 +03:00
ghost	72985eaf9e	initial commit	2023-04-01 19:29:39 +03:00