310 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
erdgeist	e3103d30f7	Debug settings for chunk size were _way_ to low for production	2007-11-24 11:09:18 +00:00
erdgeist	8f7ef4b2ea	Completely rewritten fullscrape code. All assumptions on how deflate() works were a little naive. Needs more error checking and testing.	2007-11-23 18:15:38 +00:00
erdgeist	54560fdcd3	strnstr is not part of what posix conform libc has to offer... replace it by strstr after cutting off the last byte	2007-11-23 18:14:22 +00:00
erdgeist	afcef0537c	Reflect changes in iovec code in sync code	2007-11-23 18:13:11 +00:00
erdgeist	616302c139	make ot_iovecs fix last interface more sane, also add a convenience function that handles the task of fixing, allocating and - if necessary - freeing	2007-11-23 18:12:50 +00:00
erdgeist	b1c8723609	Introducing compression for fullscrapes and tpbs stats	2007-11-22 04:39:08 +00:00
erdgeist	4bf12406fb	Introducing compression task flags	2007-11-22 04:38:25 +00:00
erdgeist	c09ad325cc	Make allowing gzip a Makefile tunable	2007-11-22 04:37:41 +00:00
erdgeist	c5e5569770	Fixing mmap allocation went to ot_mutex.c. Clean all torrents moved to ot_clean.c. Also make static buffers static	2007-11-21 01:57:39 +00:00
erdgeist	acaf7ae2b3	Fixing mmap allocation went to ot_mutex.c. Also startup new sync thread.	2007-11-21 01:57:03 +00:00
erdgeist	b73b19f8f4	Formatting	2007-11-21 01:56:14 +00:00
erdgeist	8bee224dc0	static bufs are not shared anymore, even if that means more memory.	2007-11-21 01:55:59 +00:00
erdgeist	9e45802946	Reflect changes in multithreaded sync model in header file.	2007-11-21 01:55:42 +00:00
erdgeist	4072f162b4	Make sync generation multithreaded.	2007-11-21 01:55:15 +00:00
erdgeist	e65a41d000	Split sync in and sync out into different tasks	2007-11-21 01:54:52 +00:00
erdgeist	a85798279b	Documentation fix	2007-11-21 01:54:31 +00:00
erdgeist	e65ac51a28	Last user of sendmmapdata is gone. Purge it.	2007-11-21 01:53:17 +00:00
erdgeist	e9d49af9fa	Tested for a too strict condition, we do need the correct tasktype AND an empty taskid, not the other way around	2007-11-20 02:55:13 +00:00
erdgeist	74a5afbe82	Make clean_single_torrent return much faster, if nothing is to do	2007-11-20 02:22:21 +00:00
erdgeist	cf8d4fae1d	Sockets do not inherit non-blocking state in libowfat...	2007-11-20 02:21:53 +00:00
erdgeist	6d09527ed8	Fullscrape now cleanly finalizes its thread	2007-11-19 21:14:09 +00:00
erdgeist	49ba269b9d	Cleanup now moved to its own thread, too	2007-11-19 21:10:53 +00:00
erdgeist	3528752c7b	Missing include for htonl()	2007-11-19 01:02:10 +00:00
erdgeist	8d5f221785	Full scrapes are now being delivered in different modes, as triggered by stats&mode=tpbs	2007-11-18 16:47:37 +00:00
erdgeist	dab9055590	Reflect new task-classes model in fullscrape worker	2007-11-18 16:46:48 +00:00
erdgeist	9cd6e355be	Reflect new task-classes model in mutex queue	2007-11-18 16:46:34 +00:00
erdgeist	44a674c9df	Stats are tasks now, they also come in classes.	2007-11-18 16:46:01 +00:00
erdgeist	edc73298f8	Stats are tasks now.	2007-11-18 16:45:34 +00:00
erdgeist	4735b99db2	Forgot to specify -pthread when using threads	2007-11-16 20:19:15 +00:00
erdgeist	6458a37d82	introducing multithreaded full scrape creation.	2007-11-16 00:23:42 +00:00
erdgeist	d3963803ca	tasklist code now tested in a multi threaded environment.	2007-11-15 03:35:03 +00:00
erdgeist	e476006019	Move dead socket handling from handle_(read,write,timedout) into its own function handle_dead	2007-11-14 13:06:34 +00:00
erdgeist	cf26f2ab23	Introducing the workqueue	2007-11-14 12:59:58 +00:00
erdgeist	91a3a3b342	Increase full scrape chunk size to 1/2meg	2007-11-13 00:33:55 +00:00
erdgeist	17b2ce1082	Rather embarrasing arithmetic fuckup	2007-11-13 00:30:17 +00:00
erdgeist	04214491ee	missing include	2007-11-13 00:01:24 +00:00
erdgeist	3eb88c5cc6	Fix typos in documenation	2007-11-12 17:26:01 +00:00
erdgeist	71e9ec887c	Some in code documentation to make Denis happy :)	2007-11-12 16:54:21 +00:00
erdgeist	697e239027	Moving accesslist stuff to its own object	2007-11-12 04:39:53 +00:00
erdgeist	0547e2ade2	Return at end of line missing	2007-11-12 01:45:33 +00:00
erdgeist	a8993b8eea	Moving full scrapes to iovec-creating thread safe function	2007-11-12 01:41:57 +00:00
erdgeist	ed0b67020a	Dokumentation	2007-11-12 01:40:00 +00:00
erdgeist	bb80834bf1	Reflect changes in ot_iovec and ot_fullscrape in Makefile	2007-11-12 01:39:18 +00:00
erdgeist	a0d12f9ab5	Full scrape moves to its own object	2007-11-12 01:38:54 +00:00
erdgeist	31f5b923eb	Fullscrape is thread safe now.	2007-11-12 01:38:08 +00:00
erdgeist	54bdad552e	New large chunk allocation code	2007-11-12 01:37:47 +00:00
erdgeist	5da91fd8f2	MUST NOT enable features in CVSpico Makefile bad coder	2007-11-06 18:02:29 +00:00
erdgeist	927ac023ce	The expensive DMEM stats is gone. No need for it, too much potential to DOS.	2007-11-06 18:02:03 +00:00
erdgeist	ad5fa66737	Missing newline warning, missing include fixed	2007-11-06 17:53:45 +00:00
erdgeist	49c4bbb47f	Have an own file handle udp requests.	2007-11-06 17:51:48 +00:00