erdgeist
6876e16242
assume anything looking like GET /a to be an announce...
2007-10-21 05:36:10 +00:00
erdgeist
3aa286d9b8
Last fix was not enough to get rid off those 1600er buggers.
2007-10-21 05:26:55 +00:00
erdgeist
00972c6c68
Work around the stupid utorrent 1600 bug. That'll be removed after a while.
2007-10-21 05:15:35 +00:00
erdgeist
0de8b53fdd
Now the Holzhammer: GET /an is announce, GET /sc is scrape. Period.
2007-10-21 04:55:19 +00:00
erdgeist
6b2307015f
now accept more classes of announce fuckups
2007-10-21 04:37:37 +00:00
erdgeist
42210450f3
Just one more typo
2007-10-21 04:23:39 +00:00
erdgeist
2cbb480865
Just one more typo
2007-10-21 04:20:42 +00:00
erdgeist
886421d2d5
Work around more typos that might end up in torrent files as announce urls
2007-10-21 04:13:53 +00:00
erdgeist
2b715b89f1
Debug code sometimes copied too much data
2007-10-21 03:37:26 +00:00
erdgeist
ddd85ec7e0
Fixed one leak from struct_http
2007-10-21 01:11:45 +00:00
erdgeist
8098adb48e
Be even more stupidistas-tolerant
2007-10-19 23:15:13 +00:00
erdgeist
84f8738b82
Fix debug output
2007-10-19 22:55:13 +00:00
erdgeist
d768bf6e81
Enable _DEBUG_HTTPERROR to avoid warning...
2007-10-19 22:36:28 +00:00
erdgeist
53bce09735
Include time since startup in full scrape debug output
2007-10-19 22:20:42 +00:00
erdgeist
c59e44ba94
Now limit full scrape to requests sending exactly "GET /scrape HTTP/"
2007-10-19 22:13:59 +00:00
erdgeist
41019c79d8
Introducing multiscrape
2007-10-19 21:56:59 +00:00
erdgeist
d5876ebb6b
Prevent url-decoding for debug by using a temp buffer
2007-10-19 21:00:57 +00:00
erdgeist
271ff156ec
Those stupid "announce ?info_hash" torrents get really annoying. Fix it in announce and scrape.
2007-10-19 20:02:41 +00:00
erdgeist
1b0859411e
be more verbose about what full scrape consumers deliver in their http requests
2007-10-19 15:37:00 +00:00
erdgeist
daf79f694d
After studying opentracker live data, I decided to radically reduce default allocation for vectors and making it grow faster instead: Most pools only had one or two peers, wasting 8*15 or 8*14 bytes.
2007-10-19 14:41:30 +00:00
erdgeist
870c995fbb
Remove an unused variable
2007-10-19 05:23:04 +00:00
erdgeist
cab763d4ee
Release exactly all unused bytes in mmap allocation.
2007-10-19 05:21:01 +00:00
erdgeist
714ea1b88e
give opentracker the missing header file
2007-10-19 03:41:23 +00:00
erdgeist
f56e40c24e
Must not dealloc mmaped buffers with free()
2007-10-19 03:39:04 +00:00
erdgeist
d25cf9307e
Fix misunderstandig of what libowfat thinks are seconds and what I did...
2007-10-19 02:00:53 +00:00
erdgeist
b8b1493127
Increase check interval for timeouted sockets to 10 seconds. That may prevent some disrupted scrapes.
2007-10-19 01:27:23 +00:00
erdgeist
e1f122f7d1
Since array and io_batch are in a union, and we also have time-outing writable sockets, we need to mark, which of the union is used. Also remove the blessed flag from struct http, since its rarely used and can be done in a seperate memcmp.
2007-10-19 01:26:33 +00:00
erdgeist
6eb441d8a0
Cannot access members after they are freed :/
2007-10-19 00:34:56 +00:00
erdgeist
b86e6382a1
Save a lot of work when skipping through uninteresting http request parameters
2007-10-18 23:33:07 +00:00
erdgeist
dba3bb3ae7
Make fromhex() even faster
2007-10-18 11:50:54 +00:00
erdgeist
243d5961d0
fixed one performance bug, where "skipping values from a ¶m=values pair" was requested, the requestor ended up with "values" to be parsed again.
...
improved performance of fromhex
improved performance of is_unreserved() by moving it all into a simple byte array
improved performance of %41 => 'A' conversion by reordering variables
2007-10-18 00:21:22 +00:00
erdgeist
be117f96a2
Increase send timeout. Also use an own variable for that.
2007-10-17 23:41:37 +00:00
erdgeist
32f17413fa
Increase send timeout. Also use an own variable for that.
2007-10-17 22:50:48 +00:00
erdgeist
28de135098
io_timeout is absolute, not relative :/
2007-10-17 21:13:13 +00:00
erdgeist
d1c57d90dd
Free iobatches on timeout
2007-10-17 20:25:18 +00:00
erdgeist
8e78ac7012
HEADS UP: you need to check out the latest libowfat! Huge allocations are now taken from mmap()ed regions, not from heap anymore
2007-10-17 14:43:14 +00:00
erdgeist
1e6b48cbc0
Sockets we write to now do also timeout
2007-10-16 18:23:36 +00:00
erdgeist
c730a24d0a
Fixed 24h clean bug. Allocate less memory for full scrape. Free torrents without any downloaders immediately.
2007-10-16 00:33:31 +00:00
erdgeist
28d88e3380
Exclude empty torrents from full scrape, also try to shrink full scrape buffer after it is full
2007-10-16 00:23:14 +00:00
erdgeist
3dc470d672
fixed line breaks in log
2007-10-15 18:03:13 +00:00
erdgeist
65cc45f129
Log all expansive operations to stderr
2007-10-15 18:01:38 +00:00
erdgeist
ffffd80719
Most open trackers do not have the problem of not being called often enough.. so do not introduce an extra timeout when waiting for activity. That also removes one of the last extraneous gettimeofday calls
2007-10-13 17:58:20 +00:00
erdgeist
6c1adb8fc8
since gettimeofday is rather expansive, we do only fetch time once in a 5 second period, when we are delivered a SIGALRM.
2007-10-13 17:40:37 +00:00
erdgeist
4c15dc7a70
make 64bit safe
2007-10-12 21:57:12 +00:00
erdgeist
dd82db18ad
There is a pool leak somewhere... try to find it
2007-10-06 19:17:21 +00:00
denis
0d36a8754e
fixed some stat output
2007-10-03 22:57:35 +00:00
erdgeist
25e59aeca3
Two more bugs in Makefile. Maybe I learn it one day
2007-10-01 00:31:59 +00:00
erdgeist
d0b5c463d9
Revert debug option in Makefile
2007-10-01 00:29:46 +00:00
erdgeist
fb5a228162
Makefile now runs under bsdmake and gnumake again
2007-10-01 00:27:26 +00:00
erdgeist
c350fa0b3c
New stats for s24s code, this is debug, do not use in real world
2007-09-26 16:49:13 +00:00