YGGverse
/
YGGo
mirror of https://github.com/YGGverse/YGGo.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
225 Commits
2 Branches
0 Tags
4.3 MiB
Tree: a1d8522006
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'a1d8522006'
${ noResults }
Commit Graph

5 Commits (a1d85220068991c0c7b8f212c943de9fa2a8d87e)

Author SHA1 Message Date
ghost 5999fb3a73 add distributed hosts crawling using yggo nodes manifest
2 years ago
ghost 79878d17fe add crawler / proxy user agent settings
2 years ago
ghost 0741a3e9ef implement image crawler
2 years ago
ghost eb3e70a7b7 fix robots.txt conditions
2 years ago
ghost 8e8d89db0e implement database cleaner
2 years ago