YGGverse/YGGo
1
0
Fork 0
mirror of https://github.com/YGGverse/YGGo.git synced 2025-01-10 06:48:14 +00:00
Code Issues Projects Releases Wiki Activity
269 Commits 2 Branches 0 Tags 4.2 MiB
28bf526d53
Commit Graph

56 Commits

Author SHA1 Message Date
ghost
2495a2bbc7 implement MySQL/Sphinx data model #3, add basical robots.txt support #2 2023-04-07 04:04:24 +03:00
ghost
79663c84db add CRAWL_META_ONLY option 2023-04-03 03:07:54 +03:00
ghost
04dbbc3adf make url/src column ukeys digital by using crc32 2023-04-02 18:56:56 +03:00
ghost
b218b8bbc3 make url/src columns unique keys, add insert/ignore construction 2023-04-02 18:09:44 +03:00
ghost
1485983b3a lock multi-thread execution 2023-04-02 00:27:33 +03:00
ghost
72985eaf9e initial commit 2023-04-01 19:29:39 +03:00