YGGverse/YGGo
1
0
Fork 0
mirror of https://github.com/YGGverse/YGGo.git synced 2025-01-10 14:57:56 +00:00
Code Issues Projects Releases Wiki Activity

Merge branch 'main' of https://github.com/d47081/YGGo into main

Browse Source
This commit is contained in:
ghost 2023-04-02 22:04:44 +03:00
commit 1ee2c4cf72
1 changed files with 7 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

10
README.md
View File

@ -1,9 +1,9 @@
### YGGo! - Open Source Web Search Engine ### YGGo! - Open Source Web Search Engine
Written by inspiration to research [Yggdrasil](https://yggdrasil-network.github.io) ecosystem, because of single [YaCy](https://yacy.net/) node was down. Written by inspiration to discover [Yggdrasil](https://yggdrasil-network.github.io) ecosystem, because of last [YaCy](https://yacy.net/) node there was discontinued.
Could be useful for crawling regular websites, small business resources, local networks. This engine also could be useful for crawling regular websites, small business resources, local networks.
The project goal - simple interface, clear architecture and lightweight server requirements. The project goal - simple interface, clear architecture and lightweight server requirement.
#### Online examples #### Online examples
@ -42,6 +42,10 @@ sqlite / fts5
* [ ] Make page description visible - based on the cached content dump, when website description tag not available, add condition highlights * [ ] Make page description visible - based on the cached content dump, when website description tag not available, add condition highlights
* [ ] Images search (basically implemented but requires testing and some performance optimization) * [ ] Images search (basically implemented but requires testing and some performance optimization)
* [ ] Deprecated pages index cleaner (404 http codes etc) * [ ] Deprecated pages index cleaner (404 http codes etc)
* [ ] Crawl queue balancer, that depends from CPU available
* [ ] Implement smart queue algorithm that indexing new sites homepage in higher priority
* [ ] Implement database autobackup on crawl process completting
* [ ] Add transactions to prevent potential DB crashes
* [ ] Distributed index data sharing between the nodes trough service API * [ ] Distributed index data sharing between the nodes trough service API
* [ ] An idea to make unique gravatars for sites without favicons, because simpler to ident, comparing to ipv6 * [ ] An idea to make unique gravatars for sites without favicons, because simpler to ident, comparing to ipv6
* [ ] An idea to make some visitors counters, like in good old times? * [ ] An idea to make some visitors counters, like in good old times?