YGGo! Distributed Web Search Engine
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

52 lines
2.2 KiB

2 years ago
### YGGo! - Open Source Web Search Engine
2 years ago
Written by inspiration to research [Yggdrasil](https://yggdrasil-network.github.io) ecosystem, because of single [YaCy](https://yacy.net/) node was down.
2 years ago
Could be useful for crawling regular websites, small business resources, local networks.
2 years ago
2 years ago
The project goal - simple interface, clear architecture and lightweight server requirements.
2 years ago
2 years ago
#### Online examples
2 years ago
[http://[201:23b4:991a:634d:8359:4521:5576:15b7]/yggo](http://[201:23b4:991a:634d:8359:4521:5576:15b7]/yggo)
2 years ago
#### Screenshotes
![Search page](https://github.com/d47081/YGGo/blob/main/media/search.png?raw=true)
https://github.com/d47081/YGGo/tree/main/media
2 years ago
#### Requirements
```
php 8
php-php
php-pdo
curl-curl
sqlite / fts5
```
2 years ago
#### Installation
2 years ago
* The webroot dir is `/public`
* Single configuration file placed here `/config/app.php.txt` and need to be configured and renamed to `/config/app.php`
* By the idea, script automaticaly generates database structure in `/storage` folder (where could be nice to collect other variative and tmp data - like logs, etc)
2 years ago
* Set up the `/crontab/crawler.php` script for execution every the minute, but it mostly related of the configs and targetal network volume, there is no debug implemented yet, so let's silentize it by `/dev/null`
2 years ago
* Script has no MVC model, because of super simple. It's is just 2 files, and everything else stored incapsulated in `/library` classes.
2 years ago
2 years ago
#### TODO / ideas
2 years ago
* [x] Web pages full text ranking search
* [ ] Make search results pagination
2 years ago
* [ ] Improve yggdrasil links detection, add .ygg domain zone support
2 years ago
* [ ] Make page description visible - based on the cached content dump, when website description tag not available, add condition highlights
2 years ago
* [ ] Images search (basically implemented but requires testing and some performance optimization)
* [ ] Distributed index data sharing between the nodes trough service API
2 years ago
* [ ] An idea to make unique gravatars for sites without favicons, because simpler to ident, comparing to ipv6
* [ ] An idea to make some visitors counters, like in good old times?
2 years ago
#### Feedback
Please, feel free to share your ideas and bug reports [here](https://github.com/d47081/YGGo/issues) or use sources for your own implementations.
Have a good time.