YGGo! - Open Source Web Search Engine

Written by inspiration to research Yggdrasil ecosystem, because of single Yacy node was down. Could be using for crawling regular websites, small business resources, local networks.

The goal - simple interface, clear architecture and lightweight server requirements but effective content discovery.

Online examples

An official node, that indexing only the local network
http://94.140.114.241/yggo (web mirror)

Requirements

php 8
php-php
php-pdo
curl-curl
sqlite / fts5

Installation

• The webroot dir is /public
• Single configuration file placed here /config/app.php where important option is DB settings
• By default, script automaticaly generate the database file in /storage folder but I need to play a bit with environment variables in code for that
• Set up the /crontab/crawler.php script for execution every the minute, but it mostly related of the configs and target network volume
• Script has no MVC model, because of super simple. I have a doubts to make it AJAX, but...

TODO / ideas

• Web pages full text ranking search
• Make search results pagination
• Improve yggdrasil links detection, add .ygg domain sone support
• Images search (basically implemented but requires testing and some performance optimization)
• Distributed index data sharing between the nodes trough service API