crawler/README.md

# KVAZAR Index Crawler

## Compatible

* [webapp](https://github.com/kvazar-network/webapp)
* [geminiapp](https://github.com/kvazar-network/geminiapp)

## Install

* `apt install git composer manticore php-fpm php-curl php-mbstring php-pdo php-bcmath`
* `git clone https://github.com/kvazar-network/crawler.git`
* `cd crawler`
* `composer update`

## Setup

* `cp example/config.json config.json`
* `crontab -e`:`* * * * * php src/index.php`
  * drop index: `php src/index.php drop`
  * optimize index: `php src/index.php optimize`

_To prevent data lose on server failures, set [binlog flush strategy](https://manual.manticoresearch.com/Logging/Binary_logging#Binary-flushing-strategies) to `binlog_flush = 1` in `/etc/manticoresearch/manticore.conf`_
update readme 2024-02-12 14:14:17 +00:00			`# KVAZAR Index Crawler`

			`## Compatible`

			`* [webapp](https://github.com/kvazar-network/webapp)`
update readme 2024-02-19 23:56:23 +00:00			`* [geminiapp](https://github.com/kvazar-network/geminiapp)`
update readme 2024-02-12 14:14:17 +00:00
			`## Install`

update readme 2024-02-13 00:20:59 +00:00			* `apt install git composer manticore php-fpm php-curl php-mbstring php-pdo php-bcmath`
update readme 2024-02-13 00:10:53 +00:00			* `git clone https://github.com/kvazar-network/crawler.git`
update readme 2024-02-12 14:20:27 +00:00			* `cd crawler`
update readme 2024-02-13 00:10:53 +00:00			* `composer update`
update readme 2024-03-04 18:02:19 +00:00
			`## Setup`

update readme 2024-02-12 14:20:27 +00:00			* `cp example/config.json config.json`
update readme 2024-02-13 00:14:24 +00:00			* `crontab -e`:`* * * * * php src/index.php`
			* drop index: `php src/index.php drop`
update readme 2024-03-04 18:02:19 +00:00			* optimize index: `php src/index.php optimize`

			_To prevent data lose on server failures, set [binlog flush strategy](https://manual.manticoresearch.com/Logging/Binary_logging#Binary-flushing-strategies) to `binlog_flush = 1` in `/etc/manticoresearch/manticore.conf`_